[==========] Running 7 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260203 09:15:40.200856 27553 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.26.232.126:43725
I20260203 09:15:40.202490 27553 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260203 09:15:40.203574 27553 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 09:15:40.221179 27560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:15:40.221185 27559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:15:40.222699 27553 server_base.cc:1060] running on GCE node
W20260203 09:15:40.221221 27562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:15:41.329843 27553 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260203 09:15:41.330092 27553 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260203 09:15:41.330288 27553 hybrid_clock.cc:648] HybridClock initialized: now 1770110141330263 us; error 0 us; skew 500 ppm
I20260203 09:15:41.331154 27553 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260203 09:15:41.336985 27553 webserver.cc:492] Webserver started at http://127.26.232.126:38101/ using document root <none> and password file <none>
I20260203 09:15:41.338152 27553 fs_manager.cc:362] Metadata directory not provided
I20260203 09:15:41.338411 27553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 09:15:41.338956 27553 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 09:15:41.346083 27553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770110140020880-27553-0/minicluster-data/master-0-root/instance:
uuid: "9728bccd8d994fea853e20d61f5e26e7"
format_stamp: "Formatted at 2026-02-03 09:15:41 on dist-test-slave-x12j"
I20260203 09:15:41.356361 27553 fs_manager.cc:696] Time spent creating directory manager: real 0.009s user 0.006s sys 0.004s
I20260203 09:15:41.362524 27568 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 09:15:41.364140 27553 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260203 09:15:41.364550 27553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770110140020880-27553-0/minicluster-data/master-0-root
uuid: "9728bccd8d994fea853e20d61f5e26e7"
format_stamp: "Formatted at 2026-02-03 09:15:41 on dist-test-slave-x12j"
I20260203 09:15:41.364972 27553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770110140020880-27553-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770110140020880-27553-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770110140020880-27553-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 09:15:41.426541 27553 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 09:15:41.428236 27553 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260203 09:15:41.428731 27553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 09:15:41.503544 27553 rpc_server.cc:307] RPC server started. Bound to: 127.26.232.126:43725
I20260203 09:15:41.503618 27620 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.232.126:43725 every 8 connection(s)
I20260203 09:15:41.511730 27621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:41.537127 27621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7: Bootstrap starting.
I20260203 09:15:41.543642 27621 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:41.545689 27621 log.cc:826] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7: Log is configured to *not* fsync() on all Append() calls
I20260203 09:15:41.550534 27621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7: No bootstrap required, opened a new log
I20260203 09:15:41.572875 27621 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9728bccd8d994fea853e20d61f5e26e7" member_type: VOTER }
I20260203 09:15:41.573590 27621 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:41.573853 27621 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9728bccd8d994fea853e20d61f5e26e7, State: Initialized, Role: FOLLOWER
I20260203 09:15:41.574744 27621 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9728bccd8d994fea853e20d61f5e26e7" member_type: VOTER }
I20260203 09:15:41.575282 27621 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260203 09:15:41.575554 27621 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260203 09:15:41.575892 27621 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:41.660027 27621 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9728bccd8d994fea853e20d61f5e26e7" member_type: VOTER }
I20260203 09:15:41.661464 27621 leader_election.cc:304] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9728bccd8d994fea853e20d61f5e26e7; no voters:
I20260203 09:15:41.663993 27621 leader_election.cc:290] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260203 09:15:41.664402 27624 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:15:41.667932 27624 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7 [term 1 LEADER]: Becoming Leader. State: Replica: 9728bccd8d994fea853e20d61f5e26e7, State: Running, Role: LEADER
I20260203 09:15:41.668881 27624 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9728bccd8d994fea853e20d61f5e26e7" member_type: VOTER }
I20260203 09:15:41.669556 27621 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260203 09:15:41.680282 27625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9728bccd8d994fea853e20d61f5e26e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9728bccd8d994fea853e20d61f5e26e7" member_type: VOTER } }
I20260203 09:15:41.680157 27626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9728bccd8d994fea853e20d61f5e26e7. Latest consensus state: current_term: 1 leader_uuid: "9728bccd8d994fea853e20d61f5e26e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9728bccd8d994fea853e20d61f5e26e7" member_type: VOTER } }
I20260203 09:15:41.680948 27625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7 [sys.catalog]: This master's current role is: LEADER
I20260203 09:15:41.681097 27626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7 [sys.catalog]: This master's current role is: LEADER
W20260203 09:15:41.684139 27574 tablet.cc:2378] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260203 09:15:41.688167 27632 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260203 09:15:41.702679 27632 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260203 09:15:41.705392 27553 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260203 09:15:41.719254 27632 catalog_manager.cc:1357] Generated new cluster ID: 5e1acef758864007854cc13d74534cce
I20260203 09:15:41.719589 27632 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260203 09:15:41.754362 27632 catalog_manager.cc:1380] Generated new certificate authority record
I20260203 09:15:41.756494 27632 catalog_manager.cc:1514] Loading token signing keys...
I20260203 09:15:41.772907 27632 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7: Generated new TSK 0
I20260203 09:15:41.774219 27632 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260203 09:15:41.836405 27553 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 09:15:41.844658 27643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:15:41.845630 27644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:15:41.850198 27553 server_base.cc:1060] running on GCE node
W20260203 09:15:41.850880 27646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:15:41.851742 27553 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260203 09:15:41.851941 27553 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260203 09:15:41.852108 27553 hybrid_clock.cc:648] HybridClock initialized: now 1770110141852091 us; error 0 us; skew 500 ppm
I20260203 09:15:41.852725 27553 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260203 09:15:41.857295 27553 webserver.cc:492] Webserver started at http://127.26.232.65:34737/ using document root <none> and password file <none>
I20260203 09:15:41.857862 27553 fs_manager.cc:362] Metadata directory not provided
I20260203 09:15:41.858047 27553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 09:15:41.858319 27553 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 09:15:41.859470 27553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770110140020880-27553-0/minicluster-data/ts-0-root/instance:
uuid: "dabe360bbf6a4beaae517c7b84267c38"
format_stamp: "Formatted at 2026-02-03 09:15:41 on dist-test-slave-x12j"
I20260203 09:15:41.865212 27553 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260203 09:15:41.869653 27651 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 09:15:41.870461 27553 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.003s
I20260203 09:15:41.870748 27553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770110140020880-27553-0/minicluster-data/ts-0-root
uuid: "dabe360bbf6a4beaae517c7b84267c38"
format_stamp: "Formatted at 2026-02-03 09:15:41 on dist-test-slave-x12j"
I20260203 09:15:41.871058 27553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770110140020880-27553-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770110140020880-27553-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770110140020880-27553-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 09:15:41.886277 27553 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 09:15:41.887725 27553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 09:15:41.890558 27553 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260203 09:15:41.895210 27553 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260203 09:15:41.895468 27553 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260203 09:15:41.895756 27553 ts_tablet_manager.cc:616] Registered 0 tablets
I20260203 09:15:41.895921 27553 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260203 09:15:41.998659 27553 rpc_server.cc:307] RPC server started. Bound to: 127.26.232.65:39877
I20260203 09:15:41.998797 27715 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.232.65:39877 every 8 connection(s)
I20260203 09:15:42.006803 27553 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 09:15:42.016816 27720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:15:42.020004 27721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:15:42.034265 27716 heartbeater.cc:344] Connected to a master server at 127.26.232.126:43725
I20260203 09:15:42.035081 27716 heartbeater.cc:461] Registering TS with master...
I20260203 09:15:42.037081 27716 heartbeater.cc:507] Master 127.26.232.126:43725 requested a full tablet report, sending...
I20260203 09:15:42.040792 27553 server_base.cc:1060] running on GCE node
I20260203 09:15:42.041482 27585 ts_manager.cc:194] Registered new tserver with Master: dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877)
W20260203 09:15:42.042102 27723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:15:42.043318 27553 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260203 09:15:42.043597 27553 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260203 09:15:42.043819 27553 hybrid_clock.cc:648] HybridClock initialized: now 1770110142043802 us; error 0 us; skew 500 ppm
I20260203 09:15:42.044633 27553 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260203 09:15:42.044795 27585 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57160
I20260203 09:15:42.048411 27553 webserver.cc:492] Webserver started at http://127.26.232.66:43799/ using document root <none> and password file <none>
I20260203 09:15:42.049347 27553 fs_manager.cc:362] Metadata directory not provided
I20260203 09:15:42.049590 27553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 09:15:42.049898 27553 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 09:15:42.051347 27553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770110140020880-27553-0/minicluster-data/ts-1-root/instance:
uuid: "fbb608d94d274640813c2860cf06d12b"
format_stamp: "Formatted at 2026-02-03 09:15:42 on dist-test-slave-x12j"
I20260203 09:15:42.056845 27553 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260203 09:15:42.061906 27728 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 09:15:42.062912 27553 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
I20260203 09:15:42.063206 27553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770110140020880-27553-0/minicluster-data/ts-1-root
uuid: "fbb608d94d274640813c2860cf06d12b"
format_stamp: "Formatted at 2026-02-03 09:15:42 on dist-test-slave-x12j"
I20260203 09:15:42.063508 27553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770110140020880-27553-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770110140020880-27553-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770110140020880-27553-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 09:15:42.100134 27553 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 09:15:42.101828 27553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 09:15:42.104764 27553 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260203 09:15:42.108717 27553 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260203 09:15:42.108933 27553 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260203 09:15:42.109175 27553 ts_tablet_manager.cc:616] Registered 0 tablets
I20260203 09:15:42.109323 27553 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260203 09:15:42.206570 27553 rpc_server.cc:307] RPC server started. Bound to: 127.26.232.66:36849
I20260203 09:15:42.206642 27792 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.232.66:36849 every 8 connection(s)
I20260203 09:15:42.214800 27553 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 09:15:42.224678 27796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:15:42.228011 27793 heartbeater.cc:344] Connected to a master server at 127.26.232.126:43725
I20260203 09:15:42.228516 27793 heartbeater.cc:461] Registering TS with master...
I20260203 09:15:42.229843 27793 heartbeater.cc:507] Master 127.26.232.126:43725 requested a full tablet report, sending...
I20260203 09:15:42.231438 27553 server_base.cc:1060] running on GCE node
W20260203 09:15:42.231674 27797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:15:42.233595 27799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:15:42.233851 27585 ts_manager.cc:194] Registered new tserver with Master: fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849)
I20260203 09:15:42.234860 27553 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260203 09:15:42.235160 27553 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260203 09:15:42.235335 27585 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57170
I20260203 09:15:42.235373 27553 hybrid_clock.cc:648] HybridClock initialized: now 1770110142235355 us; error 0 us; skew 500 ppm
I20260203 09:15:42.236608 27553 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260203 09:15:42.239482 27553 webserver.cc:492] Webserver started at http://127.26.232.67:35107/ using document root <none> and password file <none>
I20260203 09:15:42.240139 27553 fs_manager.cc:362] Metadata directory not provided
I20260203 09:15:42.240378 27553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 09:15:42.240733 27553 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 09:15:42.242194 27553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770110140020880-27553-0/minicluster-data/ts-2-root/instance:
uuid: "c565ce064e6347999f31e94e51b3eb3b"
format_stamp: "Formatted at 2026-02-03 09:15:42 on dist-test-slave-x12j"
I20260203 09:15:42.248363 27553 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260203 09:15:42.253271 27804 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 09:15:42.254457 27553 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260203 09:15:42.254904 27553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770110140020880-27553-0/minicluster-data/ts-2-root
uuid: "c565ce064e6347999f31e94e51b3eb3b"
format_stamp: "Formatted at 2026-02-03 09:15:42 on dist-test-slave-x12j"
I20260203 09:15:42.255456 27553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770110140020880-27553-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770110140020880-27553-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1770110140020880-27553-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 09:15:42.276818 27553 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 09:15:42.278502 27553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 09:15:42.280311 27553 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260203 09:15:42.283245 27553 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260203 09:15:42.283537 27553 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260203 09:15:42.283828 27553 ts_tablet_manager.cc:616] Registered 0 tablets
I20260203 09:15:42.284039 27553 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260203 09:15:42.373845 27553 rpc_server.cc:307] RPC server started. Bound to: 127.26.232.67:36111
I20260203 09:15:42.374071 27866 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.232.67:36111 every 8 connection(s)
I20260203 09:15:42.392750 27867 heartbeater.cc:344] Connected to a master server at 127.26.232.126:43725
I20260203 09:15:42.393126 27867 heartbeater.cc:461] Registering TS with master...
I20260203 09:15:42.394163 27867 heartbeater.cc:507] Master 127.26.232.126:43725 requested a full tablet report, sending...
I20260203 09:15:42.396868 27585 ts_manager.cc:194] Registered new tserver with Master: c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:42.397557 27553 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017012255s
I20260203 09:15:42.398543 27585 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57176
I20260203 09:15:42.452881 27585 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57192:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260203 09:15:42.456617 27585 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260203 09:15:42.574654 27756 tablet_service.cc:1505] Processing CreateTablet for tablet 074d2018d1254198abb02cd9463e64f9 (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260203 09:15:42.578490 27756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 074d2018d1254198abb02cd9463e64f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.579375 27755 tablet_service.cc:1505] Processing CreateTablet for tablet a88ea51ed509432fae935d15fcd8a913 (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260203 09:15:42.586601 27753 tablet_service.cc:1505] Processing CreateTablet for tablet 05e6e3dcf873416a9cb57fccfcd6f002 (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260203 09:15:42.589208 27752 tablet_service.cc:1505] Processing CreateTablet for tablet 4989b3f204bb43ada40440b6894de910 (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260203 09:15:42.590878 27754 tablet_service.cc:1505] Processing CreateTablet for tablet ce1a18a70d52493abcb4675c3a6e1b1f (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260203 09:15:42.591795 27755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a88ea51ed509432fae935d15fcd8a913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.593688 27751 tablet_service.cc:1505] Processing CreateTablet for tablet d3fac0b874aa4090bd3c394c817e14ec (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260203 09:15:42.596217 27753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05e6e3dcf873416a9cb57fccfcd6f002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.598052 27754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce1a18a70d52493abcb4675c3a6e1b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.599272 27752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4989b3f204bb43ada40440b6894de910. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.603227 27751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3fac0b874aa4090bd3c394c817e14ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.609020 27750 tablet_service.cc:1505] Processing CreateTablet for tablet daa6f7f8fc244b1aa48b751d437dcc77 (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260203 09:15:42.611053 27750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daa6f7f8fc244b1aa48b751d437dcc77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.616317 27681 tablet_service.cc:1505] Processing CreateTablet for tablet 074d2018d1254198abb02cd9463e64f9 (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260203 09:15:42.619601 27681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 074d2018d1254198abb02cd9463e64f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.625978 27679 tablet_service.cc:1505] Processing CreateTablet for tablet ce1a18a70d52493abcb4675c3a6e1b1f (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260203 09:15:42.632769 27680 tablet_service.cc:1505] Processing CreateTablet for tablet a88ea51ed509432fae935d15fcd8a913 (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260203 09:15:42.634737 27680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a88ea51ed509432fae935d15fcd8a913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.636083 27679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce1a18a70d52493abcb4675c3a6e1b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.629072 27677 tablet_service.cc:1505] Processing CreateTablet for tablet 4989b3f204bb43ada40440b6894de910 (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260203 09:15:42.640075 27678 tablet_service.cc:1505] Processing CreateTablet for tablet 05e6e3dcf873416a9cb57fccfcd6f002 (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260203 09:15:42.640554 27676 tablet_service.cc:1505] Processing CreateTablet for tablet d3fac0b874aa4090bd3c394c817e14ec (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260203 09:15:42.641386 27675 tablet_service.cc:1505] Processing CreateTablet for tablet daa6f7f8fc244b1aa48b751d437dcc77 (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260203 09:15:42.643110 27678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05e6e3dcf873416a9cb57fccfcd6f002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.645694 27677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4989b3f204bb43ada40440b6894de910. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.647289 27676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3fac0b874aa4090bd3c394c817e14ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.653185 27675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daa6f7f8fc244b1aa48b751d437dcc77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.653697 27749 tablet_service.cc:1505] Processing CreateTablet for tablet ed0fc738bbc64c31a0b86c6b1f807f7e (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260203 09:15:42.658532 27749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed0fc738bbc64c31a0b86c6b1f807f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.651518 27673 tablet_service.cc:1505] Processing CreateTablet for tablet ed0fc738bbc64c31a0b86c6b1f807f7e (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260203 09:15:42.661163 27673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed0fc738bbc64c31a0b86c6b1f807f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.667548 27672 tablet_service.cc:1505] Processing CreateTablet for tablet 60680bc581a44de4bb9b29c65e4d0f01 (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260203 09:15:42.675652 27748 tablet_service.cc:1505] Processing CreateTablet for tablet 60680bc581a44de4bb9b29c65e4d0f01 (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260203 09:15:42.676858 27672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60680bc581a44de4bb9b29c65e4d0f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.682569 27748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60680bc581a44de4bb9b29c65e4d0f01. 1 dirs total, 0 dirs full, 0 dirs failed
W20260203 09:15:42.697824 27634 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:15:42.735193 27832 tablet_service.cc:1505] Processing CreateTablet for tablet 074d2018d1254198abb02cd9463e64f9 (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260203 09:15:42.738330 27832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 074d2018d1254198abb02cd9463e64f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.746626 27885 tablet_bootstrap.cc:492] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38: Bootstrap starting.
I20260203 09:15:42.757038 27830 tablet_service.cc:1505] Processing CreateTablet for tablet ce1a18a70d52493abcb4675c3a6e1b1f (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260203 09:15:42.760491 27830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce1a18a70d52493abcb4675c3a6e1b1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.768474 27831 tablet_service.cc:1505] Processing CreateTablet for tablet a88ea51ed509432fae935d15fcd8a913 (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260203 09:15:42.770814 27831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a88ea51ed509432fae935d15fcd8a913. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.789177 27829 tablet_service.cc:1505] Processing CreateTablet for tablet 05e6e3dcf873416a9cb57fccfcd6f002 (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260203 09:15:42.798504 27828 tablet_service.cc:1505] Processing CreateTablet for tablet 4989b3f204bb43ada40440b6894de910 (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260203 09:15:42.809243 27829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05e6e3dcf873416a9cb57fccfcd6f002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.814389 27827 tablet_service.cc:1505] Processing CreateTablet for tablet d3fac0b874aa4090bd3c394c817e14ec (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260203 09:15:42.846560 27825 tablet_service.cc:1505] Processing CreateTablet for tablet ed0fc738bbc64c31a0b86c6b1f807f7e (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260203 09:15:42.843289 27828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4989b3f204bb43ada40440b6894de910. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.857965 27824 tablet_service.cc:1505] Processing CreateTablet for tablet 60680bc581a44de4bb9b29c65e4d0f01 (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260203 09:15:42.851992 27826 tablet_service.cc:1505] Processing CreateTablet for tablet daa6f7f8fc244b1aa48b751d437dcc77 (DEFAULT_TABLE table=test-workload [id=0130168ee5a84c4b9f98312a2bbd1f4f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260203 09:15:42.876909 27825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed0fc738bbc64c31a0b86c6b1f807f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.884994 27826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daa6f7f8fc244b1aa48b751d437dcc77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.886703 27824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60680bc581a44de4bb9b29c65e4d0f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.900326 27886 tablet_bootstrap.cc:492] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b: Bootstrap starting.
I20260203 09:15:42.907215 27827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3fac0b874aa4090bd3c394c817e14ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:15:42.917841 27885 tablet_bootstrap.cc:654] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:42.940850 27886 tablet_bootstrap.cc:654] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:42.956843 27887 tablet_bootstrap.cc:492] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b: Bootstrap starting.
I20260203 09:15:42.967808 27885 tablet_bootstrap.cc:492] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38: No bootstrap required, opened a new log
I20260203 09:15:42.968467 27885 ts_tablet_manager.cc:1403] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38: Time spent bootstrapping tablet: real 0.222s user 0.015s sys 0.036s
I20260203 09:15:42.974063 27885 raft_consensus.cc:359] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:42.974833 27885 raft_consensus.cc:385] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:42.975281 27886 tablet_bootstrap.cc:492] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b: No bootstrap required, opened a new log
I20260203 09:15:42.975131 27885 raft_consensus.cc:740] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabe360bbf6a4beaae517c7b84267c38, State: Initialized, Role: FOLLOWER
I20260203 09:15:42.975912 27886 ts_tablet_manager.cc:1403] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b: Time spent bootstrapping tablet: real 0.076s user 0.015s sys 0.013s
I20260203 09:15:42.977265 27885 consensus_queue.cc:260] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:42.978092 27887 tablet_bootstrap.cc:654] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:42.981657 27886 raft_consensus.cc:359] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:42.982482 27886 raft_consensus.cc:385] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:42.982789 27886 raft_consensus.cc:740] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Initialized, Role: FOLLOWER
I20260203 09:15:42.983642 27886 consensus_queue.cc:260] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:42.987354 27716 heartbeater.cc:499] Master 127.26.232.126:43725 was elected leader, sending a full tablet report...
I20260203 09:15:42.987609 27885 ts_tablet_manager.cc:1434] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38: Time spent starting tablet: real 0.019s user 0.007s sys 0.005s
I20260203 09:15:42.988682 27885 tablet_bootstrap.cc:492] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38: Bootstrap starting.
I20260203 09:15:42.989773 27886 ts_tablet_manager.cc:1434] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b: Time spent starting tablet: real 0.013s user 0.006s sys 0.002s
I20260203 09:15:42.990427 27793 heartbeater.cc:499] Master 127.26.232.126:43725 was elected leader, sending a full tablet report...
I20260203 09:15:42.995024 27886 tablet_bootstrap.cc:492] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b: Bootstrap starting.
I20260203 09:15:42.997967 27885 tablet_bootstrap.cc:654] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:43.001271 27886 tablet_bootstrap.cc:654] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:43.011148 27885 tablet_bootstrap.cc:492] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38: No bootstrap required, opened a new log
I20260203 09:15:43.011674 27885 ts_tablet_manager.cc:1403] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38: Time spent bootstrapping tablet: real 0.023s user 0.008s sys 0.008s
I20260203 09:15:43.014127 27886 tablet_bootstrap.cc:492] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b: No bootstrap required, opened a new log
I20260203 09:15:43.014534 27885 raft_consensus.cc:359] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.015259 27886 ts_tablet_manager.cc:1403] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b: Time spent bootstrapping tablet: real 0.020s user 0.014s sys 0.004s
I20260203 09:15:43.015326 27885 raft_consensus.cc:385] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.015733 27885 raft_consensus.cc:740] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabe360bbf6a4beaae517c7b84267c38, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.016824 27887 tablet_bootstrap.cc:492] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b: No bootstrap required, opened a new log
I20260203 09:15:43.016664 27885 consensus_queue.cc:260] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.017287 27887 ts_tablet_manager.cc:1403] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b: Time spent bootstrapping tablet: real 0.080s user 0.017s sys 0.000s
I20260203 09:15:43.018162 27886 raft_consensus.cc:359] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.018853 27886 raft_consensus.cc:385] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.019084 27885 ts_tablet_manager.cc:1434] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260203 09:15:43.019153 27886 raft_consensus.cc:740] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.020089 27885 tablet_bootstrap.cc:492] T ed0fc738bbc64c31a0b86c6b1f807f7e P dabe360bbf6a4beaae517c7b84267c38: Bootstrap starting.
I20260203 09:15:43.019948 27886 consensus_queue.cc:260] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.020269 27887 raft_consensus.cc:359] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.025589 27887 raft_consensus.cc:385] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.025918 27887 raft_consensus.cc:740] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c565ce064e6347999f31e94e51b3eb3b, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.026660 27887 consensus_queue.cc:260] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.027276 27885 tablet_bootstrap.cc:654] T ed0fc738bbc64c31a0b86c6b1f807f7e P dabe360bbf6a4beaae517c7b84267c38: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:43.022404 27886 ts_tablet_manager.cc:1434] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20260203 09:15:43.028487 27886 tablet_bootstrap.cc:492] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b: Bootstrap starting.
I20260203 09:15:43.034557 27886 tablet_bootstrap.cc:654] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:43.037433 27892 raft_consensus.cc:493] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:15:43.037900 27892 raft_consensus.cc:515] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.038480 27885 tablet_bootstrap.cc:492] T ed0fc738bbc64c31a0b86c6b1f807f7e P dabe360bbf6a4beaae517c7b84267c38: No bootstrap required, opened a new log
I20260203 09:15:43.038942 27885 ts_tablet_manager.cc:1403] T ed0fc738bbc64c31a0b86c6b1f807f7e P dabe360bbf6a4beaae517c7b84267c38: Time spent bootstrapping tablet: real 0.019s user 0.016s sys 0.001s
I20260203 09:15:43.040814 27892 leader_election.cc:290] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:43.041944 27885 raft_consensus.cc:359] T ed0fc738bbc64c31a0b86c6b1f807f7e P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.042647 27885 raft_consensus.cc:385] T ed0fc738bbc64c31a0b86c6b1f807f7e P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.042963 27885 raft_consensus.cc:740] T ed0fc738bbc64c31a0b86c6b1f807f7e P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabe360bbf6a4beaae517c7b84267c38, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.043663 27885 consensus_queue.cc:260] T ed0fc738bbc64c31a0b86c6b1f807f7e P dabe360bbf6a4beaae517c7b84267c38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.046356 27885 ts_tablet_manager.cc:1434] T ed0fc738bbc64c31a0b86c6b1f807f7e P dabe360bbf6a4beaae517c7b84267c38: Time spent starting tablet: real 0.007s user 0.006s sys 0.002s
I20260203 09:15:43.047410 27885 tablet_bootstrap.cc:492] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38: Bootstrap starting.
I20260203 09:15:43.053684 27885 tablet_bootstrap.cc:654] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:43.065539 27885 tablet_bootstrap.cc:492] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38: No bootstrap required, opened a new log
I20260203 09:15:43.066022 27885 ts_tablet_manager.cc:1403] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38: Time spent bootstrapping tablet: real 0.019s user 0.013s sys 0.004s
I20260203 09:15:43.066505 27886 tablet_bootstrap.cc:492] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b: No bootstrap required, opened a new log
I20260203 09:15:43.067013 27886 ts_tablet_manager.cc:1403] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b: Time spent bootstrapping tablet: real 0.039s user 0.006s sys 0.009s
I20260203 09:15:43.068769 27885 raft_consensus.cc:359] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.069490 27885 raft_consensus.cc:385] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.069777 27885 raft_consensus.cc:740] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabe360bbf6a4beaae517c7b84267c38, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.069833 27886 raft_consensus.cc:359] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.070598 27885 consensus_queue.cc:260] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.071776 27887 ts_tablet_manager.cc:1434] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b: Time spent starting tablet: real 0.054s user 0.014s sys 0.014s
I20260203 09:15:43.073108 27887 tablet_bootstrap.cc:492] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b: Bootstrap starting.
I20260203 09:15:43.073781 27885 ts_tablet_manager.cc:1434] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38: Time spent starting tablet: real 0.007s user 0.007s sys 0.001s
I20260203 09:15:43.074097 27867 heartbeater.cc:499] Master 127.26.232.126:43725 was elected leader, sending a full tablet report...
I20260203 09:15:43.074656 27885 tablet_bootstrap.cc:492] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38: Bootstrap starting.
I20260203 09:15:43.079720 27887 tablet_bootstrap.cc:654] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:43.081557 27890 raft_consensus.cc:493] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:15:43.082023 27890 raft_consensus.cc:515] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.084440 27890 leader_election.cc:290] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:43.070659 27886 raft_consensus.cc:385] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.084745 27885 tablet_bootstrap.cc:654] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:43.085003 27886 raft_consensus.cc:740] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.086421 27886 consensus_queue.cc:260] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.091104 27886 ts_tablet_manager.cc:1434] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b: Time spent starting tablet: real 0.024s user 0.007s sys 0.002s
I20260203 09:15:43.092365 27886 tablet_bootstrap.cc:492] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b: Bootstrap starting.
I20260203 09:15:43.102573 27886 tablet_bootstrap.cc:654] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:43.108596 27895 raft_consensus.cc:493] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:15:43.109174 27895 raft_consensus.cc:515] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.126042 27887 tablet_bootstrap.cc:492] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b: No bootstrap required, opened a new log
I20260203 09:15:43.126564 27887 ts_tablet_manager.cc:1403] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b: Time spent bootstrapping tablet: real 0.054s user 0.007s sys 0.008s
I20260203 09:15:43.111806 27895 leader_election.cc:290] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849)
I20260203 09:15:43.136006 27886 tablet_bootstrap.cc:492] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b: No bootstrap required, opened a new log
I20260203 09:15:43.137555 27886 ts_tablet_manager.cc:1403] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b: Time spent bootstrapping tablet: real 0.045s user 0.010s sys 0.003s
I20260203 09:15:43.144081 27892 raft_consensus.cc:493] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:15:43.143922 27691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05e6e3dcf873416a9cb57fccfcd6f002" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabe360bbf6a4beaae517c7b84267c38" is_pre_election: true
I20260203 09:15:43.145047 27892 raft_consensus.cc:515] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.146636 27885 tablet_bootstrap.cc:492] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38: No bootstrap required, opened a new log
I20260203 09:15:43.147135 27885 ts_tablet_manager.cc:1403] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38: Time spent bootstrapping tablet: real 0.073s user 0.010s sys 0.005s
I20260203 09:15:43.140045 27887 raft_consensus.cc:359] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.150036 27892 leader_election.cc:290] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:43.149386 27887 raft_consensus.cc:385] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.152187 27890 raft_consensus.cc:493] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:15:43.152070 27887 raft_consensus.cc:740] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c565ce064e6347999f31e94e51b3eb3b, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.158567 27885 raft_consensus.cc:359] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.154383 27691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a88ea51ed509432fae935d15fcd8a913" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabe360bbf6a4beaae517c7b84267c38" is_pre_election: true
I20260203 09:15:43.157574 27890 raft_consensus.cc:515] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.159461 27885 raft_consensus.cc:385] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.177989 27886 raft_consensus.cc:359] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.178237 27885 raft_consensus.cc:740] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabe360bbf6a4beaae517c7b84267c38, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.181012 27886 raft_consensus.cc:385] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.182071 27886 raft_consensus.cc:740] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.182806 27886 consensus_queue.cc:260] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.159492 27887 consensus_queue.cc:260] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.180436 27691 raft_consensus.cc:2468] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 0.
I20260203 09:15:43.185856 27885 consensus_queue.cc:260] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.190378 27890 leader_election.cc:290] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
W20260203 09:15:43.195158 27731 leader_election.cc:343] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:15:43.197918 27886 ts_tablet_manager.cc:1434] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b: Time spent starting tablet: real 0.060s user 0.007s sys 0.004s
I20260203 09:15:43.202898 27886 tablet_bootstrap.cc:492] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b: Bootstrap starting.
I20260203 09:15:43.204934 27768 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "60680bc581a44de4bb9b29c65e4d0f01" candidate_uuid: "dabe360bbf6a4beaae517c7b84267c38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbb608d94d274640813c2860cf06d12b" is_pre_election: true
I20260203 09:15:43.206135 27767 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "074d2018d1254198abb02cd9463e64f9" candidate_uuid: "dabe360bbf6a4beaae517c7b84267c38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbb608d94d274640813c2860cf06d12b" is_pre_election: true
W20260203 09:15:43.211850 27652 leader_election.cc:343] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:15:43.212584 27652 leader_election.cc:343] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:15:43.200405 27731 leader_election.cc:304] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dabe360bbf6a4beaae517c7b84267c38, fbb608d94d274640813c2860cf06d12b; no voters:
I20260203 09:15:43.221709 27892 raft_consensus.cc:2804] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:15:43.225229 27892 raft_consensus.cc:493] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:15:43.225629 27892 raft_consensus.cc:3060] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.223219 27887 ts_tablet_manager.cc:1434] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b: Time spent starting tablet: real 0.096s user 0.008s sys 0.014s
I20260203 09:15:43.224336 27841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a88ea51ed509432fae935d15fcd8a913" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c565ce064e6347999f31e94e51b3eb3b" is_pre_election: true
I20260203 09:15:43.224529 27842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05e6e3dcf873416a9cb57fccfcd6f002" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c565ce064e6347999f31e94e51b3eb3b" is_pre_election: true
I20260203 09:15:43.228165 27887 tablet_bootstrap.cc:492] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b: Bootstrap starting.
W20260203 09:15:43.233140 27731 leader_election.cc:343] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:15:43.233640 27731 leader_election.cc:304] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbb608d94d274640813c2860cf06d12b; no voters: c565ce064e6347999f31e94e51b3eb3b, dabe360bbf6a4beaae517c7b84267c38
I20260203 09:15:43.228507 27841 raft_consensus.cc:2468] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 0.
I20260203 09:15:43.253065 27768 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a88ea51ed509432fae935d15fcd8a913" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbb608d94d274640813c2860cf06d12b" is_pre_election: true
I20260203 09:15:43.252216 27842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "074d2018d1254198abb02cd9463e64f9" candidate_uuid: "dabe360bbf6a4beaae517c7b84267c38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c565ce064e6347999f31e94e51b3eb3b" is_pre_election: true
I20260203 09:15:43.251657 27841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "60680bc581a44de4bb9b29c65e4d0f01" candidate_uuid: "dabe360bbf6a4beaae517c7b84267c38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c565ce064e6347999f31e94e51b3eb3b" is_pre_election: true
I20260203 09:15:43.256625 27691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a88ea51ed509432fae935d15fcd8a913" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabe360bbf6a4beaae517c7b84267c38" is_pre_election: true
I20260203 09:15:43.257370 27691 raft_consensus.cc:2468] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c565ce064e6347999f31e94e51b3eb3b in term 0.
I20260203 09:15:43.259341 27887 tablet_bootstrap.cc:654] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:43.260949 27913 raft_consensus.cc:2749] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260203 09:15:43.264146 27654 leader_election.cc:343] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:15:43.264628 27654 leader_election.cc:304] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabe360bbf6a4beaae517c7b84267c38; no voters: c565ce064e6347999f31e94e51b3eb3b, fbb608d94d274640813c2860cf06d12b
I20260203 09:15:43.265676 27890 raft_consensus.cc:2749] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:15:43.267468 27807 leader_election.cc:304] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, dabe360bbf6a4beaae517c7b84267c38; no voters:
I20260203 09:15:43.266608 27886 tablet_bootstrap.cc:654] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:43.268746 27892 raft_consensus.cc:515] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.270946 27885 ts_tablet_manager.cc:1434] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38: Time spent starting tablet: real 0.123s user 0.006s sys 0.036s
W20260203 09:15:43.267550 27654 leader_election.cc:343] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:15:43.271392 27895 raft_consensus.cc:2804] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:15:43.273396 27895 raft_consensus.cc:493] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:15:43.274503 27768 raft_consensus.cc:2393] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c565ce064e6347999f31e94e51b3eb3b in current term 1: Already voted for candidate fbb608d94d274640813c2860cf06d12b in this term.
I20260203 09:15:43.274528 27895 raft_consensus.cc:3060] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.273773 27913 raft_consensus.cc:493] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:15:43.273028 27654 leader_election.cc:304] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dabe360bbf6a4beaae517c7b84267c38; no voters: c565ce064e6347999f31e94e51b3eb3b, fbb608d94d274640813c2860cf06d12b
I20260203 09:15:43.276860 27890 raft_consensus.cc:2749] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:15:43.279752 27885 tablet_bootstrap.cc:492] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38: Bootstrap starting.
I20260203 09:15:43.278005 27913 raft_consensus.cc:515] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.283836 27691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a88ea51ed509432fae935d15fcd8a913" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
I20260203 09:15:43.283496 27892 leader_election.cc:290] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 1 election: Requested vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:43.284925 27691 raft_consensus.cc:3060] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.285282 27841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a88ea51ed509432fae935d15fcd8a913" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
I20260203 09:15:43.287036 27887 tablet_bootstrap.cc:492] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b: No bootstrap required, opened a new log
I20260203 09:15:43.288575 27887 ts_tablet_manager.cc:1403] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b: Time spent bootstrapping tablet: real 0.061s user 0.010s sys 0.006s
I20260203 09:15:43.289248 27895 raft_consensus.cc:515] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.293754 27841 raft_consensus.cc:2393] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fbb608d94d274640813c2860cf06d12b in current term 1: Already voted for candidate c565ce064e6347999f31e94e51b3eb3b in this term.
I20260203 09:15:43.295950 27895 leader_election.cc:290] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 1 election: Requested vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849)
I20260203 09:15:43.294098 27913 leader_election.cc:290] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:43.296821 27690 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a88ea51ed509432fae935d15fcd8a913" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
I20260203 09:15:43.298075 27689 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed0fc738bbc64c31a0b86c6b1f807f7e" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabe360bbf6a4beaae517c7b84267c38" is_pre_election: true
I20260203 09:15:43.301446 27842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed0fc738bbc64c31a0b86c6b1f807f7e" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c565ce064e6347999f31e94e51b3eb3b" is_pre_election: true
I20260203 09:15:43.302152 27842 raft_consensus.cc:2468] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 0.
I20260203 09:15:43.300928 27689 raft_consensus.cc:2468] T ed0fc738bbc64c31a0b86c6b1f807f7e P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 0.
I20260203 09:15:43.302579 27887 raft_consensus.cc:359] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.303629 27887 raft_consensus.cc:385] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.303951 27887 raft_consensus.cc:740] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c565ce064e6347999f31e94e51b3eb3b, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.303992 27731 leader_election.cc:304] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dabe360bbf6a4beaae517c7b84267c38, fbb608d94d274640813c2860cf06d12b; no voters:
I20260203 09:15:43.304412 27767 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a88ea51ed509432fae935d15fcd8a913" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbb608d94d274640813c2860cf06d12b"
I20260203 09:15:43.304857 27913 raft_consensus.cc:2804] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:15:43.306043 27887 consensus_queue.cc:260] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.307561 27913 raft_consensus.cc:493] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:15:43.308369 27805 leader_election.cc:304] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b; no voters: dabe360bbf6a4beaae517c7b84267c38, fbb608d94d274640813c2860cf06d12b
I20260203 09:15:43.308585 27913 raft_consensus.cc:3060] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.310547 27887 ts_tablet_manager.cc:1434] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b: Time spent starting tablet: real 0.021s user 0.006s sys 0.002s
I20260203 09:15:43.310875 27886 tablet_bootstrap.cc:492] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b: No bootstrap required, opened a new log
I20260203 09:15:43.311358 27886 ts_tablet_manager.cc:1403] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b: Time spent bootstrapping tablet: real 0.109s user 0.008s sys 0.015s
I20260203 09:15:43.312286 27895 raft_consensus.cc:2749] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260203 09:15:43.312965 27887 tablet_bootstrap.cc:492] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b: Bootstrap starting.
I20260203 09:15:43.313594 27691 raft_consensus.cc:2468] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 1.
I20260203 09:15:43.316200 27731 leader_election.cc:304] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dabe360bbf6a4beaae517c7b84267c38, fbb608d94d274640813c2860cf06d12b; no voters:
I20260203 09:15:43.318658 27892 raft_consensus.cc:2804] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:15:43.322573 27913 raft_consensus.cc:515] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.323074 27885 tablet_bootstrap.cc:654] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:43.322690 27886 raft_consensus.cc:359] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.324259 27886 raft_consensus.cc:385] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.325256 27892 raft_consensus.cc:697] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 1 LEADER]: Becoming Leader. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Running, Role: LEADER
I20260203 09:15:43.325609 27886 raft_consensus.cc:740] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.327035 27913 leader_election.cc:290] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 1 election: Requested vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:43.327132 27691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed0fc738bbc64c31a0b86c6b1f807f7e" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
I20260203 09:15:43.327625 27842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed0fc738bbc64c31a0b86c6b1f807f7e" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
I20260203 09:15:43.327880 27691 raft_consensus.cc:3060] T ed0fc738bbc64c31a0b86c6b1f807f7e P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.328202 27842 raft_consensus.cc:3060] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.329708 27886 consensus_queue.cc:260] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.336040 27887 tablet_bootstrap.cc:654] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:43.337047 27886 ts_tablet_manager.cc:1434] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b: Time spent starting tablet: real 0.025s user 0.012s sys 0.000s
I20260203 09:15:43.338729 27886 tablet_bootstrap.cc:492] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b: Bootstrap starting.
I20260203 09:15:43.339288 27691 raft_consensus.cc:2468] T ed0fc738bbc64c31a0b86c6b1f807f7e P dabe360bbf6a4beaae517c7b84267c38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 1.
I20260203 09:15:43.339339 27892 consensus_queue.cc:237] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.340632 27731 leader_election.cc:304] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dabe360bbf6a4beaae517c7b84267c38, fbb608d94d274640813c2860cf06d12b; no voters:
I20260203 09:15:43.341207 27842 raft_consensus.cc:2468] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 1.
I20260203 09:15:43.343478 27916 raft_consensus.cc:2804] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:15:43.345291 27916 raft_consensus.cc:697] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [term 1 LEADER]: Becoming Leader. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Running, Role: LEADER
I20260203 09:15:43.348728 27916 consensus_queue.cc:237] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.370049 27886 tablet_bootstrap.cc:654] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:43.386590 27885 tablet_bootstrap.cc:492] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38: No bootstrap required, opened a new log
I20260203 09:15:43.389274 27885 ts_tablet_manager.cc:1403] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38: Time spent bootstrapping tablet: real 0.110s user 0.013s sys 0.017s
I20260203 09:15:43.396716 27887 tablet_bootstrap.cc:492] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b: No bootstrap required, opened a new log
I20260203 09:15:43.397279 27887 ts_tablet_manager.cc:1403] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b: Time spent bootstrapping tablet: real 0.086s user 0.015s sys 0.024s
I20260203 09:15:43.397444 27885 raft_consensus.cc:359] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.398183 27885 raft_consensus.cc:385] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.398468 27885 raft_consensus.cc:740] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabe360bbf6a4beaae517c7b84267c38, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.399107 27885 consensus_queue.cc:260] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.400405 27887 raft_consensus.cc:359] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.401146 27887 raft_consensus.cc:385] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.401607 27887 raft_consensus.cc:740] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c565ce064e6347999f31e94e51b3eb3b, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.402432 27887 consensus_queue.cc:260] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.401101 27886 tablet_bootstrap.cc:492] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b: No bootstrap required, opened a new log
I20260203 09:15:43.404987 27886 ts_tablet_manager.cc:1403] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b: Time spent bootstrapping tablet: real 0.067s user 0.015s sys 0.004s
I20260203 09:15:43.405535 27887 ts_tablet_manager.cc:1434] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b: Time spent starting tablet: real 0.008s user 0.006s sys 0.001s
I20260203 09:15:43.406502 27887 tablet_bootstrap.cc:492] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b: Bootstrap starting.
I20260203 09:15:43.408785 27886 raft_consensus.cc:359] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.409564 27886 raft_consensus.cc:385] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.409889 27886 raft_consensus.cc:740] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.410617 27886 consensus_queue.cc:260] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.404544 27885 ts_tablet_manager.cc:1434] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38: Time spent starting tablet: real 0.015s user 0.006s sys 0.002s
I20260203 09:15:43.413093 27885 tablet_bootstrap.cc:492] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38: Bootstrap starting.
I20260203 09:15:43.414638 27887 tablet_bootstrap.cc:654] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:43.418179 27886 ts_tablet_manager.cc:1434] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b: Time spent starting tablet: real 0.013s user 0.007s sys 0.000s
I20260203 09:15:43.420274 27585 catalog_manager.cc:5654] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b reported cstate change: term changed from 0 to 1, leader changed from <none> to fbb608d94d274640813c2860cf06d12b (127.26.232.66). New cstate: current_term: 1 leader_uuid: "fbb608d94d274640813c2860cf06d12b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: UNKNOWN } } }
I20260203 09:15:43.422576 27886 tablet_bootstrap.cc:492] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b: Bootstrap starting.
I20260203 09:15:43.423346 27585 catalog_manager.cc:5654] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b reported cstate change: term changed from 0 to 1, leader changed from <none> to fbb608d94d274640813c2860cf06d12b (127.26.232.66). New cstate: current_term: 1 leader_uuid: "fbb608d94d274640813c2860cf06d12b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: UNKNOWN } } }
I20260203 09:15:43.425792 27916 raft_consensus.cc:493] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:15:43.426282 27916 raft_consensus.cc:515] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.430315 27916 leader_election.cc:290] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:43.431056 27691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4989b3f204bb43ada40440b6894de910" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabe360bbf6a4beaae517c7b84267c38" is_pre_election: true
I20260203 09:15:43.431609 27841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4989b3f204bb43ada40440b6894de910" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c565ce064e6347999f31e94e51b3eb3b" is_pre_election: true
W20260203 09:15:43.433106 27731 leader_election.cc:343] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:15:43.434407 27731 leader_election.cc:343] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:15:43.434638 27885 tablet_bootstrap.cc:654] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:43.434975 27731 leader_election.cc:304] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fbb608d94d274640813c2860cf06d12b; no voters: c565ce064e6347999f31e94e51b3eb3b, dabe360bbf6a4beaae517c7b84267c38
I20260203 09:15:43.436858 27916 raft_consensus.cc:2749] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:15:43.442428 27886 tablet_bootstrap.cc:654] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:43.449051 27887 tablet_bootstrap.cc:492] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b: No bootstrap required, opened a new log
I20260203 09:15:43.450528 27887 ts_tablet_manager.cc:1403] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b: Time spent bootstrapping tablet: real 0.044s user 0.012s sys 0.016s
I20260203 09:15:43.454352 27887 raft_consensus.cc:359] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.455287 27887 raft_consensus.cc:385] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.455651 27887 raft_consensus.cc:740] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c565ce064e6347999f31e94e51b3eb3b, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.456472 27887 consensus_queue.cc:260] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.460395 27887 ts_tablet_manager.cc:1434] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b: Time spent starting tablet: real 0.009s user 0.004s sys 0.003s
I20260203 09:15:43.461499 27887 tablet_bootstrap.cc:492] T d3fac0b874aa4090bd3c394c817e14ec P c565ce064e6347999f31e94e51b3eb3b: Bootstrap starting.
I20260203 09:15:43.460456 27885 tablet_bootstrap.cc:492] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38: No bootstrap required, opened a new log
I20260203 09:15:43.465173 27885 ts_tablet_manager.cc:1403] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38: Time spent bootstrapping tablet: real 0.052s user 0.012s sys 0.010s
I20260203 09:15:43.468009 27885 raft_consensus.cc:359] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.468771 27885 raft_consensus.cc:385] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.468943 27887 tablet_bootstrap.cc:654] T d3fac0b874aa4090bd3c394c817e14ec P c565ce064e6347999f31e94e51b3eb3b: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:43.474094 27886 tablet_bootstrap.cc:492] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b: No bootstrap required, opened a new log
I20260203 09:15:43.474591 27886 ts_tablet_manager.cc:1403] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b: Time spent bootstrapping tablet: real 0.052s user 0.022s sys 0.002s
I20260203 09:15:43.475147 27887 tablet_bootstrap.cc:492] T d3fac0b874aa4090bd3c394c817e14ec P c565ce064e6347999f31e94e51b3eb3b: No bootstrap required, opened a new log
I20260203 09:15:43.475528 27887 ts_tablet_manager.cc:1403] T d3fac0b874aa4090bd3c394c817e14ec P c565ce064e6347999f31e94e51b3eb3b: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.006s
I20260203 09:15:43.469067 27885 raft_consensus.cc:740] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabe360bbf6a4beaae517c7b84267c38, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.477386 27885 consensus_queue.cc:260] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.477787 27887 raft_consensus.cc:359] T d3fac0b874aa4090bd3c394c817e14ec P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.478173 27886 raft_consensus.cc:359] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.478873 27886 raft_consensus.cc:385] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.479244 27886 raft_consensus.cc:740] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.479892 27885 ts_tablet_manager.cc:1434] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38: Time spent starting tablet: real 0.014s user 0.004s sys 0.000s
I20260203 09:15:43.480005 27886 consensus_queue.cc:260] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.478327 27887 raft_consensus.cc:385] T d3fac0b874aa4090bd3c394c817e14ec P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.480906 27885 tablet_bootstrap.cc:492] T 4989b3f204bb43ada40440b6894de910 P dabe360bbf6a4beaae517c7b84267c38: Bootstrap starting.
I20260203 09:15:43.482369 27892 raft_consensus.cc:493] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:15:43.482805 27892 raft_consensus.cc:515] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.484593 27887 raft_consensus.cc:740] T d3fac0b874aa4090bd3c394c817e14ec P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c565ce064e6347999f31e94e51b3eb3b, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.484912 27892 leader_election.cc:290] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:43.487200 27841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3fac0b874aa4090bd3c394c817e14ec" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c565ce064e6347999f31e94e51b3eb3b" is_pre_election: true
I20260203 09:15:43.487927 27887 consensus_queue.cc:260] T d3fac0b874aa4090bd3c394c817e14ec P c565ce064e6347999f31e94e51b3eb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.488986 27841 raft_consensus.cc:2468] T d3fac0b874aa4090bd3c394c817e14ec P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 0.
I20260203 09:15:43.490543 27731 leader_election.cc:304] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, fbb608d94d274640813c2860cf06d12b; no voters:
I20260203 09:15:43.491113 27885 tablet_bootstrap.cc:654] T 4989b3f204bb43ada40440b6894de910 P dabe360bbf6a4beaae517c7b84267c38: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:43.491170 27887 ts_tablet_manager.cc:1434] T d3fac0b874aa4090bd3c394c817e14ec P c565ce064e6347999f31e94e51b3eb3b: Time spent starting tablet: real 0.015s user 0.004s sys 0.003s
I20260203 09:15:43.491338 27892 raft_consensus.cc:2804] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:15:43.491750 27892 raft_consensus.cc:493] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:15:43.492072 27892 raft_consensus.cc:3060] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.492266 27887 tablet_bootstrap.cc:492] T 05e6e3dcf873416a9cb57fccfcd6f002 P c565ce064e6347999f31e94e51b3eb3b: Bootstrap starting.
I20260203 09:15:43.488442 27886 ts_tablet_manager.cc:1434] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b: Time spent starting tablet: real 0.014s user 0.006s sys 0.003s
I20260203 09:15:43.495334 27886 tablet_bootstrap.cc:492] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b: Bootstrap starting.
I20260203 09:15:43.500113 27887 tablet_bootstrap.cc:654] T 05e6e3dcf873416a9cb57fccfcd6f002 P c565ce064e6347999f31e94e51b3eb3b: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:43.488338 27691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3fac0b874aa4090bd3c394c817e14ec" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabe360bbf6a4beaae517c7b84267c38" is_pre_election: true
I20260203 09:15:43.501217 27691 raft_consensus.cc:2468] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 0.
I20260203 09:15:43.504524 27892 raft_consensus.cc:515] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.505301 27886 tablet_bootstrap.cc:654] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:43.507593 27892 leader_election.cc:290] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 1 election: Requested vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:43.508996 27841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3fac0b874aa4090bd3c394c817e14ec" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
I20260203 09:15:43.509534 27691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3fac0b874aa4090bd3c394c817e14ec" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
I20260203 09:15:43.509768 27841 raft_consensus.cc:3060] T d3fac0b874aa4090bd3c394c817e14ec P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.510145 27691 raft_consensus.cc:3060] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.514420 27887 tablet_bootstrap.cc:492] T 05e6e3dcf873416a9cb57fccfcd6f002 P c565ce064e6347999f31e94e51b3eb3b: No bootstrap required, opened a new log
I20260203 09:15:43.514930 27887 ts_tablet_manager.cc:1403] T 05e6e3dcf873416a9cb57fccfcd6f002 P c565ce064e6347999f31e94e51b3eb3b: Time spent bootstrapping tablet: real 0.023s user 0.019s sys 0.001s
I20260203 09:15:43.520362 27912 raft_consensus.cc:493] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:15:43.520969 27912 raft_consensus.cc:515] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.525350 27768 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce1a18a70d52493abcb4675c3a6e1b1f" candidate_uuid: "dabe360bbf6a4beaae517c7b84267c38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbb608d94d274640813c2860cf06d12b" is_pre_election: true
I20260203 09:15:43.525949 27912 leader_election.cc:290] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:43.521286 27691 raft_consensus.cc:2468] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 1.
I20260203 09:15:43.526103 27768 raft_consensus.cc:2468] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabe360bbf6a4beaae517c7b84267c38 in term 0.
I20260203 09:15:43.526163 27842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce1a18a70d52493abcb4675c3a6e1b1f" candidate_uuid: "dabe360bbf6a4beaae517c7b84267c38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c565ce064e6347999f31e94e51b3eb3b" is_pre_election: true
I20260203 09:15:43.526801 27842 raft_consensus.cc:2468] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabe360bbf6a4beaae517c7b84267c38 in term 0.
I20260203 09:15:43.527171 27731 leader_election.cc:304] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dabe360bbf6a4beaae517c7b84267c38, fbb608d94d274640813c2860cf06d12b; no voters:
I20260203 09:15:43.527853 27652 leader_election.cc:304] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dabe360bbf6a4beaae517c7b84267c38, fbb608d94d274640813c2860cf06d12b; no voters:
I20260203 09:15:43.528805 27890 raft_consensus.cc:2804] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:15:43.529178 27890 raft_consensus.cc:493] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:15:43.529521 27890 raft_consensus.cc:3060] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.531276 27841 raft_consensus.cc:2468] T d3fac0b874aa4090bd3c394c817e14ec P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 1.
I20260203 09:15:43.532850 27887 raft_consensus.cc:359] T 05e6e3dcf873416a9cb57fccfcd6f002 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.533645 27887 raft_consensus.cc:385] T 05e6e3dcf873416a9cb57fccfcd6f002 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.533731 27892 raft_consensus.cc:2804] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:15:43.534029 27887 raft_consensus.cc:740] T 05e6e3dcf873416a9cb57fccfcd6f002 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c565ce064e6347999f31e94e51b3eb3b, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.535101 27892 raft_consensus.cc:697] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [term 1 LEADER]: Becoming Leader. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Running, Role: LEADER
I20260203 09:15:43.534881 27887 consensus_queue.cc:260] T 05e6e3dcf873416a9cb57fccfcd6f002 P c565ce064e6347999f31e94e51b3eb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.536027 27892 consensus_queue.cc:237] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.537922 27887 ts_tablet_manager.cc:1434] T 05e6e3dcf873416a9cb57fccfcd6f002 P c565ce064e6347999f31e94e51b3eb3b: Time spent starting tablet: real 0.023s user 0.007s sys 0.000s
I20260203 09:15:43.538908 27887 tablet_bootstrap.cc:492] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b: Bootstrap starting.
I20260203 09:15:43.543493 27890 raft_consensus.cc:515] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.546638 27768 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce1a18a70d52493abcb4675c3a6e1b1f" candidate_uuid: "dabe360bbf6a4beaae517c7b84267c38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbb608d94d274640813c2860cf06d12b"
I20260203 09:15:43.546947 27841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce1a18a70d52493abcb4675c3a6e1b1f" candidate_uuid: "dabe360bbf6a4beaae517c7b84267c38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
I20260203 09:15:43.547279 27768 raft_consensus.cc:3060] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.547531 27841 raft_consensus.cc:3060] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.549235 27890 leader_election.cc:290] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 1 election: Requested vote from peers fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:43.555770 27887 tablet_bootstrap.cc:654] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:43.557212 27841 raft_consensus.cc:2468] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabe360bbf6a4beaae517c7b84267c38 in term 1.
I20260203 09:15:43.557329 27768 raft_consensus.cc:2468] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabe360bbf6a4beaae517c7b84267c38 in term 1.
I20260203 09:15:43.558609 27654 leader_election.cc:304] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, dabe360bbf6a4beaae517c7b84267c38; no voters:
I20260203 09:15:43.559340 27890 raft_consensus.cc:2804] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:15:43.560189 27885 tablet_bootstrap.cc:492] T 4989b3f204bb43ada40440b6894de910 P dabe360bbf6a4beaae517c7b84267c38: No bootstrap required, opened a new log
I20260203 09:15:43.560619 27885 ts_tablet_manager.cc:1403] T 4989b3f204bb43ada40440b6894de910 P dabe360bbf6a4beaae517c7b84267c38: Time spent bootstrapping tablet: real 0.080s user 0.032s sys 0.028s
I20260203 09:15:43.560596 27890 raft_consensus.cc:697] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [term 1 LEADER]: Becoming Leader. State: Replica: dabe360bbf6a4beaae517c7b84267c38, State: Running, Role: LEADER
I20260203 09:15:43.564586 27885 raft_consensus.cc:359] T 4989b3f204bb43ada40440b6894de910 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.565369 27885 raft_consensus.cc:385] T 4989b3f204bb43ada40440b6894de910 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.565640 27885 raft_consensus.cc:740] T 4989b3f204bb43ada40440b6894de910 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabe360bbf6a4beaae517c7b84267c38, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.565196 27890 consensus_queue.cc:237] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.566254 27885 consensus_queue.cc:260] T 4989b3f204bb43ada40440b6894de910 P dabe360bbf6a4beaae517c7b84267c38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.568053 27885 ts_tablet_manager.cc:1434] T 4989b3f204bb43ada40440b6894de910 P dabe360bbf6a4beaae517c7b84267c38: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260203 09:15:43.568851 27885 tablet_bootstrap.cc:492] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38: Bootstrap starting.
I20260203 09:15:43.570102 27886 tablet_bootstrap.cc:492] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b: No bootstrap required, opened a new log
I20260203 09:15:43.569010 27582 catalog_manager.cc:5654] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b reported cstate change: term changed from 0 to 1, leader changed from <none> to fbb608d94d274640813c2860cf06d12b (127.26.232.66). New cstate: current_term: 1 leader_uuid: "fbb608d94d274640813c2860cf06d12b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: UNKNOWN } } }
I20260203 09:15:43.570603 27886 ts_tablet_manager.cc:1403] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b: Time spent bootstrapping tablet: real 0.075s user 0.008s sys 0.008s
I20260203 09:15:43.575822 27886 raft_consensus.cc:359] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.576318 27886 raft_consensus.cc:385] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.576531 27886 raft_consensus.cc:740] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.577152 27886 consensus_queue.cc:260] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.579387 27886 ts_tablet_manager.cc:1434] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260203 09:15:43.580291 27886 tablet_bootstrap.cc:492] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b: Bootstrap starting.
I20260203 09:15:43.580431 27885 tablet_bootstrap.cc:654] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:43.583985 27887 tablet_bootstrap.cc:492] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b: No bootstrap required, opened a new log
I20260203 09:15:43.584417 27887 ts_tablet_manager.cc:1403] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b: Time spent bootstrapping tablet: real 0.046s user 0.012s sys 0.003s
I20260203 09:15:43.591348 27885 tablet_bootstrap.cc:492] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38: No bootstrap required, opened a new log
I20260203 09:15:43.591815 27885 ts_tablet_manager.cc:1403] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38: Time spent bootstrapping tablet: real 0.023s user 0.008s sys 0.003s
I20260203 09:15:43.591675 27583 catalog_manager.cc:5654] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 reported cstate change: term changed from 0 to 1, leader changed from <none> to dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65). New cstate: current_term: 1 leader_uuid: "dabe360bbf6a4beaae517c7b84267c38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: UNKNOWN } } }
I20260203 09:15:43.594975 27887 raft_consensus.cc:359] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.595711 27887 raft_consensus.cc:385] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.595964 27887 raft_consensus.cc:740] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c565ce064e6347999f31e94e51b3eb3b, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.596266 27886 tablet_bootstrap.cc:654] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:43.596570 27887 consensus_queue.cc:260] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.602629 27887 ts_tablet_manager.cc:1434] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b: Time spent starting tablet: real 0.018s user 0.005s sys 0.000s
I20260203 09:15:43.603968 27887 tablet_bootstrap.cc:492] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b: Bootstrap starting.
I20260203 09:15:43.598264 27885 raft_consensus.cc:359] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.605420 27885 raft_consensus.cc:385] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.605746 27885 raft_consensus.cc:740] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dabe360bbf6a4beaae517c7b84267c38, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.606529 27885 consensus_queue.cc:260] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.608954 27885 ts_tablet_manager.cc:1434] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38: Time spent starting tablet: real 0.017s user 0.002s sys 0.006s
I20260203 09:15:43.610610 27887 tablet_bootstrap.cc:654] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b: Neither blocks nor log segments found. Creating new log.
I20260203 09:15:43.618026 27886 tablet_bootstrap.cc:492] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b: No bootstrap required, opened a new log
I20260203 09:15:43.618501 27886 ts_tablet_manager.cc:1403] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b: Time spent bootstrapping tablet: real 0.038s user 0.013s sys 0.014s
I20260203 09:15:43.621124 27886 raft_consensus.cc:359] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.621783 27886 raft_consensus.cc:385] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.622048 27886 raft_consensus.cc:740] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.622690 27886 consensus_queue.cc:260] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.625919 27887 tablet_bootstrap.cc:492] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b: No bootstrap required, opened a new log
I20260203 09:15:43.626294 27887 ts_tablet_manager.cc:1403] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b: Time spent bootstrapping tablet: real 0.023s user 0.012s sys 0.008s
I20260203 09:15:43.626663 27886 ts_tablet_manager.cc:1434] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260203 09:15:43.628196 27887 raft_consensus.cc:359] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.628917 27887 raft_consensus.cc:385] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:15:43.629179 27887 raft_consensus.cc:740] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c565ce064e6347999f31e94e51b3eb3b, State: Initialized, Role: FOLLOWER
I20260203 09:15:43.629907 27887 consensus_queue.cc:260] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.631911 27887 ts_tablet_manager.cc:1434] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260203 09:15:43.644851 27895 raft_consensus.cc:493] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:15:43.645413 27895 raft_consensus.cc:515] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.648397 27895 leader_election.cc:290] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849)
I20260203 09:15:43.649071 27691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4989b3f204bb43ada40440b6894de910" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabe360bbf6a4beaae517c7b84267c38" is_pre_election: true
I20260203 09:15:43.649720 27691 raft_consensus.cc:2468] T 4989b3f204bb43ada40440b6894de910 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c565ce064e6347999f31e94e51b3eb3b in term 0.
I20260203 09:15:43.649861 27768 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4989b3f204bb43ada40440b6894de910" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbb608d94d274640813c2860cf06d12b" is_pre_election: true
I20260203 09:15:43.650569 27807 leader_election.cc:304] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, dabe360bbf6a4beaae517c7b84267c38; no voters:
I20260203 09:15:43.650701 27768 raft_consensus.cc:2468] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c565ce064e6347999f31e94e51b3eb3b in term 0.
I20260203 09:15:43.651289 27895 raft_consensus.cc:2804] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:15:43.651643 27895 raft_consensus.cc:493] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:15:43.651983 27895 raft_consensus.cc:3060] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.656874 27895 raft_consensus.cc:515] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.659067 27895 leader_election.cc:290] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 1 election: Requested vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849)
I20260203 09:15:43.660192 27691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4989b3f204bb43ada40440b6894de910" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
I20260203 09:15:43.660328 27768 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4989b3f204bb43ada40440b6894de910" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbb608d94d274640813c2860cf06d12b"
I20260203 09:15:43.661099 27768 raft_consensus.cc:3060] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.660825 27691 raft_consensus.cc:3060] T 4989b3f204bb43ada40440b6894de910 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.667943 27768 raft_consensus.cc:2468] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c565ce064e6347999f31e94e51b3eb3b in term 1.
I20260203 09:15:43.669189 27805 leader_election.cc:304] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, fbb608d94d274640813c2860cf06d12b; no voters:
I20260203 09:15:43.672734 27691 raft_consensus.cc:2468] T 4989b3f204bb43ada40440b6894de910 P dabe360bbf6a4beaae517c7b84267c38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c565ce064e6347999f31e94e51b3eb3b in term 1.
I20260203 09:15:43.672847 27895 raft_consensus.cc:493] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:15:43.674235 27939 raft_consensus.cc:2804] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:15:43.673772 27895 raft_consensus.cc:515] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.675349 27939 raft_consensus.cc:697] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [term 1 LEADER]: Becoming Leader. State: Replica: c565ce064e6347999f31e94e51b3eb3b, State: Running, Role: LEADER
I20260203 09:15:43.676793 27691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "daa6f7f8fc244b1aa48b751d437dcc77" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabe360bbf6a4beaae517c7b84267c38" is_pre_election: true
I20260203 09:15:43.677244 27892 raft_consensus.cc:493] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:15:43.676286 27895 leader_election.cc:290] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849)
I20260203 09:15:43.677446 27691 raft_consensus.cc:2468] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c565ce064e6347999f31e94e51b3eb3b in term 0.
I20260203 09:15:43.677752 27892 raft_consensus.cc:515] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.678493 27807 leader_election.cc:304] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, dabe360bbf6a4beaae517c7b84267c38; no voters:
I20260203 09:15:43.678751 27768 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "daa6f7f8fc244b1aa48b751d437dcc77" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbb608d94d274640813c2860cf06d12b" is_pre_election: true
I20260203 09:15:43.679349 27768 raft_consensus.cc:2468] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c565ce064e6347999f31e94e51b3eb3b in term 0.
I20260203 09:15:43.679579 27940 raft_consensus.cc:2804] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:15:43.679932 27940 raft_consensus.cc:493] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:15:43.680286 27940 raft_consensus.cc:3060] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.676262 27939 consensus_queue.cc:237] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.682840 27841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "60680bc581a44de4bb9b29c65e4d0f01" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c565ce064e6347999f31e94e51b3eb3b" is_pre_election: true
I20260203 09:15:43.683537 27841 raft_consensus.cc:2468] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 0.
I20260203 09:15:43.685108 27731 leader_election.cc:304] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, fbb608d94d274640813c2860cf06d12b; no voters:
I20260203 09:15:43.685878 27916 raft_consensus.cc:2804] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:15:43.686282 27916 raft_consensus.cc:493] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:15:43.686635 27916 raft_consensus.cc:3060] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.688779 27892 leader_election.cc:290] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:43.690047 27940 raft_consensus.cc:515] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.692210 27940 leader_election.cc:290] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 1 election: Requested vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849)
I20260203 09:15:43.693017 27689 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "daa6f7f8fc244b1aa48b751d437dcc77" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
I20260203 09:15:43.693712 27689 raft_consensus.cc:3060] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.692962 27583 catalog_manager.cc:5654] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b reported cstate change: term changed from 0 to 1, leader changed from <none> to c565ce064e6347999f31e94e51b3eb3b (127.26.232.67). New cstate: current_term: 1 leader_uuid: "c565ce064e6347999f31e94e51b3eb3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: HEALTHY } } }
I20260203 09:15:43.697402 27768 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "daa6f7f8fc244b1aa48b751d437dcc77" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbb608d94d274640813c2860cf06d12b"
I20260203 09:15:43.698109 27768 raft_consensus.cc:3060] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:15:43.700172 27634 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:15:43.705660 27916 raft_consensus.cc:515] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.706300 27689 raft_consensus.cc:2468] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c565ce064e6347999f31e94e51b3eb3b in term 1.
I20260203 09:15:43.706629 27768 raft_consensus.cc:2468] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c565ce064e6347999f31e94e51b3eb3b in term 1.
I20260203 09:15:43.707476 27807 leader_election.cc:304] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, dabe360bbf6a4beaae517c7b84267c38; no voters:
I20260203 09:15:43.707970 27916 leader_election.cc:290] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 1 election: Requested vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:43.708559 27940 raft_consensus.cc:2804] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:15:43.705662 27691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "60680bc581a44de4bb9b29c65e4d0f01" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabe360bbf6a4beaae517c7b84267c38" is_pre_election: true
I20260203 09:15:43.709442 27841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "60680bc581a44de4bb9b29c65e4d0f01" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
I20260203 09:15:43.709615 27691 raft_consensus.cc:2468] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 0.
I20260203 09:15:43.710060 27841 raft_consensus.cc:3060] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.710351 27689 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "60680bc581a44de4bb9b29c65e4d0f01" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
I20260203 09:15:43.711114 27689 raft_consensus.cc:3060] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.709741 27940 raft_consensus.cc:697] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 1 LEADER]: Becoming Leader. State: Replica: c565ce064e6347999f31e94e51b3eb3b, State: Running, Role: LEADER
I20260203 09:15:43.712024 27940 consensus_queue.cc:237] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.717492 27841 raft_consensus.cc:2468] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 1.
I20260203 09:15:43.718701 27731 leader_election.cc:304] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, fbb608d94d274640813c2860cf06d12b; no voters:
I20260203 09:15:43.719868 27916 raft_consensus.cc:2804] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:15:43.720088 27689 raft_consensus.cc:2468] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 1.
I20260203 09:15:43.720700 27916 raft_consensus.cc:697] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [term 1 LEADER]: Becoming Leader. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Running, Role: LEADER
I20260203 09:15:43.722079 27916 consensus_queue.cc:237] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.730846 27583 catalog_manager.cc:5654] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b reported cstate change: term changed from 0 to 1, leader changed from <none> to c565ce064e6347999f31e94e51b3eb3b (127.26.232.67). New cstate: current_term: 1 leader_uuid: "c565ce064e6347999f31e94e51b3eb3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: HEALTHY } } }
I20260203 09:15:43.733582 27582 catalog_manager.cc:5654] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b reported cstate change: term changed from 0 to 1, leader changed from <none> to fbb608d94d274640813c2860cf06d12b (127.26.232.66). New cstate: current_term: 1 leader_uuid: "fbb608d94d274640813c2860cf06d12b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: UNKNOWN } } }
I20260203 09:15:43.752280 27916 consensus_queue.cc:1048] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:15:43.773896 27916 consensus_queue.cc:1048] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:15:43.775139 27940 raft_consensus.cc:493] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:15:43.775624 27940 raft_consensus.cc:515] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.777429 27940 leader_election.cc:290] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849)
I20260203 09:15:43.779120 27768 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "074d2018d1254198abb02cd9463e64f9" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbb608d94d274640813c2860cf06d12b" is_pre_election: true
I20260203 09:15:43.779317 27691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "074d2018d1254198abb02cd9463e64f9" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabe360bbf6a4beaae517c7b84267c38" is_pre_election: true
I20260203 09:15:43.779985 27768 raft_consensus.cc:2468] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c565ce064e6347999f31e94e51b3eb3b in term 0.
I20260203 09:15:43.780082 27691 raft_consensus.cc:2468] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c565ce064e6347999f31e94e51b3eb3b in term 0.
I20260203 09:15:43.781461 27807 leader_election.cc:304] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, dabe360bbf6a4beaae517c7b84267c38; no voters:
I20260203 09:15:43.783274 27940 raft_consensus.cc:2804] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:15:43.783838 27940 raft_consensus.cc:493] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:15:43.784245 27940 raft_consensus.cc:3060] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.791846 27940 raft_consensus.cc:515] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.795442 27768 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "074d2018d1254198abb02cd9463e64f9" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbb608d94d274640813c2860cf06d12b"
I20260203 09:15:43.795295 27689 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "074d2018d1254198abb02cd9463e64f9" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
I20260203 09:15:43.796264 27768 raft_consensus.cc:3060] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.796721 27940 leader_election.cc:290] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 1 election: Requested vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849)
I20260203 09:15:43.796329 27689 raft_consensus.cc:3060] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.802284 27689 raft_consensus.cc:2468] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c565ce064e6347999f31e94e51b3eb3b in term 1.
I20260203 09:15:43.803253 27807 leader_election.cc:304] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, dabe360bbf6a4beaae517c7b84267c38; no voters:
I20260203 09:15:43.803988 27940 raft_consensus.cc:2804] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:15:43.804378 27940 raft_consensus.cc:697] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [term 1 LEADER]: Becoming Leader. State: Replica: c565ce064e6347999f31e94e51b3eb3b, State: Running, Role: LEADER
I20260203 09:15:43.804740 27768 raft_consensus.cc:2468] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c565ce064e6347999f31e94e51b3eb3b in term 1.
I20260203 09:15:43.805181 27940 consensus_queue.cc:237] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.812709 27583 catalog_manager.cc:5654] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b reported cstate change: term changed from 0 to 1, leader changed from <none> to c565ce064e6347999f31e94e51b3eb3b (127.26.232.67). New cstate: current_term: 1 leader_uuid: "c565ce064e6347999f31e94e51b3eb3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: HEALTHY } } }
I20260203 09:15:43.874589 27916 consensus_queue.cc:1048] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:15:43.889155 27892 consensus_queue.cc:1048] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:15:43.903411 27890 raft_consensus.cc:493] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:15:43.903851 27890 raft_consensus.cc:515] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.905705 27890 leader_election.cc:290] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:43.906436 27768 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05e6e3dcf873416a9cb57fccfcd6f002" candidate_uuid: "dabe360bbf6a4beaae517c7b84267c38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbb608d94d274640813c2860cf06d12b" is_pre_election: true
I20260203 09:15:43.907078 27768 raft_consensus.cc:2468] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabe360bbf6a4beaae517c7b84267c38 in term 0.
I20260203 09:15:43.907123 27841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05e6e3dcf873416a9cb57fccfcd6f002" candidate_uuid: "dabe360bbf6a4beaae517c7b84267c38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c565ce064e6347999f31e94e51b3eb3b" is_pre_election: true
I20260203 09:15:43.907869 27841 raft_consensus.cc:2468] T 05e6e3dcf873416a9cb57fccfcd6f002 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dabe360bbf6a4beaae517c7b84267c38 in term 0.
I20260203 09:15:43.908349 27652 leader_election.cc:304] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dabe360bbf6a4beaae517c7b84267c38, fbb608d94d274640813c2860cf06d12b; no voters:
I20260203 09:15:43.909426 27890 raft_consensus.cc:2804] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:15:43.909775 27890 raft_consensus.cc:493] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:15:43.910104 27890 raft_consensus.cc:3060] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.916883 27890 raft_consensus.cc:515] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.918912 27890 leader_election.cc:290] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 1 election: Requested vote from peers fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:43.920044 27768 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05e6e3dcf873416a9cb57fccfcd6f002" candidate_uuid: "dabe360bbf6a4beaae517c7b84267c38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbb608d94d274640813c2860cf06d12b"
I20260203 09:15:43.920626 27768 raft_consensus.cc:3060] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.921190 27841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05e6e3dcf873416a9cb57fccfcd6f002" candidate_uuid: "dabe360bbf6a4beaae517c7b84267c38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
I20260203 09:15:43.921730 27841 raft_consensus.cc:3060] T 05e6e3dcf873416a9cb57fccfcd6f002 P c565ce064e6347999f31e94e51b3eb3b [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:15:43.926658 27841 raft_consensus.cc:2468] T 05e6e3dcf873416a9cb57fccfcd6f002 P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabe360bbf6a4beaae517c7b84267c38 in term 1.
I20260203 09:15:43.927207 27768 raft_consensus.cc:2468] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabe360bbf6a4beaae517c7b84267c38 in term 1.
I20260203 09:15:43.928181 27654 leader_election.cc:304] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, dabe360bbf6a4beaae517c7b84267c38; no voters:
I20260203 09:15:43.928866 27890 raft_consensus.cc:2804] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:15:43.929335 27890 raft_consensus.cc:697] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 1 LEADER]: Becoming Leader. State: Replica: dabe360bbf6a4beaae517c7b84267c38, State: Running, Role: LEADER
I20260203 09:15:43.930158 27890 consensus_queue.cc:237] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:43.938071 27583 catalog_manager.cc:5654] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 reported cstate change: term changed from 0 to 1, leader changed from <none> to dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65). New cstate: current_term: 1 leader_uuid: "dabe360bbf6a4beaae517c7b84267c38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: UNKNOWN } } }
I20260203 09:15:43.947715 27890 consensus_queue.cc:1048] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:15:43.958928 27890 consensus_queue.cc:1048] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:15:43.966328 27892 consensus_queue.cc:1048] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:15:43.985072 27916 consensus_queue.cc:1048] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:15:44.088840 27841 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "074d2018d1254198abb02cd9463e64f9"
dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
mode: GRACEFUL
new_leader_uuid: "dabe360bbf6a4beaae517c7b84267c38"
from {username='slave'} at 127.0.0.1:35460
I20260203 09:15:44.089602 27841 raft_consensus.cc:606] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [term 1 LEADER]: Received request to transfer leadership to TS dabe360bbf6a4beaae517c7b84267c38
I20260203 09:15:44.105576 27768 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a88ea51ed509432fae935d15fcd8a913"
dest_uuid: "fbb608d94d274640813c2860cf06d12b"
mode: GRACEFUL
new_leader_uuid: "dabe360bbf6a4beaae517c7b84267c38"
from {username='slave'} at 127.0.0.1:55872
I20260203 09:15:44.106091 27768 raft_consensus.cc:606] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 1 LEADER]: Received request to transfer leadership to TS dabe360bbf6a4beaae517c7b84267c38
I20260203 09:15:44.118803 27841 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "4989b3f204bb43ada40440b6894de910"
dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
mode: GRACEFUL
new_leader_uuid: "fbb608d94d274640813c2860cf06d12b"
from {username='slave'} at 127.0.0.1:35460
I20260203 09:15:44.119454 27841 raft_consensus.cc:606] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [term 1 LEADER]: Received request to transfer leadership to TS fbb608d94d274640813c2860cf06d12b
I20260203 09:15:44.128803 27841 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "daa6f7f8fc244b1aa48b751d437dcc77"
dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
mode: GRACEFUL
new_leader_uuid: "fbb608d94d274640813c2860cf06d12b"
from {username='slave'} at 127.0.0.1:35460
I20260203 09:15:44.129433 27841 raft_consensus.cc:606] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 1 LEADER]: Received request to transfer leadership to TS fbb608d94d274640813c2860cf06d12b
I20260203 09:15:44.137117 27768 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "60680bc581a44de4bb9b29c65e4d0f01"
dest_uuid: "fbb608d94d274640813c2860cf06d12b"
mode: GRACEFUL
new_leader_uuid: "c565ce064e6347999f31e94e51b3eb3b"
from {username='slave'} at 127.0.0.1:55872
I20260203 09:15:44.137621 27768 raft_consensus.cc:606] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [term 1 LEADER]: Received request to transfer leadership to TS c565ce064e6347999f31e94e51b3eb3b
I20260203 09:15:44.217307 27940 consensus_queue.cc:1048] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:15:44.225796 27939 raft_consensus.cc:993] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b: : Instructing follower fbb608d94d274640813c2860cf06d12b to start an election
I20260203 09:15:44.226586 27940 raft_consensus.cc:1081] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [term 1 LEADER]: Signalling peer fbb608d94d274640813c2860cf06d12b to start an election
I20260203 09:15:44.228994 27767 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "4989b3f204bb43ada40440b6894de910"
dest_uuid: "fbb608d94d274640813c2860cf06d12b"
from {username='slave'} at 127.0.0.1:50884
I20260203 09:15:44.229609 27767 raft_consensus.cc:493] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:15:44.229974 27767 raft_consensus.cc:3060] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:15:44.235277 27940 consensus_queue.cc:1048] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:15:44.236568 27961 consensus_queue.cc:1048] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:15:44.240137 27767 raft_consensus.cc:515] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:44.242069 27768 raft_consensus.cc:1240] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Rejecting Update request from peer c565ce064e6347999f31e94e51b3eb3b for earlier term 1. Current term is 2. Ops: []
I20260203 09:15:44.242427 27767 leader_election.cc:290] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 2 election: Requested vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:44.246484 27841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4989b3f204bb43ada40440b6894de910" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
I20260203 09:15:44.246587 27691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4989b3f204bb43ada40440b6894de910" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
I20260203 09:15:44.247166 27841 raft_consensus.cc:3055] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:15:44.247500 27841 raft_consensus.cc:740] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c565ce064e6347999f31e94e51b3eb3b, State: Running, Role: LEADER
I20260203 09:15:44.248309 27841 consensus_queue.cc:260] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:44.249459 27841 raft_consensus.cc:3060] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:15:44.252668 27940 raft_consensus.cc:993] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b: : Instructing follower fbb608d94d274640813c2860cf06d12b to start an election
I20260203 09:15:44.253099 27940 raft_consensus.cc:1081] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 1 LEADER]: Signalling peer fbb608d94d274640813c2860cf06d12b to start an election
I20260203 09:15:44.256634 27841 raft_consensus.cc:2468] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 2.
I20260203 09:15:44.258383 27731 leader_election.cc:304] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, fbb608d94d274640813c2860cf06d12b; no voters: dabe360bbf6a4beaae517c7b84267c38
I20260203 09:15:44.259027 27765 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "daa6f7f8fc244b1aa48b751d437dcc77"
dest_uuid: "fbb608d94d274640813c2860cf06d12b"
from {username='slave'} at 127.0.0.1:50884
I20260203 09:15:44.260910 27765 raft_consensus.cc:493] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:15:44.261861 27765 raft_consensus.cc:3060] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:15:44.262696 27913 raft_consensus.cc:2804] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:15:44.263159 27913 raft_consensus.cc:697] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [term 2 LEADER]: Becoming Leader. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Running, Role: LEADER
I20260203 09:15:44.263964 27913 consensus_queue.cc:237] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:44.270553 27940 consensus_queue.cc:1048] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:15:44.271911 27940 consensus_queue.cc:1048] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:15:44.273875 27765 raft_consensus.cc:515] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:44.276911 27765 leader_election.cc:290] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 2 election: Requested vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:44.278048 27768 raft_consensus.cc:1240] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Rejecting Update request from peer c565ce064e6347999f31e94e51b3eb3b for earlier term 1. Current term is 2. Ops: []
I20260203 09:15:44.279892 27688 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "daa6f7f8fc244b1aa48b751d437dcc77" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
I20260203 09:15:44.280390 27940 consensus_queue.cc:1059] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:15:44.282492 27913 consensus_queue.cc:1048] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:15:44.289234 27961 raft_consensus.cc:3055] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:15:44.289618 27961 raft_consensus.cc:740] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c565ce064e6347999f31e94e51b3eb3b, State: Running, Role: LEADER
I20260203 09:15:44.287887 27585 catalog_manager.cc:5654] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b reported cstate change: term changed from 1 to 2, leader changed from c565ce064e6347999f31e94e51b3eb3b (127.26.232.67) to fbb608d94d274640813c2860cf06d12b (127.26.232.66). New cstate: current_term: 2 leader_uuid: "fbb608d94d274640813c2860cf06d12b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: UNKNOWN } } }
I20260203 09:15:44.293490 27842 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "daa6f7f8fc244b1aa48b751d437dcc77" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
I20260203 09:15:44.292318 27961 consensus_queue.cc:260] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:44.298784 27961 raft_consensus.cc:3060] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:15:44.303512 27913 consensus_queue.cc:1048] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:15:44.313903 27940 consensus_queue.cc:1048] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:15:44.318787 27939 raft_consensus.cc:993] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b: : Instructing follower dabe360bbf6a4beaae517c7b84267c38 to start an election
I20260203 09:15:44.319929 27939 raft_consensus.cc:1081] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [term 1 LEADER]: Signalling peer dabe360bbf6a4beaae517c7b84267c38 to start an election
I20260203 09:15:44.326097 27691 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "074d2018d1254198abb02cd9463e64f9"
dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
from {username='slave'} at 127.0.0.1:53066
I20260203 09:15:44.329473 27691 raft_consensus.cc:493] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:15:44.329993 27691 raft_consensus.cc:3060] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:15:44.330946 27842 raft_consensus.cc:2468] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 2.
I20260203 09:15:44.332798 27731 leader_election.cc:304] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, fbb608d94d274640813c2860cf06d12b; no voters: dabe360bbf6a4beaae517c7b84267c38
I20260203 09:15:44.333647 27913 raft_consensus.cc:2804] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:15:44.334101 27913 raft_consensus.cc:697] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 2 LEADER]: Becoming Leader. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Running, Role: LEADER
I20260203 09:15:44.335624 27913 consensus_queue.cc:237] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:44.344213 27691 raft_consensus.cc:515] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:44.353354 27892 raft_consensus.cc:993] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b: : Instructing follower c565ce064e6347999f31e94e51b3eb3b to start an election
I20260203 09:15:44.354511 27892 raft_consensus.cc:1081] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [term 1 LEADER]: Signalling peer c565ce064e6347999f31e94e51b3eb3b to start an election
I20260203 09:15:44.358688 27842 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "60680bc581a44de4bb9b29c65e4d0f01"
dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
from {username='slave'} at 127.0.0.1:55610
I20260203 09:15:44.359342 27842 raft_consensus.cc:493] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:15:44.359738 27842 raft_consensus.cc:3060] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:15:44.367578 27842 raft_consensus.cc:515] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:44.374902 27890 consensus_queue.cc:1048] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:15:44.381313 27765 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "074d2018d1254198abb02cd9463e64f9" candidate_uuid: "dabe360bbf6a4beaae517c7b84267c38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbb608d94d274640813c2860cf06d12b"
I20260203 09:15:44.378798 27691 leader_election.cc:290] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 2 election: Requested vote from peers fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:44.380040 27839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "074d2018d1254198abb02cd9463e64f9" candidate_uuid: "dabe360bbf6a4beaae517c7b84267c38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
I20260203 09:15:44.383805 27839 raft_consensus.cc:3055] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:15:44.384320 27839 raft_consensus.cc:740] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c565ce064e6347999f31e94e51b3eb3b, State: Running, Role: LEADER
I20260203 09:15:44.385217 27839 consensus_queue.cc:260] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:44.387528 27839 raft_consensus.cc:3060] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:15:44.399047 27765 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "60680bc581a44de4bb9b29c65e4d0f01" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbb608d94d274640813c2860cf06d12b"
I20260203 09:15:44.399628 27765 raft_consensus.cc:3055] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:15:44.399928 27765 raft_consensus.cc:740] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Running, Role: LEADER
I20260203 09:15:44.398609 27691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "60680bc581a44de4bb9b29c65e4d0f01" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
I20260203 09:15:44.392891 27842 leader_election.cc:290] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 2 election: Requested vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849)
I20260203 09:15:44.400470 27691 raft_consensus.cc:3060] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:15:44.400678 27765 consensus_queue.cc:260] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:44.398663 27582 catalog_manager.cc:5654] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b reported cstate change: term changed from 1 to 2, leader changed from c565ce064e6347999f31e94e51b3eb3b (127.26.232.67) to fbb608d94d274640813c2860cf06d12b (127.26.232.66). New cstate: current_term: 2 leader_uuid: "fbb608d94d274640813c2860cf06d12b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: UNKNOWN } } }
I20260203 09:15:44.406874 27765 raft_consensus.cc:3060] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:15:44.410389 27691 raft_consensus.cc:2468] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c565ce064e6347999f31e94e51b3eb3b in term 2.
W20260203 09:15:44.410874 27913 consensus_queue.cc:1175] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dabe360bbf6a4beaae517c7b84267c38" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260203 09:15:44.412963 27807 leader_election.cc:304] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, dabe360bbf6a4beaae517c7b84267c38; no voters:
I20260203 09:15:44.413781 27961 raft_consensus.cc:2804] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:15:44.414258 27961 raft_consensus.cc:697] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b [term 2 LEADER]: Becoming Leader. State: Replica: c565ce064e6347999f31e94e51b3eb3b, State: Running, Role: LEADER
I20260203 09:15:44.415053 27961 consensus_queue.cc:237] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:44.423179 27912 consensus_queue.cc:1048] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:15:44.431291 27765 raft_consensus.cc:2468] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c565ce064e6347999f31e94e51b3eb3b in term 2.
I20260203 09:15:44.400272 27839 raft_consensus.cc:2468] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabe360bbf6a4beaae517c7b84267c38 in term 2.
I20260203 09:15:44.450486 27583 catalog_manager.cc:5654] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b reported cstate change: term changed from 1 to 2, leader changed from fbb608d94d274640813c2860cf06d12b (127.26.232.66) to c565ce064e6347999f31e94e51b3eb3b (127.26.232.67). New cstate: current_term: 2 leader_uuid: "c565ce064e6347999f31e94e51b3eb3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: HEALTHY } } }
I20260203 09:15:44.462949 27654 leader_election.cc:304] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, dabe360bbf6a4beaae517c7b84267c38; no voters: fbb608d94d274640813c2860cf06d12b
I20260203 09:15:44.465917 27912 raft_consensus.cc:2804] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:15:44.466459 27912 raft_consensus.cc:697] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [term 2 LEADER]: Becoming Leader. State: Replica: dabe360bbf6a4beaae517c7b84267c38, State: Running, Role: LEADER
I20260203 09:15:44.467324 27912 consensus_queue.cc:237] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:44.481868 27585 catalog_manager.cc:5654] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 reported cstate change: term changed from 1 to 2, leader changed from c565ce064e6347999f31e94e51b3eb3b (127.26.232.67) to dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65). New cstate: current_term: 2 leader_uuid: "dabe360bbf6a4beaae517c7b84267c38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: UNKNOWN } } }
I20260203 09:15:44.490299 27892 raft_consensus.cc:993] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b: : Instructing follower dabe360bbf6a4beaae517c7b84267c38 to start an election
I20260203 09:15:44.490738 27913 raft_consensus.cc:1081] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 1 LEADER]: Signalling peer dabe360bbf6a4beaae517c7b84267c38 to start an election
I20260203 09:15:44.492020 27691 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a88ea51ed509432fae935d15fcd8a913"
dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
from {username='slave'} at 127.0.0.1:53050
I20260203 09:15:44.492460 27691 raft_consensus.cc:493] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:15:44.492774 27691 raft_consensus.cc:3060] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:15:44.497586 27691 raft_consensus.cc:515] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:44.499258 27691 leader_election.cc:290] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 2 election: Requested vote from peers fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:44.500082 27765 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a88ea51ed509432fae935d15fcd8a913" candidate_uuid: "dabe360bbf6a4beaae517c7b84267c38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbb608d94d274640813c2860cf06d12b"
I20260203 09:15:44.500696 27765 raft_consensus.cc:3055] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:15:44.501051 27765 raft_consensus.cc:740] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Running, Role: LEADER
I20260203 09:15:44.501395 27839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a88ea51ed509432fae935d15fcd8a913" candidate_uuid: "dabe360bbf6a4beaae517c7b84267c38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
I20260203 09:15:44.501895 27839 raft_consensus.cc:3060] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:15:44.501807 27765 consensus_queue.cc:260] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:44.503104 27765 raft_consensus.cc:3060] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:15:44.509418 27839 raft_consensus.cc:2468] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabe360bbf6a4beaae517c7b84267c38 in term 2.
I20260203 09:15:44.509419 27765 raft_consensus.cc:2468] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabe360bbf6a4beaae517c7b84267c38 in term 2.
I20260203 09:15:44.510764 27652 leader_election.cc:304] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dabe360bbf6a4beaae517c7b84267c38, fbb608d94d274640813c2860cf06d12b; no voters:
I20260203 09:15:44.511610 27973 raft_consensus.cc:2804] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:15:44.511968 27973 raft_consensus.cc:697] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [term 2 LEADER]: Becoming Leader. State: Replica: dabe360bbf6a4beaae517c7b84267c38, State: Running, Role: LEADER
I20260203 09:15:44.512684 27973 consensus_queue.cc:237] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:44.519651 27585 catalog_manager.cc:5654] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 reported cstate change: term changed from 1 to 2, leader changed from fbb608d94d274640813c2860cf06d12b (127.26.232.66) to dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65). New cstate: current_term: 2 leader_uuid: "dabe360bbf6a4beaae517c7b84267c38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: UNKNOWN } } }
I20260203 09:15:44.657941 27839 raft_consensus.cc:1275] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Refusing update from remote peer fbb608d94d274640813c2860cf06d12b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:15:44.659142 27913 consensus_queue.cc:1048] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:15:44.666906 27691 raft_consensus.cc:3060] T 4989b3f204bb43ada40440b6894de910 P dabe360bbf6a4beaae517c7b84267c38 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:15:44.675237 27691 raft_consensus.cc:1275] T 4989b3f204bb43ada40440b6894de910 P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Refusing update from remote peer fbb608d94d274640813c2860cf06d12b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:15:44.677055 27974 consensus_queue.cc:1048] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:15:44.723438 27691 raft_consensus.cc:3060] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:15:44.731871 27691 raft_consensus.cc:1275] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Refusing update from remote peer fbb608d94d274640813c2860cf06d12b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:15:44.733498 27974 consensus_queue.cc:1048] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:15:44.734333 27839 raft_consensus.cc:1275] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Refusing update from remote peer fbb608d94d274640813c2860cf06d12b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:15:44.735881 27974 consensus_queue.cc:1048] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:15:44.893465 27839 raft_consensus.cc:1275] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Refusing update from remote peer dabe360bbf6a4beaae517c7b84267c38: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:15:44.894959 27973 consensus_queue.cc:1048] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:15:44.903016 27765 raft_consensus.cc:3060] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:15:44.909282 27765 raft_consensus.cc:1275] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Refusing update from remote peer dabe360bbf6a4beaae517c7b84267c38: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:15:44.910468 27972 consensus_queue.cc:1048] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:15:44.917446 27765 raft_consensus.cc:1275] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Refusing update from remote peer dabe360bbf6a4beaae517c7b84267c38: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:15:44.918535 27972 consensus_queue.cc:1048] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:15:44.927282 27765 raft_consensus.cc:1275] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Refusing update from remote peer c565ce064e6347999f31e94e51b3eb3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:15:44.927999 27839 raft_consensus.cc:1275] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Refusing update from remote peer dabe360bbf6a4beaae517c7b84267c38: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:15:44.928618 27961 consensus_queue.cc:1048] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:15:44.929584 27973 consensus_queue.cc:1048] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:15:44.945389 27691 raft_consensus.cc:1275] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Refusing update from remote peer c565ce064e6347999f31e94e51b3eb3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:15:44.948249 27961 consensus_queue.cc:1048] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:15:47.224165 27553 auto_leader_rebalancer-test.cc:272] The leader distribution is
I20260203 09:15:47.224936 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:15:47.242223 27689 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a88ea51ed509432fae935d15fcd8a913"
dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
mode: GRACEFUL
new_leader_uuid: "c565ce064e6347999f31e94e51b3eb3b"
from {username='slave'} at 127.0.0.1:51534
I20260203 09:15:47.242729 27689 raft_consensus.cc:606] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [term 2 LEADER]: Received request to transfer leadership to TS c565ce064e6347999f31e94e51b3eb3b
I20260203 09:15:47.253456 27768 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "daa6f7f8fc244b1aa48b751d437dcc77"
dest_uuid: "fbb608d94d274640813c2860cf06d12b"
mode: GRACEFUL
new_leader_uuid: "c565ce064e6347999f31e94e51b3eb3b"
from {username='slave'} at 127.0.0.1:55880
I20260203 09:15:47.254068 27768 raft_consensus.cc:606] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 2 LEADER]: Received request to transfer leadership to TS c565ce064e6347999f31e94e51b3eb3b
I20260203 09:15:47.255304 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260203 09:15:47.255831 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:15:47.267496 27974 raft_consensus.cc:993] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b: : Instructing follower c565ce064e6347999f31e94e51b3eb3b to start an election
I20260203 09:15:47.267891 27974 raft_consensus.cc:1081] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 2 LEADER]: Signalling peer c565ce064e6347999f31e94e51b3eb3b to start an election
I20260203 09:15:47.269559 27841 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "daa6f7f8fc244b1aa48b751d437dcc77"
dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
from {username='slave'} at 127.0.0.1:55610
I20260203 09:15:47.270133 27841 raft_consensus.cc:493] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:15:47.270440 27841 raft_consensus.cc:3060] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:15:47.275740 27841 raft_consensus.cc:515] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:47.277595 27841 leader_election.cc:290] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 3 election: Requested vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849)
I20260203 09:15:47.278563 27689 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "daa6f7f8fc244b1aa48b751d437dcc77" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
I20260203 09:15:47.278857 27768 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "daa6f7f8fc244b1aa48b751d437dcc77" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fbb608d94d274640813c2860cf06d12b"
I20260203 09:15:47.279251 27689 raft_consensus.cc:3060] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:15:47.279354 27768 raft_consensus.cc:3055] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:15:47.279709 27768 raft_consensus.cc:740] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Running, Role: LEADER
W20260203 09:15:47.280722 27863 debug-util.cc:398] Leaking SignalData structure 0x7b080002f2c0 after lost signal to thread 27556
I20260203 09:15:47.280453 27768 consensus_queue.cc:260] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
W20260203 09:15:47.281443 27863 debug-util.cc:398] Leaking SignalData structure 0x7b080002f9c0 after lost signal to thread 27620
I20260203 09:15:47.281684 27768 raft_consensus.cc:3060] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:15:47.283051 27863 debug-util.cc:398] Leaking SignalData structure 0x7b08001b4680 after lost signal to thread 27866
I20260203 09:15:47.286465 27689 raft_consensus.cc:2468] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c565ce064e6347999f31e94e51b3eb3b in term 3.
I20260203 09:15:47.287755 27807 leader_election.cc:304] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, dabe360bbf6a4beaae517c7b84267c38; no voters:
I20260203 09:15:47.288106 27768 raft_consensus.cc:2468] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c565ce064e6347999f31e94e51b3eb3b in term 3.
I20260203 09:15:47.288774 27978 raft_consensus.cc:2804] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:15:47.290611 27978 raft_consensus.cc:697] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 3 LEADER]: Becoming Leader. State: Replica: c565ce064e6347999f31e94e51b3eb3b, State: Running, Role: LEADER
I20260203 09:15:47.291469 27978 consensus_queue.cc:237] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:47.302424 27583 catalog_manager.cc:5654] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b reported cstate change: term changed from 2 to 3, leader changed from fbb608d94d274640813c2860cf06d12b (127.26.232.66) to c565ce064e6347999f31e94e51b3eb3b (127.26.232.67). New cstate: current_term: 3 leader_uuid: "c565ce064e6347999f31e94e51b3eb3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: HEALTHY } } }
I20260203 09:15:47.321955 27992 raft_consensus.cc:993] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38: : Instructing follower c565ce064e6347999f31e94e51b3eb3b to start an election
I20260203 09:15:47.322386 27980 raft_consensus.cc:1081] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [term 2 LEADER]: Signalling peer c565ce064e6347999f31e94e51b3eb3b to start an election
I20260203 09:15:47.323958 27841 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a88ea51ed509432fae935d15fcd8a913"
dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
from {username='slave'} at 127.0.0.1:55618
I20260203 09:15:47.324488 27841 raft_consensus.cc:493] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:15:47.324801 27841 raft_consensus.cc:3060] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:15:47.329896 27841 raft_consensus.cc:515] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:47.331666 27841 leader_election.cc:290] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 3 election: Requested vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849)
I20260203 09:15:47.333038 27689 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a88ea51ed509432fae935d15fcd8a913" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
I20260203 09:15:47.333141 27768 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a88ea51ed509432fae935d15fcd8a913" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fbb608d94d274640813c2860cf06d12b"
I20260203 09:15:47.333835 27689 raft_consensus.cc:3055] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:15:47.333925 27768 raft_consensus.cc:3060] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:15:47.334306 27689 raft_consensus.cc:740] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dabe360bbf6a4beaae517c7b84267c38, State: Running, Role: LEADER
I20260203 09:15:47.335264 27689 consensus_queue.cc:260] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:47.336637 27689 raft_consensus.cc:3060] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:15:47.339040 27768 raft_consensus.cc:2468] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c565ce064e6347999f31e94e51b3eb3b in term 3.
I20260203 09:15:47.340162 27805 leader_election.cc:304] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, fbb608d94d274640813c2860cf06d12b; no voters:
I20260203 09:15:47.340863 27978 raft_consensus.cc:2804] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:15:47.341244 27978 raft_consensus.cc:697] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 3 LEADER]: Becoming Leader. State: Replica: c565ce064e6347999f31e94e51b3eb3b, State: Running, Role: LEADER
I20260203 09:15:47.342038 27978 consensus_queue.cc:237] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:47.344841 27689 raft_consensus.cc:2468] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c565ce064e6347999f31e94e51b3eb3b in term 3.
I20260203 09:15:47.350009 27583 catalog_manager.cc:5654] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b reported cstate change: term changed from 2 to 3, leader changed from dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65) to c565ce064e6347999f31e94e51b3eb3b (127.26.232.67). New cstate: current_term: 3 leader_uuid: "c565ce064e6347999f31e94e51b3eb3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: HEALTHY } } }
I20260203 09:15:47.729907 27768 raft_consensus.cc:1275] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 3 FOLLOWER]: Refusing update from remote peer c565ce064e6347999f31e94e51b3eb3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:15:47.731371 27978 consensus_queue.cc:1048] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:15:47.747546 27689 raft_consensus.cc:1275] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [term 3 FOLLOWER]: Refusing update from remote peer c565ce064e6347999f31e94e51b3eb3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:15:47.749037 27978 consensus_queue.cc:1048] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:15:47.825256 27768 raft_consensus.cc:1275] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 3 FOLLOWER]: Refusing update from remote peer c565ce064e6347999f31e94e51b3eb3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:15:47.826530 27978 consensus_queue.cc:1048] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:15:47.840026 27689 raft_consensus.cc:1275] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [term 3 FOLLOWER]: Refusing update from remote peer c565ce064e6347999f31e94e51b3eb3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:15:47.848543 27986 consensus_queue.cc:1048] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:15:48.256994 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:15:48.265913 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:15:48.266465 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:15:49.267577 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:15:49.274895 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:15:49.275477 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:15:50.276821 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:15:50.282397 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:15:50.282794 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:15:51.283708 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:15:51.290149 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:15:51.290624 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:15:52.291473 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:15:52.296914 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:15:52.297405 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:15:53.298373 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:15:53.303722 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:15:53.304154 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:15:54.305100 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:15:54.309639 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:15:54.310019 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:15:55.310873 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:15:55.315513 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:15:55.315882 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:15:56.316788 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:15:56.321409 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:15:56.321802 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:15:57.351751 27553 auto_leader_rebalancer-test.cc:291] The leader distribution is
I20260203 09:15:57.372787 27691 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "074d2018d1254198abb02cd9463e64f9"
dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
mode: GRACEFUL
new_leader_uuid: "fbb608d94d274640813c2860cf06d12b"
from {username='slave'} at 127.0.0.1:49944
I20260203 09:15:57.373492 27691 raft_consensus.cc:606] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [term 2 LEADER]: Received request to transfer leadership to TS fbb608d94d274640813c2860cf06d12b
I20260203 09:15:57.378719 27841 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a88ea51ed509432fae935d15fcd8a913"
dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
mode: GRACEFUL
new_leader_uuid: "fbb608d94d274640813c2860cf06d12b"
from {username='slave'} at 127.0.0.1:35460
I20260203 09:15:57.379251 27841 raft_consensus.cc:606] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 3 LEADER]: Received request to transfer leadership to TS fbb608d94d274640813c2860cf06d12b
I20260203 09:15:57.384039 27691 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "ce1a18a70d52493abcb4675c3a6e1b1f"
dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
mode: GRACEFUL
new_leader_uuid: "fbb608d94d274640813c2860cf06d12b"
from {username='slave'} at 127.0.0.1:49944
I20260203 09:15:57.384537 27691 raft_consensus.cc:606] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [term 1 LEADER]: Received request to transfer leadership to TS fbb608d94d274640813c2860cf06d12b
I20260203 09:15:57.389343 27691 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "05e6e3dcf873416a9cb57fccfcd6f002"
dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
mode: GRACEFUL
new_leader_uuid: "fbb608d94d274640813c2860cf06d12b"
from {username='slave'} at 127.0.0.1:49944
I20260203 09:15:57.390245 27691 raft_consensus.cc:606] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 1 LEADER]: Received request to transfer leadership to TS fbb608d94d274640813c2860cf06d12b
I20260203 09:15:57.401912 27841 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "daa6f7f8fc244b1aa48b751d437dcc77"
dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
mode: GRACEFUL
new_leader_uuid: "fbb608d94d274640813c2860cf06d12b"
from {username='slave'} at 127.0.0.1:35460
I20260203 09:15:57.402630 27841 raft_consensus.cc:606] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 3 LEADER]: Received request to transfer leadership to TS fbb608d94d274640813c2860cf06d12b
I20260203 09:15:57.418346 28011 raft_consensus.cc:993] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b: : Instructing follower fbb608d94d274640813c2860cf06d12b to start an election
I20260203 09:15:57.418812 28011 raft_consensus.cc:1081] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 3 LEADER]: Signalling peer fbb608d94d274640813c2860cf06d12b to start an election
I20260203 09:15:57.420483 27768 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "daa6f7f8fc244b1aa48b751d437dcc77"
dest_uuid: "fbb608d94d274640813c2860cf06d12b"
from {username='slave'} at 127.0.0.1:50884
I20260203 09:15:57.420964 27768 raft_consensus.cc:493] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:15:57.421273 27768 raft_consensus.cc:3060] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:15:57.426743 27768 raft_consensus.cc:515] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:57.428226 27768 leader_election.cc:290] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 4 election: Requested vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:57.429327 27691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "daa6f7f8fc244b1aa48b751d437dcc77" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
I20260203 09:15:57.429522 27841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "daa6f7f8fc244b1aa48b751d437dcc77" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
I20260203 09:15:57.429910 27691 raft_consensus.cc:3060] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:15:57.430019 27841 raft_consensus.cc:3055] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:15:57.430367 27841 raft_consensus.cc:740] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c565ce064e6347999f31e94e51b3eb3b, State: Running, Role: LEADER
I20260203 09:15:57.430953 27841 consensus_queue.cc:260] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:57.431855 27841 raft_consensus.cc:3060] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:15:57.434902 27691 raft_consensus.cc:2468] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 4.
I20260203 09:15:57.436105 27731 leader_election.cc:304] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dabe360bbf6a4beaae517c7b84267c38, fbb608d94d274640813c2860cf06d12b; no voters:
I20260203 09:15:57.436440 27841 raft_consensus.cc:2468] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 4.
I20260203 09:15:57.437184 28007 raft_consensus.cc:2804] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:15:57.438301 28007 raft_consensus.cc:697] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 4 LEADER]: Becoming Leader. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Running, Role: LEADER
I20260203 09:15:57.439236 28007 consensus_queue.cc:237] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:57.446545 27584 catalog_manager.cc:5654] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b reported cstate change: term changed from 3 to 4, leader changed from c565ce064e6347999f31e94e51b3eb3b (127.26.232.67) to fbb608d94d274640813c2860cf06d12b (127.26.232.66). New cstate: current_term: 4 leader_uuid: "fbb608d94d274640813c2860cf06d12b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: UNKNOWN } } }
I20260203 09:15:57.697032 28006 raft_consensus.cc:993] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b: : Instructing follower fbb608d94d274640813c2860cf06d12b to start an election
I20260203 09:15:57.697474 28006 raft_consensus.cc:1081] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 3 LEADER]: Signalling peer fbb608d94d274640813c2860cf06d12b to start an election
I20260203 09:15:57.698845 27768 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a88ea51ed509432fae935d15fcd8a913"
dest_uuid: "fbb608d94d274640813c2860cf06d12b"
from {username='slave'} at 127.0.0.1:50884
I20260203 09:15:57.699244 27768 raft_consensus.cc:493] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:15:57.699463 27768 raft_consensus.cc:3060] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:15:57.703524 27768 raft_consensus.cc:515] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:57.704947 27768 leader_election.cc:290] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 4 election: Requested vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:57.705680 27691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a88ea51ed509432fae935d15fcd8a913" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
I20260203 09:15:57.705892 27841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a88ea51ed509432fae935d15fcd8a913" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
I20260203 09:15:57.706260 27691 raft_consensus.cc:3060] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:15:57.706389 27841 raft_consensus.cc:3055] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:15:57.706789 27841 raft_consensus.cc:740] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c565ce064e6347999f31e94e51b3eb3b, State: Running, Role: LEADER
I20260203 09:15:57.707953 27841 consensus_queue.cc:260] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:57.709172 27841 raft_consensus.cc:3060] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:15:57.710029 28018 raft_consensus.cc:993] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38: : Instructing follower fbb608d94d274640813c2860cf06d12b to start an election
I20260203 09:15:57.710600 27980 raft_consensus.cc:1081] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [term 2 LEADER]: Signalling peer fbb608d94d274640813c2860cf06d12b to start an election
I20260203 09:15:57.712213 27768 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "074d2018d1254198abb02cd9463e64f9"
dest_uuid: "fbb608d94d274640813c2860cf06d12b"
from {username='slave'} at 127.0.0.1:50882
I20260203 09:15:57.712567 27691 raft_consensus.cc:2468] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 4.
I20260203 09:15:57.712780 27768 raft_consensus.cc:493] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:15:57.713122 27768 raft_consensus.cc:3060] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:15:57.713557 27731 leader_election.cc:304] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dabe360bbf6a4beaae517c7b84267c38, fbb608d94d274640813c2860cf06d12b; no voters:
I20260203 09:15:57.714223 27841 raft_consensus.cc:2468] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 4.
I20260203 09:15:57.714411 28012 raft_consensus.cc:2804] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:15:57.715492 28012 raft_consensus.cc:697] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 4 LEADER]: Becoming Leader. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Running, Role: LEADER
I20260203 09:15:57.716176 28012 consensus_queue.cc:237] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:57.718789 27768 raft_consensus.cc:515] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:57.720611 27768 leader_election.cc:290] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 3 election: Requested vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:57.722344 27841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "074d2018d1254198abb02cd9463e64f9" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
I20260203 09:15:57.722208 27691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "074d2018d1254198abb02cd9463e64f9" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
I20260203 09:15:57.722877 27841 raft_consensus.cc:3060] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:15:57.722944 27691 raft_consensus.cc:3055] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:15:57.723397 27691 raft_consensus.cc:740] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dabe360bbf6a4beaae517c7b84267c38, State: Running, Role: LEADER
I20260203 09:15:57.723610 27584 catalog_manager.cc:5654] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b reported cstate change: term changed from 3 to 4, leader changed from c565ce064e6347999f31e94e51b3eb3b (127.26.232.67) to fbb608d94d274640813c2860cf06d12b (127.26.232.66). New cstate: current_term: 4 leader_uuid: "fbb608d94d274640813c2860cf06d12b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: UNKNOWN } } }
I20260203 09:15:57.724150 27691 consensus_queue.cc:260] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:57.725816 27691 raft_consensus.cc:3060] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:15:57.730082 27841 raft_consensus.cc:2468] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 3.
I20260203 09:15:57.731362 27731 leader_election.cc:304] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, fbb608d94d274640813c2860cf06d12b; no voters:
I20260203 09:15:57.732136 28012 raft_consensus.cc:2804] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:15:57.732095 27691 raft_consensus.cc:2468] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 3.
I20260203 09:15:57.732806 28012 raft_consensus.cc:697] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b [term 3 LEADER]: Becoming Leader. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Running, Role: LEADER
I20260203 09:15:57.733645 28012 consensus_queue.cc:237] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:57.740366 27584 catalog_manager.cc:5654] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b reported cstate change: term changed from 2 to 3, leader changed from dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65) to fbb608d94d274640813c2860cf06d12b (127.26.232.66). New cstate: current_term: 3 leader_uuid: "fbb608d94d274640813c2860cf06d12b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: UNKNOWN } } }
I20260203 09:15:57.798635 28018 raft_consensus.cc:993] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38: : Instructing follower fbb608d94d274640813c2860cf06d12b to start an election
I20260203 09:15:57.799062 27980 raft_consensus.cc:1081] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 1 LEADER]: Signalling peer fbb608d94d274640813c2860cf06d12b to start an election
I20260203 09:15:57.800351 27768 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "05e6e3dcf873416a9cb57fccfcd6f002"
dest_uuid: "fbb608d94d274640813c2860cf06d12b"
from {username='slave'} at 127.0.0.1:50882
I20260203 09:15:57.800782 27768 raft_consensus.cc:493] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:15:57.801033 27768 raft_consensus.cc:3060] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:15:57.805291 27768 raft_consensus.cc:515] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:57.806542 27768 leader_election.cc:290] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 2 election: Requested vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:57.807657 27691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05e6e3dcf873416a9cb57fccfcd6f002" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
I20260203 09:15:57.807823 27841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05e6e3dcf873416a9cb57fccfcd6f002" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
I20260203 09:15:57.808406 27691 raft_consensus.cc:3055] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:15:57.808537 27841 raft_consensus.cc:3060] T 05e6e3dcf873416a9cb57fccfcd6f002 P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:15:57.808809 27691 raft_consensus.cc:740] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dabe360bbf6a4beaae517c7b84267c38, State: Running, Role: LEADER
I20260203 09:15:57.809619 27691 consensus_queue.cc:260] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:57.811039 27691 raft_consensus.cc:3060] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:15:57.816387 27841 raft_consensus.cc:2468] T 05e6e3dcf873416a9cb57fccfcd6f002 P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 2.
I20260203 09:15:57.817637 27731 leader_election.cc:304] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, fbb608d94d274640813c2860cf06d12b; no voters:
I20260203 09:15:57.818317 27691 raft_consensus.cc:2468] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 2.
I20260203 09:15:57.818548 28012 raft_consensus.cc:2804] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:15:57.819108 28012 raft_consensus.cc:697] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [term 2 LEADER]: Becoming Leader. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Running, Role: LEADER
I20260203 09:15:57.820065 28012 consensus_queue.cc:237] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:57.827545 27584 catalog_manager.cc:5654] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b reported cstate change: term changed from 1 to 2, leader changed from dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65) to fbb608d94d274640813c2860cf06d12b (127.26.232.66). New cstate: current_term: 2 leader_uuid: "fbb608d94d274640813c2860cf06d12b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: UNKNOWN } } }
I20260203 09:15:57.830382 28018 raft_consensus.cc:993] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38: : Instructing follower fbb608d94d274640813c2860cf06d12b to start an election
I20260203 09:15:57.830878 28018 raft_consensus.cc:1081] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [term 1 LEADER]: Signalling peer fbb608d94d274640813c2860cf06d12b to start an election
I20260203 09:15:57.832713 27768 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "ce1a18a70d52493abcb4675c3a6e1b1f"
dest_uuid: "fbb608d94d274640813c2860cf06d12b"
from {username='slave'} at 127.0.0.1:50882
I20260203 09:15:57.833117 27768 raft_consensus.cc:493] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:15:57.833372 27768 raft_consensus.cc:3060] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:15:57.838078 27768 raft_consensus.cc:515] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:57.839370 27768 leader_election.cc:290] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 2 election: Requested vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:15:57.840184 27691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce1a18a70d52493abcb4675c3a6e1b1f" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
I20260203 09:15:57.840416 27841 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce1a18a70d52493abcb4675c3a6e1b1f" candidate_uuid: "fbb608d94d274640813c2860cf06d12b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
I20260203 09:15:57.840767 27691 raft_consensus.cc:3055] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:15:57.840870 27841 raft_consensus.cc:3060] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:15:57.841037 27691 raft_consensus.cc:740] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dabe360bbf6a4beaae517c7b84267c38, State: Running, Role: LEADER
I20260203 09:15:57.841675 27691 consensus_queue.cc:260] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:57.842482 27691 raft_consensus.cc:3060] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:15:57.844898 27841 raft_consensus.cc:2468] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 2.
I20260203 09:15:57.845762 27731 leader_election.cc:304] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, fbb608d94d274640813c2860cf06d12b; no voters:
I20260203 09:15:57.846546 28012 raft_consensus.cc:2804] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:15:57.846660 27691 raft_consensus.cc:2468] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbb608d94d274640813c2860cf06d12b in term 2.
I20260203 09:15:57.847050 28012 raft_consensus.cc:697] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [term 2 LEADER]: Becoming Leader. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Running, Role: LEADER
I20260203 09:15:57.847960 28012 consensus_queue.cc:237] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:15:57.855803 27584 catalog_manager.cc:5654] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b reported cstate change: term changed from 1 to 2, leader changed from dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65) to fbb608d94d274640813c2860cf06d12b (127.26.232.66). New cstate: current_term: 2 leader_uuid: "fbb608d94d274640813c2860cf06d12b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: UNKNOWN } } }
I20260203 09:15:58.018844 27841 raft_consensus.cc:1275] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 4 FOLLOWER]: Refusing update from remote peer fbb608d94d274640813c2860cf06d12b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260203 09:15:58.020143 28012 consensus_queue.cc:1048] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:15:58.029901 27691 raft_consensus.cc:1275] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [term 4 FOLLOWER]: Refusing update from remote peer fbb608d94d274640813c2860cf06d12b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260203 09:15:58.031904 28012 consensus_queue.cc:1048] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:15:58.498613 27690 raft_consensus.cc:1275] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Refusing update from remote peer fbb608d94d274640813c2860cf06d12b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:15:58.499457 27688 raft_consensus.cc:1275] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [term 3 FOLLOWER]: Refusing update from remote peer fbb608d94d274640813c2860cf06d12b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:15:58.502982 27688 raft_consensus.cc:1275] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [term 4 FOLLOWER]: Refusing update from remote peer fbb608d94d274640813c2860cf06d12b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260203 09:15:58.503079 27839 raft_consensus.cc:1275] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 4 FOLLOWER]: Refusing update from remote peer fbb608d94d274640813c2860cf06d12b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260203 09:15:58.507086 28028 consensus_queue.cc:1048] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:15:58.508194 28012 consensus_queue.cc:1048] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:15:58.508378 28028 consensus_queue.cc:1048] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:15:58.512018 28007 consensus_queue.cc:1048] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:15:58.518620 27842 raft_consensus.cc:1275] T 05e6e3dcf873416a9cb57fccfcd6f002 P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Refusing update from remote peer fbb608d94d274640813c2860cf06d12b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:15:58.521979 28028 consensus_queue.cc:1048] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:15:58.527384 27841 raft_consensus.cc:1275] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [term 3 FOLLOWER]: Refusing update from remote peer fbb608d94d274640813c2860cf06d12b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:15:58.547029 28030 consensus_queue.cc:1048] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260203 09:15:58.568883 27690 raft_consensus.cc:1275] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Refusing update from remote peer fbb608d94d274640813c2860cf06d12b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:15:58.574985 28012 consensus_queue.cc:1048] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:15:58.588353 27839 raft_consensus.cc:1275] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Refusing update from remote peer fbb608d94d274640813c2860cf06d12b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:15:58.593632 28007 consensus_queue.cc:1048] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260203 09:15:59.414866 27789 debug-util.cc:398] Leaking SignalData structure 0x7b080012b060 after lost signal to thread 27556
W20260203 09:15:59.415827 27789 debug-util.cc:398] Leaking SignalData structure 0x7b080012b740 after lost signal to thread 27620
W20260203 09:15:59.416623 27789 debug-util.cc:398] Leaking SignalData structure 0x7b08000cfc80 after lost signal to thread 27715
W20260203 09:15:59.417490 27789 debug-util.cc:398] Leaking SignalData structure 0x7b08000a0980 after lost signal to thread 27792
W20260203 09:15:59.418241 27789 debug-util.cc:398] Leaking SignalData structure 0x7b08001ecce0 after lost signal to thread 27866
I20260203 09:16:00.779523 27553 auto_leader_rebalancer-test.cc:306] The leader distribution is
I20260203 09:16:00.781090 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:00.792366 27768 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "05e6e3dcf873416a9cb57fccfcd6f002"
dest_uuid: "fbb608d94d274640813c2860cf06d12b"
mode: GRACEFUL
new_leader_uuid: "dabe360bbf6a4beaae517c7b84267c38"
from {username='slave'} at 127.0.0.1:55880
I20260203 09:16:00.793360 27768 raft_consensus.cc:606] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [term 2 LEADER]: Received request to transfer leadership to TS dabe360bbf6a4beaae517c7b84267c38
I20260203 09:16:00.796401 27768 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "ce1a18a70d52493abcb4675c3a6e1b1f"
dest_uuid: "fbb608d94d274640813c2860cf06d12b"
mode: GRACEFUL
new_leader_uuid: "c565ce064e6347999f31e94e51b3eb3b"
from {username='slave'} at 127.0.0.1:55880
I20260203 09:16:00.796984 27768 raft_consensus.cc:606] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [term 2 LEADER]: Received request to transfer leadership to TS c565ce064e6347999f31e94e51b3eb3b
I20260203 09:16:00.799940 27768 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d3fac0b874aa4090bd3c394c817e14ec"
dest_uuid: "fbb608d94d274640813c2860cf06d12b"
mode: GRACEFUL
new_leader_uuid: "dabe360bbf6a4beaae517c7b84267c38"
from {username='slave'} at 127.0.0.1:55880
I20260203 09:16:00.800535 27768 raft_consensus.cc:606] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [term 1 LEADER]: Received request to transfer leadership to TS dabe360bbf6a4beaae517c7b84267c38
I20260203 09:16:00.803226 27768 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "daa6f7f8fc244b1aa48b751d437dcc77"
dest_uuid: "fbb608d94d274640813c2860cf06d12b"
mode: GRACEFUL
new_leader_uuid: "dabe360bbf6a4beaae517c7b84267c38"
from {username='slave'} at 127.0.0.1:55880
I20260203 09:16:00.803803 27768 raft_consensus.cc:606] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 4 LEADER]: Received request to transfer leadership to TS dabe360bbf6a4beaae517c7b84267c38
I20260203 09:16:00.806155 27768 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "ed0fc738bbc64c31a0b86c6b1f807f7e"
dest_uuid: "fbb608d94d274640813c2860cf06d12b"
mode: GRACEFUL
new_leader_uuid: "c565ce064e6347999f31e94e51b3eb3b"
from {username='slave'} at 127.0.0.1:55880
I20260203 09:16:00.806942 27768 raft_consensus.cc:606] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [term 1 LEADER]: Received request to transfer leadership to TS c565ce064e6347999f31e94e51b3eb3b
I20260203 09:16:00.808456 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260203 09:16:00.809348 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:00.843086 28035 raft_consensus.cc:993] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b: : Instructing follower c565ce064e6347999f31e94e51b3eb3b to start an election
I20260203 09:16:00.843766 28046 raft_consensus.cc:1081] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [term 2 LEADER]: Signalling peer c565ce064e6347999f31e94e51b3eb3b to start an election
I20260203 09:16:00.845566 27841 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "ce1a18a70d52493abcb4675c3a6e1b1f"
dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
from {username='slave'} at 127.0.0.1:55610
I20260203 09:16:00.846184 27841 raft_consensus.cc:493] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:16:00.846601 27841 raft_consensus.cc:3060] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:16:00.849421 28035 raft_consensus.cc:993] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b: : Instructing follower c565ce064e6347999f31e94e51b3eb3b to start an election
I20260203 09:16:00.849849 28046 raft_consensus.cc:1081] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [term 1 LEADER]: Signalling peer c565ce064e6347999f31e94e51b3eb3b to start an election
I20260203 09:16:00.852186 27839 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "ed0fc738bbc64c31a0b86c6b1f807f7e"
dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
from {username='slave'} at 127.0.0.1:55610
I20260203 09:16:00.852888 27839 raft_consensus.cc:493] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:16:00.853513 27839 raft_consensus.cc:3060] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:00.855396 27841 raft_consensus.cc:515] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:16:00.859396 27841 leader_election.cc:290] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 3 election: Requested vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849)
I20260203 09:16:00.860296 27689 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce1a18a70d52493abcb4675c3a6e1b1f" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
I20260203 09:16:00.860141 27768 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce1a18a70d52493abcb4675c3a6e1b1f" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fbb608d94d274640813c2860cf06d12b"
I20260203 09:16:00.861135 27689 raft_consensus.cc:3060] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:16:00.861639 27768 raft_consensus.cc:3055] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:16:00.862026 27768 raft_consensus.cc:740] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Running, Role: LEADER
I20260203 09:16:00.863018 27768 consensus_queue.cc:260] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:16:00.864173 27839 raft_consensus.cc:515] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:16:00.864708 27768 raft_consensus.cc:3060] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:16:00.866793 27839 leader_election.cc:290] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 2 election: Requested vote from peers dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877), fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849)
I20260203 09:16:00.867470 27691 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed0fc738bbc64c31a0b86c6b1f807f7e" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
I20260203 09:16:00.867571 27765 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed0fc738bbc64c31a0b86c6b1f807f7e" candidate_uuid: "c565ce064e6347999f31e94e51b3eb3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbb608d94d274640813c2860cf06d12b"
I20260203 09:16:00.868157 27765 raft_consensus.cc:3055] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:16:00.868557 27765 raft_consensus.cc:740] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Running, Role: LEADER
I20260203 09:16:00.869447 27765 consensus_queue.cc:260] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:16:00.870424 27765 raft_consensus.cc:3060] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:00.872272 27689 raft_consensus.cc:2468] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c565ce064e6347999f31e94e51b3eb3b in term 3.
I20260203 09:16:00.868254 27691 raft_consensus.cc:3060] T ed0fc738bbc64c31a0b86c6b1f807f7e P dabe360bbf6a4beaae517c7b84267c38 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:00.874769 27807 leader_election.cc:304] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, dabe360bbf6a4beaae517c7b84267c38; no voters:
I20260203 09:16:00.876295 28006 raft_consensus.cc:2804] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:16:00.877522 27765 raft_consensus.cc:2468] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c565ce064e6347999f31e94e51b3eb3b in term 2.
I20260203 09:16:00.878971 27805 leader_election.cc:304] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, fbb608d94d274640813c2860cf06d12b; no voters:
I20260203 09:16:00.880002 28047 raft_consensus.cc:2804] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:16:00.880359 28006 raft_consensus.cc:697] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b [term 3 LEADER]: Becoming Leader. State: Replica: c565ce064e6347999f31e94e51b3eb3b, State: Running, Role: LEADER
I20260203 09:16:00.881781 28006 consensus_queue.cc:237] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:16:00.885035 27691 raft_consensus.cc:2468] T ed0fc738bbc64c31a0b86c6b1f807f7e P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c565ce064e6347999f31e94e51b3eb3b in term 2.
I20260203 09:16:00.892565 27768 raft_consensus.cc:2468] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c565ce064e6347999f31e94e51b3eb3b in term 3.
I20260203 09:16:00.896618 28047 raft_consensus.cc:697] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b [term 2 LEADER]: Becoming Leader. State: Replica: c565ce064e6347999f31e94e51b3eb3b, State: Running, Role: LEADER
I20260203 09:16:00.897771 28047 consensus_queue.cc:237] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:16:00.910395 27582 catalog_manager.cc:5654] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b reported cstate change: term changed from 2 to 3, leader changed from fbb608d94d274640813c2860cf06d12b (127.26.232.66) to c565ce064e6347999f31e94e51b3eb3b (127.26.232.67). New cstate: current_term: 3 leader_uuid: "c565ce064e6347999f31e94e51b3eb3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:00.930967 27582 catalog_manager.cc:5654] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b reported cstate change: term changed from 1 to 2, leader changed from fbb608d94d274640813c2860cf06d12b (127.26.232.66) to c565ce064e6347999f31e94e51b3eb3b (127.26.232.67). New cstate: current_term: 2 leader_uuid: "c565ce064e6347999f31e94e51b3eb3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:00.959138 28035 raft_consensus.cc:993] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b: : Instructing follower dabe360bbf6a4beaae517c7b84267c38 to start an election
I20260203 09:16:00.959615 28046 raft_consensus.cc:1081] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [term 1 LEADER]: Signalling peer dabe360bbf6a4beaae517c7b84267c38 to start an election
I20260203 09:16:00.961467 27691 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d3fac0b874aa4090bd3c394c817e14ec"
dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
from {username='slave'} at 127.0.0.1:53050
I20260203 09:16:00.961925 27691 raft_consensus.cc:493] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:16:00.962177 27691 raft_consensus.cc:3060] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:00.966679 27691 raft_consensus.cc:515] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:16:00.969261 27691 leader_election.cc:290] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 2 election: Requested vote from peers fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:16:00.969787 27768 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3fac0b874aa4090bd3c394c817e14ec" candidate_uuid: "dabe360bbf6a4beaae517c7b84267c38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fbb608d94d274640813c2860cf06d12b"
I20260203 09:16:00.970373 27768 raft_consensus.cc:3055] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:16:00.970659 27768 raft_consensus.cc:740] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Running, Role: LEADER
I20260203 09:16:00.971035 27839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d3fac0b874aa4090bd3c394c817e14ec" candidate_uuid: "dabe360bbf6a4beaae517c7b84267c38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
I20260203 09:16:00.971524 27839 raft_consensus.cc:3060] T d3fac0b874aa4090bd3c394c817e14ec P c565ce064e6347999f31e94e51b3eb3b [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:00.971566 27768 consensus_queue.cc:260] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:16:00.973124 27768 raft_consensus.cc:3060] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:00.977434 27839 raft_consensus.cc:2468] T d3fac0b874aa4090bd3c394c817e14ec P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabe360bbf6a4beaae517c7b84267c38 in term 2.
I20260203 09:16:00.978675 27654 leader_election.cc:304] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, dabe360bbf6a4beaae517c7b84267c38; no voters:
I20260203 09:16:00.979521 27768 raft_consensus.cc:2468] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabe360bbf6a4beaae517c7b84267c38 in term 2.
I20260203 09:16:00.980520 28055 raft_consensus.cc:2804] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:16:00.981966 28055 raft_consensus.cc:697] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38 [term 2 LEADER]: Becoming Leader. State: Replica: dabe360bbf6a4beaae517c7b84267c38, State: Running, Role: LEADER
I20260203 09:16:00.982846 28055 consensus_queue.cc:237] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:16:00.991830 27582 catalog_manager.cc:5654] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38 reported cstate change: term changed from 1 to 2, leader changed from fbb608d94d274640813c2860cf06d12b (127.26.232.66) to dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65). New cstate: current_term: 2 leader_uuid: "dabe360bbf6a4beaae517c7b84267c38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:01.247570 28035 raft_consensus.cc:993] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b: : Instructing follower dabe360bbf6a4beaae517c7b84267c38 to start an election
I20260203 09:16:01.248052 28035 raft_consensus.cc:1081] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 4 LEADER]: Signalling peer dabe360bbf6a4beaae517c7b84267c38 to start an election
I20260203 09:16:01.249967 27691 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "daa6f7f8fc244b1aa48b751d437dcc77"
dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
from {username='slave'} at 127.0.0.1:53050
I20260203 09:16:01.250533 27691 raft_consensus.cc:493] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:16:01.250808 27691 raft_consensus.cc:3060] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:16:01.257181 27691 raft_consensus.cc:515] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:16:01.258632 27691 leader_election.cc:290] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 5 election: Requested vote from peers fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:16:01.259567 27768 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "daa6f7f8fc244b1aa48b751d437dcc77" candidate_uuid: "dabe360bbf6a4beaae517c7b84267c38" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "fbb608d94d274640813c2860cf06d12b"
I20260203 09:16:01.259661 27839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "daa6f7f8fc244b1aa48b751d437dcc77" candidate_uuid: "dabe360bbf6a4beaae517c7b84267c38" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
I20260203 09:16:01.260162 27768 raft_consensus.cc:3055] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 4 LEADER]: Stepping down as leader of term 4
I20260203 09:16:01.260246 27839 raft_consensus.cc:3060] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:16:01.260542 27768 raft_consensus.cc:740] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Running, Role: LEADER
I20260203 09:16:01.261309 27768 consensus_queue.cc:260] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:16:01.262506 27768 raft_consensus.cc:3060] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:16:01.267176 27839 raft_consensus.cc:2468] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabe360bbf6a4beaae517c7b84267c38 in term 5.
I20260203 09:16:01.268311 27654 leader_election.cc:304] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c565ce064e6347999f31e94e51b3eb3b, dabe360bbf6a4beaae517c7b84267c38; no voters:
I20260203 09:16:01.269222 28055 raft_consensus.cc:2804] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [term 5 FOLLOWER]: Leader election won for term 5
I20260203 09:16:01.269583 27768 raft_consensus.cc:2468] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabe360bbf6a4beaae517c7b84267c38 in term 5.
I20260203 09:16:01.270315 28055 raft_consensus.cc:697] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [term 5 LEADER]: Becoming Leader. State: Replica: dabe360bbf6a4beaae517c7b84267c38, State: Running, Role: LEADER
I20260203 09:16:01.271329 28055 consensus_queue.cc:237] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:16:01.280956 27582 catalog_manager.cc:5654] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 reported cstate change: term changed from 4 to 5, leader changed from fbb608d94d274640813c2860cf06d12b (127.26.232.66) to dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65). New cstate: current_term: 5 leader_uuid: "dabe360bbf6a4beaae517c7b84267c38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:01.322580 28046 raft_consensus.cc:993] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b: : Instructing follower dabe360bbf6a4beaae517c7b84267c38 to start an election
I20260203 09:16:01.322994 28035 raft_consensus.cc:1081] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [term 2 LEADER]: Signalling peer dabe360bbf6a4beaae517c7b84267c38 to start an election
I20260203 09:16:01.324259 27691 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "05e6e3dcf873416a9cb57fccfcd6f002"
dest_uuid: "dabe360bbf6a4beaae517c7b84267c38"
from {username='slave'} at 127.0.0.1:53050
I20260203 09:16:01.324733 27691 raft_consensus.cc:493] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:16:01.324980 27691 raft_consensus.cc:3060] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:16:01.329178 27691 raft_consensus.cc:515] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:16:01.330565 27691 leader_election.cc:290] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 3 election: Requested vote from peers fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849), c565ce064e6347999f31e94e51b3eb3b (127.26.232.67:36111)
I20260203 09:16:01.331434 27768 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05e6e3dcf873416a9cb57fccfcd6f002" candidate_uuid: "dabe360bbf6a4beaae517c7b84267c38" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fbb608d94d274640813c2860cf06d12b"
I20260203 09:16:01.331629 27839 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05e6e3dcf873416a9cb57fccfcd6f002" candidate_uuid: "dabe360bbf6a4beaae517c7b84267c38" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c565ce064e6347999f31e94e51b3eb3b"
I20260203 09:16:01.331934 27768 raft_consensus.cc:3055] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:16:01.332198 27839 raft_consensus.cc:3060] T 05e6e3dcf873416a9cb57fccfcd6f002 P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:16:01.332208 27768 raft_consensus.cc:740] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fbb608d94d274640813c2860cf06d12b, State: Running, Role: LEADER
I20260203 09:16:01.333077 27768 consensus_queue.cc:260] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:16:01.333926 27768 raft_consensus.cc:3060] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:16:01.338337 27768 raft_consensus.cc:2468] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabe360bbf6a4beaae517c7b84267c38 in term 3.
I20260203 09:16:01.339591 27652 leader_election.cc:304] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dabe360bbf6a4beaae517c7b84267c38, fbb608d94d274640813c2860cf06d12b; no voters:
I20260203 09:16:01.340358 28055 raft_consensus.cc:2804] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:16:01.340857 28055 raft_consensus.cc:697] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 3 LEADER]: Becoming Leader. State: Replica: dabe360bbf6a4beaae517c7b84267c38, State: Running, Role: LEADER
I20260203 09:16:01.340966 27839 raft_consensus.cc:2468] T 05e6e3dcf873416a9cb57fccfcd6f002 P c565ce064e6347999f31e94e51b3eb3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dabe360bbf6a4beaae517c7b84267c38 in term 3.
I20260203 09:16:01.341753 28055 consensus_queue.cc:237] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } }
I20260203 09:16:01.349793 27582 catalog_manager.cc:5654] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 reported cstate change: term changed from 2 to 3, leader changed from fbb608d94d274640813c2860cf06d12b (127.26.232.66) to dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65). New cstate: current_term: 3 leader_uuid: "dabe360bbf6a4beaae517c7b84267c38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:01.377828 27768 raft_consensus.cc:1275] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [term 3 FOLLOWER]: Refusing update from remote peer c565ce064e6347999f31e94e51b3eb3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:16:01.378943 28006 consensus_queue.cc:1048] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:16:01.398442 27691 raft_consensus.cc:1275] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [term 3 FOLLOWER]: Refusing update from remote peer c565ce064e6347999f31e94e51b3eb3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:16:01.400142 28006 consensus_queue.cc:1048] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:16:01.422348 27691 raft_consensus.cc:1275] T ed0fc738bbc64c31a0b86c6b1f807f7e P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Refusing update from remote peer c565ce064e6347999f31e94e51b3eb3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:01.423472 28006 consensus_queue.cc:1048] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dabe360bbf6a4beaae517c7b84267c38" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:01.431872 27768 raft_consensus.cc:1275] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Refusing update from remote peer c565ce064e6347999f31e94e51b3eb3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:01.434295 28047 consensus_queue.cc:1048] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:01.486202 27768 raft_consensus.cc:1275] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Refusing update from remote peer dabe360bbf6a4beaae517c7b84267c38: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:01.487238 28055 consensus_queue.cc:1048] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:01.495389 27839 raft_consensus.cc:1275] T d3fac0b874aa4090bd3c394c817e14ec P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Refusing update from remote peer dabe360bbf6a4beaae517c7b84267c38: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:01.496760 28055 consensus_queue.cc:1048] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:01.751025 27839 raft_consensus.cc:1275] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 5 FOLLOWER]: Refusing update from remote peer dabe360bbf6a4beaae517c7b84267c38: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260203 09:16:01.752447 28068 consensus_queue.cc:1048] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260203 09:16:01.764917 27768 raft_consensus.cc:1275] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 5 FOLLOWER]: Refusing update from remote peer dabe360bbf6a4beaae517c7b84267c38: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260203 09:16:01.766866 28068 consensus_queue.cc:1048] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260203 09:16:01.810850 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:01.815769 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:01.816197 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:01.831408 27839 raft_consensus.cc:1275] T 05e6e3dcf873416a9cb57fccfcd6f002 P c565ce064e6347999f31e94e51b3eb3b [term 3 FOLLOWER]: Refusing update from remote peer dabe360bbf6a4beaae517c7b84267c38: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:16:01.833021 28068 consensus_queue.cc:1048] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c565ce064e6347999f31e94e51b3eb3b" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 36111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:16:01.843439 27768 raft_consensus.cc:1275] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [term 3 FOLLOWER]: Refusing update from remote peer dabe360bbf6a4beaae517c7b84267c38: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:16:01.844952 28071 consensus_queue.cc:1048] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbb608d94d274640813c2860cf06d12b" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:16:02.887023 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:02.895104 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:02.895576 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20260203 09:16:03.868703 27863 debug-util.cc:398] Leaking SignalData structure 0x7b08001f79e0 after lost signal to thread 27556
W20260203 09:16:03.869413 27863 debug-util.cc:398] Leaking SignalData structure 0x7b080014e940 after lost signal to thread 27620
W20260203 09:16:03.870085 27863 debug-util.cc:398] Leaking SignalData structure 0x7b080002f460 after lost signal to thread 27715
W20260203 09:16:03.870682 27863 debug-util.cc:398] Leaking SignalData structure 0x7b08001f8180 after lost signal to thread 27792
W20260203 09:16:03.871294 27863 debug-util.cc:398] Leaking SignalData structure 0x7b08001e6de0 after lost signal to thread 27866
I20260203 09:16:03.896750 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:03.901551 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:03.901930 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:04.902782 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:04.908102 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:04.908524 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:05.909571 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:05.914377 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:05.914811 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:06.915824 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:06.922685 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:06.923154 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:07.924221 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:07.928948 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:07.929363 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:08.930420 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:08.935256 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:08.935707 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:09.936699 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:09.942078 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:09.942482 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:10.972479 27553 auto_leader_rebalancer-test.cc:318] The leader distribution is
I20260203 09:16:10.973098 27553 tablet_server.cc:178] TabletServer@127.26.232.65:0 shutting down...
W20260203 09:16:10.993343 27731 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:16:10.998193 27731 consensus_peers.cc:597] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b -> Peer dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877): Couldn't send request to peer dabe360bbf6a4beaae517c7b84267c38. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:16:11.002760 27553 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260203 09:16:11.002780 27807 consensus_peers.cc:597] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b -> Peer dabe360bbf6a4beaae517c7b84267c38 (127.26.232.65:39877): Couldn't send request to peer dabe360bbf6a4beaae517c7b84267c38. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:16:11.003789 27553 tablet_replica.cc:333] T 4989b3f204bb43ada40440b6894de910 P dabe360bbf6a4beaae517c7b84267c38: stopping tablet replica
I20260203 09:16:11.004747 27553 raft_consensus.cc:2243] T 4989b3f204bb43ada40440b6894de910 P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:11.005369 27553 raft_consensus.cc:2272] T 4989b3f204bb43ada40440b6894de910 P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.007704 27553 tablet_replica.cc:333] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38: stopping tablet replica
I20260203 09:16:11.008224 27553 raft_consensus.cc:2243] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:11.008613 27553 raft_consensus.cc:2272] T ce1a18a70d52493abcb4675c3a6e1b1f P dabe360bbf6a4beaae517c7b84267c38 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.010515 27553 tablet_replica.cc:333] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38: stopping tablet replica
I20260203 09:16:11.010998 27553 raft_consensus.cc:2243] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38 [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:16:11.011802 27553 raft_consensus.cc:2272] T d3fac0b874aa4090bd3c394c817e14ec P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.013383 27553 tablet_replica.cc:333] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38: stopping tablet replica
I20260203 09:16:11.013854 27553 raft_consensus.cc:2243] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:11.014269 27553 raft_consensus.cc:2272] T a88ea51ed509432fae935d15fcd8a913 P dabe360bbf6a4beaae517c7b84267c38 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.016379 27553 tablet_replica.cc:333] T ed0fc738bbc64c31a0b86c6b1f807f7e P dabe360bbf6a4beaae517c7b84267c38: stopping tablet replica
I20260203 09:16:11.016932 27553 raft_consensus.cc:2243] T ed0fc738bbc64c31a0b86c6b1f807f7e P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:11.017364 27553 raft_consensus.cc:2272] T ed0fc738bbc64c31a0b86c6b1f807f7e P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.019130 27553 tablet_replica.cc:333] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38: stopping tablet replica
I20260203 09:16:11.019587 27553 raft_consensus.cc:2243] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:11.019945 27553 raft_consensus.cc:2272] T 60680bc581a44de4bb9b29c65e4d0f01 P dabe360bbf6a4beaae517c7b84267c38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.021733 27553 tablet_replica.cc:333] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38: stopping tablet replica
I20260203 09:16:11.022230 27553 raft_consensus.cc:2243] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:16:11.022989 27553 raft_consensus.cc:2272] T 05e6e3dcf873416a9cb57fccfcd6f002 P dabe360bbf6a4beaae517c7b84267c38 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.024564 27553 tablet_replica.cc:333] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38: stopping tablet replica
I20260203 09:16:11.025094 27553 raft_consensus.cc:2243] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [term 5 LEADER]: Raft consensus shutting down.
I20260203 09:16:11.025846 27553 raft_consensus.cc:2272] T daa6f7f8fc244b1aa48b751d437dcc77 P dabe360bbf6a4beaae517c7b84267c38 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.027421 27553 tablet_replica.cc:333] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38: stopping tablet replica
I20260203 09:16:11.027837 27553 raft_consensus.cc:2243] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:11.028254 27553 raft_consensus.cc:2272] T 074d2018d1254198abb02cd9463e64f9 P dabe360bbf6a4beaae517c7b84267c38 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.115150 27553 tablet_server.cc:195] TabletServer@127.26.232.65:0 shutdown complete.
I20260203 09:16:11.135015 27553 tablet_server.cc:178] TabletServer@127.26.232.66:0 shutting down...
I20260203 09:16:11.160571 27553 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260203 09:16:11.161358 27553 tablet_replica.cc:333] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b: stopping tablet replica
I20260203 09:16:11.162050 27553 raft_consensus.cc:2243] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:11.162539 27553 raft_consensus.cc:2272] T ce1a18a70d52493abcb4675c3a6e1b1f P fbb608d94d274640813c2860cf06d12b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.164301 27553 tablet_replica.cc:333] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b: stopping tablet replica
I20260203 09:16:11.164872 27553 raft_consensus.cc:2243] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:11.165287 27553 raft_consensus.cc:2272] T d3fac0b874aa4090bd3c394c817e14ec P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.166977 27553 tablet_replica.cc:333] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b: stopping tablet replica
I20260203 09:16:11.167495 27553 raft_consensus.cc:2243] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:16:11.168526 27553 raft_consensus.cc:2272] T a88ea51ed509432fae935d15fcd8a913 P fbb608d94d274640813c2860cf06d12b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.170670 27553 tablet_replica.cc:333] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b: stopping tablet replica
I20260203 09:16:11.171109 27553 raft_consensus.cc:2243] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:11.171511 27553 raft_consensus.cc:2272] T 60680bc581a44de4bb9b29c65e4d0f01 P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.173033 27553 tablet_replica.cc:333] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b: stopping tablet replica
I20260203 09:16:11.173478 27553 raft_consensus.cc:2243] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:11.173843 27553 raft_consensus.cc:2272] T ed0fc738bbc64c31a0b86c6b1f807f7e P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.175590 27553 tablet_replica.cc:333] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b: stopping tablet replica
I20260203 09:16:11.176056 27553 raft_consensus.cc:2243] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:16:11.176863 27553 raft_consensus.cc:2272] T 4989b3f204bb43ada40440b6894de910 P fbb608d94d274640813c2860cf06d12b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.178445 27553 tablet_replica.cc:333] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b: stopping tablet replica
I20260203 09:16:11.178931 27553 raft_consensus.cc:2243] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:11.179306 27553 raft_consensus.cc:2272] T daa6f7f8fc244b1aa48b751d437dcc77 P fbb608d94d274640813c2860cf06d12b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.180964 27553 tablet_replica.cc:333] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b: stopping tablet replica
I20260203 09:16:11.181392 27553 raft_consensus.cc:2243] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:16:11.182088 27553 raft_consensus.cc:2272] T 074d2018d1254198abb02cd9463e64f9 P fbb608d94d274640813c2860cf06d12b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.183679 27553 tablet_replica.cc:333] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b: stopping tablet replica
I20260203 09:16:11.184067 27553 raft_consensus.cc:2243] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:11.184401 27553 raft_consensus.cc:2272] T 05e6e3dcf873416a9cb57fccfcd6f002 P fbb608d94d274640813c2860cf06d12b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.229519 27553 tablet_server.cc:195] TabletServer@127.26.232.66:0 shutdown complete.
I20260203 09:16:11.246795 27553 tablet_server.cc:178] TabletServer@127.26.232.67:0 shutting down...
W20260203 09:16:11.267306 27805 consensus_peers.cc:597] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b -> Peer fbb608d94d274640813c2860cf06d12b (127.26.232.66:36849): Couldn't send request to peer fbb608d94d274640813c2860cf06d12b. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.66:36849: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:16:11.277631 27553 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260203 09:16:11.278312 27553 tablet_replica.cc:333] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b: stopping tablet replica
I20260203 09:16:11.278900 27553 raft_consensus.cc:2243] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:11.279351 27553 raft_consensus.cc:2272] T 4989b3f204bb43ada40440b6894de910 P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.281150 27553 tablet_replica.cc:333] T d3fac0b874aa4090bd3c394c817e14ec P c565ce064e6347999f31e94e51b3eb3b: stopping tablet replica
I20260203 09:16:11.281611 27553 raft_consensus.cc:2243] T d3fac0b874aa4090bd3c394c817e14ec P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:11.281972 27553 raft_consensus.cc:2272] T d3fac0b874aa4090bd3c394c817e14ec P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.283632 27553 tablet_replica.cc:333] T 05e6e3dcf873416a9cb57fccfcd6f002 P c565ce064e6347999f31e94e51b3eb3b: stopping tablet replica
I20260203 09:16:11.284057 27553 raft_consensus.cc:2243] T 05e6e3dcf873416a9cb57fccfcd6f002 P c565ce064e6347999f31e94e51b3eb3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:11.284446 27553 raft_consensus.cc:2272] T 05e6e3dcf873416a9cb57fccfcd6f002 P c565ce064e6347999f31e94e51b3eb3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.286049 27553 tablet_replica.cc:333] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b: stopping tablet replica
I20260203 09:16:11.286520 27553 raft_consensus.cc:2243] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:11.286919 27553 raft_consensus.cc:2272] T 074d2018d1254198abb02cd9463e64f9 P c565ce064e6347999f31e94e51b3eb3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.288708 27553 tablet_replica.cc:333] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b: stopping tablet replica
I20260203 09:16:11.289187 27553 raft_consensus.cc:2243] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:11.289629 27553 raft_consensus.cc:2272] T daa6f7f8fc244b1aa48b751d437dcc77 P c565ce064e6347999f31e94e51b3eb3b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.291289 27553 tablet_replica.cc:333] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b: stopping tablet replica
I20260203 09:16:11.291752 27553 raft_consensus.cc:2243] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:16:11.292409 27553 raft_consensus.cc:2272] T ce1a18a70d52493abcb4675c3a6e1b1f P c565ce064e6347999f31e94e51b3eb3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.294541 27553 tablet_replica.cc:333] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b: stopping tablet replica
I20260203 09:16:11.295090 27553 raft_consensus.cc:2243] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:16:11.295899 27553 raft_consensus.cc:2272] T 60680bc581a44de4bb9b29c65e4d0f01 P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.297583 27553 tablet_replica.cc:333] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b: stopping tablet replica
I20260203 09:16:11.298045 27553 raft_consensus.cc:2243] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:16:11.298848 27553 raft_consensus.cc:2272] T ed0fc738bbc64c31a0b86c6b1f807f7e P c565ce064e6347999f31e94e51b3eb3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.300585 27553 tablet_replica.cc:333] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b: stopping tablet replica
I20260203 09:16:11.301196 27553 raft_consensus.cc:2243] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:11.301612 27553 raft_consensus.cc:2272] T a88ea51ed509432fae935d15fcd8a913 P c565ce064e6347999f31e94e51b3eb3b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.350462 27553 tablet_server.cc:195] TabletServer@127.26.232.67:0 shutdown complete.
I20260203 09:16:11.368786 27553 master.cc:561] Master@127.26.232.126:43725 shutting down...
I20260203 09:16:11.515769 27553 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7 [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:16:11.516309 27553 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:11.516592 27553 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9728bccd8d994fea853e20d61f5e26e7: stopping tablet replica
I20260203 09:16:11.535529 27553 master.cc:583] Master@127.26.232.126:43725 shutdown complete.
c565ce064e6347999f31e94e51b3eb3b 1
dabe360bbf6a4beaae517c7b84267c38 4
fbb608d94d274640813c2860cf06d12b 4
c565ce064e6347999f31e94e51b3eb3b 3
dabe360bbf6a4beaae517c7b84267c38 3
fbb608d94d274640813c2860cf06d12b 3
c565ce064e6347999f31e94e51b3eb3b 1
dabe360bbf6a4beaae517c7b84267c38 0
fbb608d94d274640813c2860cf06d12b 8
c565ce064e6347999f31e94e51b3eb3b 3
dabe360bbf6a4beaae517c7b84267c38 3
fbb608d94d274640813c2860cf06d12b 3
[ OK ] LeaderRebalancerTest.FunctionalTestForDivided (31378 ms)
[ RUN ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260203 09:16:11.576555 27553 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.26.232.126:40205
I20260203 09:16:11.577781 27553 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 09:16:11.583207 28097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:16:11.583886 28098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:16:11.584513 28100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:16:11.585502 27553 server_base.cc:1060] running on GCE node
I20260203 09:16:11.586503 27553 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260203 09:16:11.586697 27553 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260203 09:16:11.586848 27553 hybrid_clock.cc:648] HybridClock initialized: now 1770110171586830 us; error 0 us; skew 500 ppm
I20260203 09:16:11.587436 27553 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260203 09:16:11.589936 27553 webserver.cc:492] Webserver started at http://127.26.232.126:44687/ using document root <none> and password file <none>
I20260203 09:16:11.590405 27553 fs_manager.cc:362] Metadata directory not provided
I20260203 09:16:11.590593 27553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 09:16:11.590830 27553 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 09:16:11.591935 27553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770110140020880-27553-0/minicluster-data/master-0-root/instance:
uuid: "957fa947a0e64391972969c3559e0d83"
format_stamp: "Formatted at 2026-02-03 09:16:11 on dist-test-slave-x12j"
I20260203 09:16:11.596521 27553 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260203 09:16:11.599721 28105 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 09:16:11.600487 27553 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260203 09:16:11.600764 27553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770110140020880-27553-0/minicluster-data/master-0-root
uuid: "957fa947a0e64391972969c3559e0d83"
format_stamp: "Formatted at 2026-02-03 09:16:11 on dist-test-slave-x12j"
I20260203 09:16:11.601001 27553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770110140020880-27553-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770110140020880-27553-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770110140020880-27553-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 09:16:11.630712 27553 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 09:16:11.631867 27553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 09:16:11.678581 27553 rpc_server.cc:307] RPC server started. Bound to: 127.26.232.126:40205
I20260203 09:16:11.678690 28156 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.232.126:40205 every 8 connection(s)
I20260203 09:16:11.682294 28157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:11.693001 28157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83: Bootstrap starting.
I20260203 09:16:11.697846 28157 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:11.702284 28157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83: No bootstrap required, opened a new log
I20260203 09:16:11.704411 28157 raft_consensus.cc:359] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "957fa947a0e64391972969c3559e0d83" member_type: VOTER }
I20260203 09:16:11.704852 28157 raft_consensus.cc:385] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:11.705080 28157 raft_consensus.cc:740] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 957fa947a0e64391972969c3559e0d83, State: Initialized, Role: FOLLOWER
I20260203 09:16:11.705616 28157 consensus_queue.cc:260] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "957fa947a0e64391972969c3559e0d83" member_type: VOTER }
I20260203 09:16:11.706032 28157 raft_consensus.cc:399] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260203 09:16:11.706259 28157 raft_consensus.cc:493] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260203 09:16:11.706533 28157 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:11.710436 28157 raft_consensus.cc:515] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "957fa947a0e64391972969c3559e0d83" member_type: VOTER }
I20260203 09:16:11.710947 28157 leader_election.cc:304] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 957fa947a0e64391972969c3559e0d83; no voters:
I20260203 09:16:11.712026 28157 leader_election.cc:290] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260203 09:16:11.712409 28160 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:11.713671 28160 raft_consensus.cc:697] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83 [term 1 LEADER]: Becoming Leader. State: Replica: 957fa947a0e64391972969c3559e0d83, State: Running, Role: LEADER
I20260203 09:16:11.714349 28160 consensus_queue.cc:237] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "957fa947a0e64391972969c3559e0d83" member_type: VOTER }
I20260203 09:16:11.714812 28157 sys_catalog.cc:565] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83 [sys.catalog]: configured and running, proceeding with master startup.
I20260203 09:16:11.719540 28162 sys_catalog.cc:455] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 957fa947a0e64391972969c3559e0d83. Latest consensus state: current_term: 1 leader_uuid: "957fa947a0e64391972969c3559e0d83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "957fa947a0e64391972969c3559e0d83" member_type: VOTER } }
I20260203 09:16:11.719728 28161 sys_catalog.cc:455] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "957fa947a0e64391972969c3559e0d83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "957fa947a0e64391972969c3559e0d83" member_type: VOTER } }
I20260203 09:16:11.720150 28162 sys_catalog.cc:458] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83 [sys.catalog]: This master's current role is: LEADER
I20260203 09:16:11.720317 28161 sys_catalog.cc:458] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83 [sys.catalog]: This master's current role is: LEADER
I20260203 09:16:11.722891 28168 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260203 09:16:11.727897 28168 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260203 09:16:11.730270 27553 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260203 09:16:11.736176 28168 catalog_manager.cc:1357] Generated new cluster ID: 528ba44e22d44a4cac2e813aaf083adc
I20260203 09:16:11.736402 28168 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260203 09:16:11.766860 28168 catalog_manager.cc:1380] Generated new certificate authority record
I20260203 09:16:11.768074 28168 catalog_manager.cc:1514] Loading token signing keys...
I20260203 09:16:11.784950 28168 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83: Generated new TSK 0
I20260203 09:16:11.785528 28168 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260203 09:16:11.797758 27553 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 09:16:11.804185 28179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:16:11.805162 28180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:16:11.806865 28182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:16:11.809306 27553 server_base.cc:1060] running on GCE node
I20260203 09:16:11.810458 27553 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260203 09:16:11.810669 27553 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260203 09:16:11.810825 27553 hybrid_clock.cc:648] HybridClock initialized: now 1770110171810806 us; error 0 us; skew 500 ppm
I20260203 09:16:11.811538 27553 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260203 09:16:11.813922 27553 webserver.cc:492] Webserver started at http://127.26.232.65:37323/ using document root <none> and password file <none>
I20260203 09:16:11.814538 27553 fs_manager.cc:362] Metadata directory not provided
I20260203 09:16:11.814730 27553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 09:16:11.815002 27553 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 09:16:11.816227 27553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770110140020880-27553-0/minicluster-data/ts-0-root/instance:
uuid: "4961439bc01640ccb052971bca67aa50"
format_stamp: "Formatted at 2026-02-03 09:16:11 on dist-test-slave-x12j"
I20260203 09:16:11.821138 27553 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260203 09:16:11.824630 28187 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 09:16:11.825532 27553 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260203 09:16:11.825806 27553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770110140020880-27553-0/minicluster-data/ts-0-root
uuid: "4961439bc01640ccb052971bca67aa50"
format_stamp: "Formatted at 2026-02-03 09:16:11 on dist-test-slave-x12j"
I20260203 09:16:11.826079 27553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770110140020880-27553-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770110140020880-27553-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770110140020880-27553-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 09:16:11.843859 27553 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 09:16:11.845304 27553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 09:16:11.847000 27553 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260203 09:16:11.849619 27553 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260203 09:16:11.849825 27553 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260203 09:16:11.850071 27553 ts_tablet_manager.cc:616] Registered 0 tablets
I20260203 09:16:11.850227 27553 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260203 09:16:11.895356 27553 rpc_server.cc:307] RPC server started. Bound to: 127.26.232.65:32937
I20260203 09:16:11.895454 28250 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.232.65:32937 every 8 connection(s)
I20260203 09:16:11.900251 27553 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 09:16:11.907529 28255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:16:11.909940 28256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:16:11.911336 28258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:16:11.912667 27553 server_base.cc:1060] running on GCE node
I20260203 09:16:11.914052 27553 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260203 09:16:11.914261 27553 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260203 09:16:11.914436 27553 hybrid_clock.cc:648] HybridClock initialized: now 1770110171914418 us; error 0 us; skew 500 ppm
I20260203 09:16:11.914793 28251 heartbeater.cc:344] Connected to a master server at 127.26.232.126:40205
I20260203 09:16:11.915021 27553 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260203 09:16:11.915140 28251 heartbeater.cc:461] Registering TS with master...
I20260203 09:16:11.915933 28251 heartbeater.cc:507] Master 127.26.232.126:40205 requested a full tablet report, sending...
I20260203 09:16:11.917800 27553 webserver.cc:492] Webserver started at http://127.26.232.66:36161/ using document root <none> and password file <none>
I20260203 09:16:11.918045 28122 ts_manager.cc:194] Registered new tserver with Master: 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937)
I20260203 09:16:11.918319 27553 fs_manager.cc:362] Metadata directory not provided
I20260203 09:16:11.918540 27553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 09:16:11.918787 27553 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 09:16:11.919849 27553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770110140020880-27553-0/minicluster-data/ts-1-root/instance:
uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
format_stamp: "Formatted at 2026-02-03 09:16:11 on dist-test-slave-x12j"
I20260203 09:16:11.919824 28122 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54932
I20260203 09:16:11.924585 27553 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260203 09:16:11.928117 28263 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 09:16:11.929041 27553 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260203 09:16:11.929355 27553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770110140020880-27553-0/minicluster-data/ts-1-root
uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
format_stamp: "Formatted at 2026-02-03 09:16:11 on dist-test-slave-x12j"
I20260203 09:16:11.929634 27553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770110140020880-27553-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770110140020880-27553-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770110140020880-27553-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 09:16:11.942414 27553 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 09:16:11.943703 27553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 09:16:11.945297 27553 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260203 09:16:11.947640 27553 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260203 09:16:11.947851 27553 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260203 09:16:11.948091 27553 ts_tablet_manager.cc:616] Registered 0 tablets
I20260203 09:16:11.948251 27553 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260203 09:16:11.993075 27553 rpc_server.cc:307] RPC server started. Bound to: 127.26.232.66:36787
I20260203 09:16:11.993191 28326 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.232.66:36787 every 8 connection(s)
I20260203 09:16:11.997869 27553 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 09:16:12.006619 28331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:16:12.006780 28332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:16:12.009382 27553 server_base.cc:1060] running on GCE node
I20260203 09:16:12.009920 28327 heartbeater.cc:344] Connected to a master server at 127.26.232.126:40205
W20260203 09:16:12.010195 28334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:16:12.010274 28327 heartbeater.cc:461] Registering TS with master...
I20260203 09:16:12.011091 28327 heartbeater.cc:507] Master 127.26.232.126:40205 requested a full tablet report, sending...
I20260203 09:16:12.011092 27553 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260203 09:16:12.011519 27553 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260203 09:16:12.011669 27553 hybrid_clock.cc:648] HybridClock initialized: now 1770110172011655 us; error 0 us; skew 500 ppm
I20260203 09:16:12.012319 27553 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260203 09:16:12.013334 28122 ts_manager.cc:194] Registered new tserver with Master: c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787)
I20260203 09:16:12.014912 27553 webserver.cc:492] Webserver started at http://127.26.232.67:46705/ using document root <none> and password file <none>
I20260203 09:16:12.014905 28122 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54936
I20260203 09:16:12.015501 27553 fs_manager.cc:362] Metadata directory not provided
I20260203 09:16:12.015686 27553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 09:16:12.015995 27553 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 09:16:12.017329 27553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770110140020880-27553-0/minicluster-data/ts-2-root/instance:
uuid: "19934d0e5f7d41a198ef452237e6a238"
format_stamp: "Formatted at 2026-02-03 09:16:12 on dist-test-slave-x12j"
I20260203 09:16:12.022153 27553 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260203 09:16:12.026194 28339 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 09:16:12.027065 27553 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.004s sys 0.000s
I20260203 09:16:12.027383 27553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770110140020880-27553-0/minicluster-data/ts-2-root
uuid: "19934d0e5f7d41a198ef452237e6a238"
format_stamp: "Formatted at 2026-02-03 09:16:12 on dist-test-slave-x12j"
I20260203 09:16:12.027680 27553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770110140020880-27553-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770110140020880-27553-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1770110140020880-27553-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 09:16:12.042735 27553 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 09:16:12.044086 27553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 09:16:12.045778 27553 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260203 09:16:12.048218 27553 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260203 09:16:12.048437 27553 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260203 09:16:12.048733 27553 ts_tablet_manager.cc:616] Registered 0 tablets
I20260203 09:16:12.048895 27553 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260203 09:16:12.090736 27553 rpc_server.cc:307] RPC server started. Bound to: 127.26.232.67:37755
I20260203 09:16:12.090852 28401 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.232.67:37755 every 8 connection(s)
I20260203 09:16:12.104591 28402 heartbeater.cc:344] Connected to a master server at 127.26.232.126:40205
I20260203 09:16:12.105008 28402 heartbeater.cc:461] Registering TS with master...
I20260203 09:16:12.105736 28402 heartbeater.cc:507] Master 127.26.232.126:40205 requested a full tablet report, sending...
I20260203 09:16:12.107651 28122 ts_manager.cc:194] Registered new tserver with Master: 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:12.108397 27553 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01472096s
I20260203 09:16:12.109237 28122 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54946
I20260203 09:16:12.134374 28122 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54954:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260203 09:16:12.137216 28122 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260203 09:16:12.205862 28214 tablet_service.cc:1505] Processing CreateTablet for tablet cb7d38bef7ee47c1ade9124f4362d083 (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260203 09:16:12.207331 28214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7d38bef7ee47c1ade9124f4362d083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.210081 28215 tablet_service.cc:1505] Processing CreateTablet for tablet feb960bd17de4e2bb654b6a5a87c4d43 (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260203 09:16:12.211434 28215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feb960bd17de4e2bb654b6a5a87c4d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.212857 28367 tablet_service.cc:1505] Processing CreateTablet for tablet feb960bd17de4e2bb654b6a5a87c4d43 (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260203 09:16:12.213444 28365 tablet_service.cc:1505] Processing CreateTablet for tablet cd88a45cfab242e58705e11b11875298 (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260203 09:16:12.213683 28366 tablet_service.cc:1505] Processing CreateTablet for tablet cb7d38bef7ee47c1ade9124f4362d083 (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260203 09:16:12.214257 28367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feb960bd17de4e2bb654b6a5a87c4d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.214825 28365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd88a45cfab242e58705e11b11875298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.216133 28366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7d38bef7ee47c1ade9124f4362d083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.217902 28213 tablet_service.cc:1505] Processing CreateTablet for tablet cd88a45cfab242e58705e11b11875298 (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260203 09:16:12.219247 28213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd88a45cfab242e58705e11b11875298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.228922 28212 tablet_service.cc:1505] Processing CreateTablet for tablet 43f348635db64f2dafea2f7ce2f538a5 (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260203 09:16:12.230396 28212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f348635db64f2dafea2f7ce2f538a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.243530 28364 tablet_service.cc:1505] Processing CreateTablet for tablet 43f348635db64f2dafea2f7ce2f538a5 (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260203 09:16:12.245062 28364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f348635db64f2dafea2f7ce2f538a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.250685 28417 tablet_bootstrap.cc:492] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50: Bootstrap starting.
I20260203 09:16:12.251668 28418 tablet_bootstrap.cc:492] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238: Bootstrap starting.
I20260203 09:16:12.257736 28417 tablet_bootstrap.cc:654] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.258062 28418 tablet_bootstrap.cc:654] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.263988 28214 tablet_service.cc:1505] Processing CreateTablet for tablet 2d01575aefc8413993898b91f0ee2881 (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260203 09:16:12.265496 28214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d01575aefc8413993898b91f0ee2881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.273509 28366 tablet_service.cc:1505] Processing CreateTablet for tablet 2d01575aefc8413993898b91f0ee2881 (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260203 09:16:12.274073 28418 tablet_bootstrap.cc:492] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238: No bootstrap required, opened a new log
I20260203 09:16:12.274588 28418 ts_tablet_manager.cc:1403] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238: Time spent bootstrapping tablet: real 0.023s user 0.010s sys 0.008s
I20260203 09:16:12.274829 28366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d01575aefc8413993898b91f0ee2881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.277308 28417 tablet_bootstrap.cc:492] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50: No bootstrap required, opened a new log
I20260203 09:16:12.277933 28417 ts_tablet_manager.cc:1403] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50: Time spent bootstrapping tablet: real 0.028s user 0.010s sys 0.008s
I20260203 09:16:12.277557 28418 raft_consensus.cc:359] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.278913 28418 raft_consensus.cc:385] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.279218 28418 raft_consensus.cc:740] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.281488 28418 consensus_queue.cc:260] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.283952 28402 heartbeater.cc:499] Master 127.26.232.126:40205 was elected leader, sending a full tablet report...
I20260203 09:16:12.286092 28418 ts_tablet_manager.cc:1434] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260203 09:16:12.287118 28418 tablet_bootstrap.cc:492] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238: Bootstrap starting.
I20260203 09:16:12.287283 28417 raft_consensus.cc:359] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.288165 28417 raft_consensus.cc:385] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.288981 28417 raft_consensus.cc:740] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.289853 28417 consensus_queue.cc:260] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.293951 28418 tablet_bootstrap.cc:654] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.298520 28251 heartbeater.cc:499] Master 127.26.232.126:40205 was elected leader, sending a full tablet report...
I20260203 09:16:12.302102 28417 ts_tablet_manager.cc:1434] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50: Time spent starting tablet: real 0.024s user 0.007s sys 0.005s
I20260203 09:16:12.303278 28417 tablet_bootstrap.cc:492] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50: Bootstrap starting.
I20260203 09:16:12.304585 28214 tablet_service.cc:1505] Processing CreateTablet for tablet 749653feb73c4b79a3d9adf185404a54 (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260203 09:16:12.305886 28214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 749653feb73c4b79a3d9adf185404a54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.306015 28418 tablet_bootstrap.cc:492] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238: No bootstrap required, opened a new log
I20260203 09:16:12.306551 28418 ts_tablet_manager.cc:1403] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238: Time spent bootstrapping tablet: real 0.020s user 0.013s sys 0.004s
I20260203 09:16:12.309702 28418 raft_consensus.cc:359] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } }
I20260203 09:16:12.310505 28418 raft_consensus.cc:385] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.310838 28418 raft_consensus.cc:740] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.311693 28418 consensus_queue.cc:260] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } }
I20260203 09:16:12.313864 28418 ts_tablet_manager.cc:1434] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260203 09:16:12.315045 28418 tablet_bootstrap.cc:492] T 43f348635db64f2dafea2f7ce2f538a5 P 19934d0e5f7d41a198ef452237e6a238: Bootstrap starting.
I20260203 09:16:12.317942 28215 tablet_service.cc:1505] Processing CreateTablet for tablet bef87f4cbe204179ae62b2c0fcf03c52 (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260203 09:16:12.319046 28417 tablet_bootstrap.cc:654] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.319231 28215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bef87f4cbe204179ae62b2c0fcf03c52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.321851 28418 tablet_bootstrap.cc:654] T 43f348635db64f2dafea2f7ce2f538a5 P 19934d0e5f7d41a198ef452237e6a238: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.317252 28365 tablet_service.cc:1505] Processing CreateTablet for tablet 749653feb73c4b79a3d9adf185404a54 (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260203 09:16:12.324493 28291 tablet_service.cc:1505] Processing CreateTablet for tablet feb960bd17de4e2bb654b6a5a87c4d43 (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260203 09:16:12.325910 28291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet feb960bd17de4e2bb654b6a5a87c4d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.326098 28290 tablet_service.cc:1505] Processing CreateTablet for tablet cb7d38bef7ee47c1ade9124f4362d083 (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260203 09:16:12.327351 28290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7d38bef7ee47c1ade9124f4362d083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.329980 28289 tablet_service.cc:1505] Processing CreateTablet for tablet cd88a45cfab242e58705e11b11875298 (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260203 09:16:12.331511 28289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd88a45cfab242e58705e11b11875298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.333876 28288 tablet_service.cc:1505] Processing CreateTablet for tablet 43f348635db64f2dafea2f7ce2f538a5 (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260203 09:16:12.335317 28288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f348635db64f2dafea2f7ce2f538a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.335261 28213 tablet_service.cc:1505] Processing CreateTablet for tablet 7475c49386954b638b459eed5689e758 (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260203 09:16:12.337828 28287 tablet_service.cc:1505] Processing CreateTablet for tablet 2d01575aefc8413993898b91f0ee2881 (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260203 09:16:12.339128 28287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d01575aefc8413993898b91f0ee2881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.341279 28366 tablet_service.cc:1505] Processing CreateTablet for tablet 7475c49386954b638b459eed5689e758 (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260203 09:16:12.342239 28417 tablet_bootstrap.cc:492] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50: No bootstrap required, opened a new log
I20260203 09:16:12.341954 28215 tablet_service.cc:1505] Processing CreateTablet for tablet 67eea80e9038484c98bbc3837d24448f (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260203 09:16:12.342728 28417 ts_tablet_manager.cc:1403] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50: Time spent bootstrapping tablet: real 0.040s user 0.005s sys 0.010s
I20260203 09:16:12.342598 28286 tablet_service.cc:1505] Processing CreateTablet for tablet 749653feb73c4b79a3d9adf185404a54 (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260203 09:16:12.343930 28286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 749653feb73c4b79a3d9adf185404a54. 1 dirs total, 0 dirs full, 0 dirs failed
W20260203 09:16:12.344391 28403 tablet.cc:2378] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260203 09:16:12.346755 28285 tablet_service.cc:1505] Processing CreateTablet for tablet bef87f4cbe204179ae62b2c0fcf03c52 (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260203 09:16:12.342635 28366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7475c49386954b638b459eed5689e758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.347296 28417 raft_consensus.cc:359] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } }
I20260203 09:16:12.348018 28417 raft_consensus.cc:385] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.348338 28417 raft_consensus.cc:740] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.348616 28284 tablet_service.cc:1505] Processing CreateTablet for tablet 7475c49386954b638b459eed5689e758 (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260203 09:16:12.349242 28417 consensus_queue.cc:260] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } }
I20260203 09:16:12.349931 28284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7475c49386954b638b459eed5689e758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.341266 28213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7475c49386954b638b459eed5689e758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.353386 28285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bef87f4cbe204179ae62b2c0fcf03c52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.353674 28417 ts_tablet_manager.cc:1434] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50: Time spent starting tablet: real 0.011s user 0.006s sys 0.001s
I20260203 09:16:12.354691 28417 tablet_bootstrap.cc:492] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50: Bootstrap starting.
I20260203 09:16:12.361142 28417 tablet_bootstrap.cc:654] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.333911 28364 tablet_service.cc:1505] Processing CreateTablet for tablet bef87f4cbe204179ae62b2c0fcf03c52 (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260203 09:16:12.366431 28364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bef87f4cbe204179ae62b2c0fcf03c52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.364972 28215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67eea80e9038484c98bbc3837d24448f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.375459 28417 tablet_bootstrap.cc:492] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50: No bootstrap required, opened a new log
I20260203 09:16:12.376082 28417 ts_tablet_manager.cc:1403] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50: Time spent bootstrapping tablet: real 0.022s user 0.012s sys 0.005s
I20260203 09:16:12.378930 28417 raft_consensus.cc:359] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.380236 28283 tablet_service.cc:1505] Processing CreateTablet for tablet 67eea80e9038484c98bbc3837d24448f (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260203 09:16:12.381642 28283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67eea80e9038484c98bbc3837d24448f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.381795 28367 tablet_service.cc:1505] Processing CreateTablet for tablet 67eea80e9038484c98bbc3837d24448f (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260203 09:16:12.383028 28367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67eea80e9038484c98bbc3837d24448f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.391083 28214 tablet_service.cc:1505] Processing CreateTablet for tablet c6875bd2def54a3daaa4149c7ced68ef (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260203 09:16:12.392493 28214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6875bd2def54a3daaa4149c7ced68ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.379967 28417 raft_consensus.cc:385] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.395362 28417 raft_consensus.cc:740] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.396551 28417 consensus_queue.cc:260] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.411093 28417 ts_tablet_manager.cc:1434] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50: Time spent starting tablet: real 0.035s user 0.005s sys 0.000s
I20260203 09:16:12.412329 28417 tablet_bootstrap.cc:492] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50: Bootstrap starting.
I20260203 09:16:12.425738 28365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 749653feb73c4b79a3d9adf185404a54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.431924 28288 tablet_service.cc:1505] Processing CreateTablet for tablet c6875bd2def54a3daaa4149c7ced68ef (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260203 09:16:12.431954 28426 tablet_bootstrap.cc:492] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79: Bootstrap starting.
I20260203 09:16:12.443956 28288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6875bd2def54a3daaa4149c7ced68ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.444257 28417 tablet_bootstrap.cc:654] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.445690 28367 tablet_service.cc:1505] Processing CreateTablet for tablet c6875bd2def54a3daaa4149c7ced68ef (DEFAULT_TABLE table=test-workload [id=1c4dbb6375fa4e95bf7f96fc330e93be]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260203 09:16:12.447034 28367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6875bd2def54a3daaa4149c7ced68ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:12.447744 28418 tablet_bootstrap.cc:492] T 43f348635db64f2dafea2f7ce2f538a5 P 19934d0e5f7d41a198ef452237e6a238: No bootstrap required, opened a new log
I20260203 09:16:12.453286 28418 ts_tablet_manager.cc:1403] T 43f348635db64f2dafea2f7ce2f538a5 P 19934d0e5f7d41a198ef452237e6a238: Time spent bootstrapping tablet: real 0.138s user 0.009s sys 0.006s
I20260203 09:16:12.440501 28426 tablet_bootstrap.cc:654] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.456270 28418 raft_consensus.cc:359] T 43f348635db64f2dafea2f7ce2f538a5 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.457370 28418 raft_consensus.cc:385] T 43f348635db64f2dafea2f7ce2f538a5 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.457765 28418 raft_consensus.cc:740] T 43f348635db64f2dafea2f7ce2f538a5 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.458667 28418 consensus_queue.cc:260] T 43f348635db64f2dafea2f7ce2f538a5 P 19934d0e5f7d41a198ef452237e6a238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.461633 28421 raft_consensus.cc:493] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:12.462162 28421 raft_consensus.cc:515] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.473414 28421 leader_election.cc:290] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787)
I20260203 09:16:12.474828 28421 raft_consensus.cc:493] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:12.476095 28421 raft_consensus.cc:515] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } }
I20260203 09:16:12.478335 28226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb7d38bef7ee47c1ade9124f4362d083" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4961439bc01640ccb052971bca67aa50" is_pre_election: true
I20260203 09:16:12.479218 28226 raft_consensus.cc:2468] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19934d0e5f7d41a198ef452237e6a238 in term 0.
I20260203 09:16:12.481734 28421 leader_election.cc:290] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787)
I20260203 09:16:12.481628 28342 leader_election.cc:304] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50; no voters:
I20260203 09:16:12.482550 28226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "feb960bd17de4e2bb654b6a5a87c4d43" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4961439bc01640ccb052971bca67aa50" is_pre_election: true
I20260203 09:16:12.485466 28421 raft_consensus.cc:493] T 43f348635db64f2dafea2f7ce2f538a5 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:12.485536 28226 raft_consensus.cc:2468] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19934d0e5f7d41a198ef452237e6a238 in term 0.
I20260203 09:16:12.491489 28342 leader_election.cc:304] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50; no voters:
I20260203 09:16:12.486766 28430 raft_consensus.cc:2804] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:12.492415 28429 raft_consensus.cc:2804] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:12.469656 28418 ts_tablet_manager.cc:1434] T 43f348635db64f2dafea2f7ce2f538a5 P 19934d0e5f7d41a198ef452237e6a238: Time spent starting tablet: real 0.016s user 0.006s sys 0.001s
I20260203 09:16:12.492982 28429 raft_consensus.cc:493] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:12.492476 28430 raft_consensus.cc:493] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:12.493424 28429 raft_consensus.cc:3060] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:12.493551 28430 raft_consensus.cc:3060] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:12.493884 28421 raft_consensus.cc:515] T 43f348635db64f2dafea2f7ce2f538a5 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.496803 28226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43f348635db64f2dafea2f7ce2f538a5" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4961439bc01640ccb052971bca67aa50" is_pre_election: true
I20260203 09:16:12.490307 28426 tablet_bootstrap.cc:492] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79: No bootstrap required, opened a new log
W20260203 09:16:12.498255 28342 leader_election.cc:343] T 43f348635db64f2dafea2f7ce2f538a5 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:12.498477 28426 ts_tablet_manager.cc:1403] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79: Time spent bootstrapping tablet: real 0.067s user 0.024s sys 0.004s
I20260203 09:16:12.499291 28301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb7d38bef7ee47c1ade9124f4362d083" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" is_pre_election: true
I20260203 09:16:12.500733 28300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "feb960bd17de4e2bb654b6a5a87c4d43" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" is_pre_election: true
I20260203 09:16:12.501361 28426 raft_consensus.cc:359] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
W20260203 09:16:12.502032 28341 leader_election.cc:343] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:12.502877 28418 tablet_bootstrap.cc:492] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238: Bootstrap starting.
W20260203 09:16:12.503377 28341 leader_election.cc:343] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:12.503906 28300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43f348635db64f2dafea2f7ce2f538a5" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" is_pre_election: true
W20260203 09:16:12.505276 28341 leader_election.cc:343] T 43f348635db64f2dafea2f7ce2f538a5 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:12.504873 28429 raft_consensus.cc:515] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } }
I20260203 09:16:12.505836 28341 leader_election.cc:304] T 43f348635db64f2dafea2f7ce2f538a5 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238; no voters: 4961439bc01640ccb052971bca67aa50, c3abf1e576bb4f2bb5325812e8a63d79
I20260203 09:16:12.507727 28430 raft_consensus.cc:515] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.508010 28226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "feb960bd17de4e2bb654b6a5a87c4d43" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4961439bc01640ccb052971bca67aa50"
I20260203 09:16:12.508708 28226 raft_consensus.cc:3060] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:12.509560 28418 tablet_bootstrap.cc:654] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.511420 28225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb7d38bef7ee47c1ade9124f4362d083" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4961439bc01640ccb052971bca67aa50"
I20260203 09:16:12.512133 28225 raft_consensus.cc:3060] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:12.502727 28421 leader_election.cc:290] T 43f348635db64f2dafea2f7ce2f538a5 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787)
I20260203 09:16:12.514375 28421 raft_consensus.cc:2749] T 43f348635db64f2dafea2f7ce2f538a5 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:12.519807 28226 raft_consensus.cc:2468] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19934d0e5f7d41a198ef452237e6a238 in term 1.
I20260203 09:16:12.520326 28225 raft_consensus.cc:2468] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19934d0e5f7d41a198ef452237e6a238 in term 1.
I20260203 09:16:12.521070 28417 tablet_bootstrap.cc:492] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50: No bootstrap required, opened a new log
I20260203 09:16:12.521111 28342 leader_election.cc:304] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50; no voters:
I20260203 09:16:12.521733 28430 leader_election.cc:290] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 election: Requested vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787)
I20260203 09:16:12.502075 28426 raft_consensus.cc:385] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.522095 28342 leader_election.cc:304] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50; no voters:
I20260203 09:16:12.522336 28426 raft_consensus.cc:740] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3abf1e576bb4f2bb5325812e8a63d79, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.522507 28430 raft_consensus.cc:2804] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:12.523147 28430 raft_consensus.cc:697] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Becoming Leader. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Running, Role: LEADER
I20260203 09:16:12.523347 28426 consensus_queue.cc:260] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.522002 28429 leader_election.cc:290] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 election: Requested vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787)
I20260203 09:16:12.524509 28430 consensus_queue.cc:237] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } }
I20260203 09:16:12.525493 28429 raft_consensus.cc:2804] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:12.526046 28429 raft_consensus.cc:697] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Becoming Leader. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Running, Role: LEADER
I20260203 09:16:12.523370 28417 ts_tablet_manager.cc:1403] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50: Time spent bootstrapping tablet: real 0.111s user 0.018s sys 0.002s
I20260203 09:16:12.529488 28300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb7d38bef7ee47c1ade9124f4362d083" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
I20260203 09:16:12.530087 28327 heartbeater.cc:499] Master 127.26.232.126:40205 was elected leader, sending a full tablet report...
I20260203 09:16:12.530440 28417 raft_consensus.cc:359] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.526861 28429 consensus_queue.cc:237] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.532330 28300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "feb960bd17de4e2bb654b6a5a87c4d43" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
I20260203 09:16:12.529484 28426 ts_tablet_manager.cc:1434] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79: Time spent starting tablet: real 0.031s user 0.007s sys 0.001s
I20260203 09:16:12.531122 28417 raft_consensus.cc:385] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.534317 28417 raft_consensus.cc:740] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.535019 28426 tablet_bootstrap.cc:492] T 43f348635db64f2dafea2f7ce2f538a5 P c3abf1e576bb4f2bb5325812e8a63d79: Bootstrap starting.
I20260203 09:16:12.535152 28417 consensus_queue.cc:260] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.539423 28417 ts_tablet_manager.cc:1434] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260203 09:16:12.540431 28417 tablet_bootstrap.cc:492] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50: Bootstrap starting.
I20260203 09:16:12.542050 28426 tablet_bootstrap.cc:654] T 43f348635db64f2dafea2f7ce2f538a5 P c3abf1e576bb4f2bb5325812e8a63d79: Neither blocks nor log segments found. Creating new log.
W20260203 09:16:12.533797 28341 leader_election.cc:343] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:16:12.547977 28341 leader_election.cc:343] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:12.551083 28418 tablet_bootstrap.cc:492] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238: No bootstrap required, opened a new log
I20260203 09:16:12.551630 28418 ts_tablet_manager.cc:1403] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238: Time spent bootstrapping tablet: real 0.049s user 0.013s sys 0.012s
I20260203 09:16:12.551872 28417 tablet_bootstrap.cc:654] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.558954 28418 raft_consensus.cc:359] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.560142 28418 raft_consensus.cc:385] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.560997 28418 raft_consensus.cc:740] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.563103 28418 consensus_queue.cc:260] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.565635 28426 tablet_bootstrap.cc:492] T 43f348635db64f2dafea2f7ce2f538a5 P c3abf1e576bb4f2bb5325812e8a63d79: No bootstrap required, opened a new log
I20260203 09:16:12.565675 28418 ts_tablet_manager.cc:1434] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238: Time spent starting tablet: real 0.014s user 0.002s sys 0.005s
I20260203 09:16:12.566357 28426 ts_tablet_manager.cc:1403] T 43f348635db64f2dafea2f7ce2f538a5 P c3abf1e576bb4f2bb5325812e8a63d79: Time spent bootstrapping tablet: real 0.032s user 0.015s sys 0.005s
I20260203 09:16:12.567091 28418 tablet_bootstrap.cc:492] T cd88a45cfab242e58705e11b11875298 P 19934d0e5f7d41a198ef452237e6a238: Bootstrap starting.
I20260203 09:16:12.569471 28426 raft_consensus.cc:359] T 43f348635db64f2dafea2f7ce2f538a5 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.570345 28426 raft_consensus.cc:385] T 43f348635db64f2dafea2f7ce2f538a5 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.570680 28426 raft_consensus.cc:740] T 43f348635db64f2dafea2f7ce2f538a5 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3abf1e576bb4f2bb5325812e8a63d79, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.567533 28422 raft_consensus.cc:493] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:12.571635 28426 consensus_queue.cc:260] T 43f348635db64f2dafea2f7ce2f538a5 P c3abf1e576bb4f2bb5325812e8a63d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.572608 28422 raft_consensus.cc:515] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.574656 28426 ts_tablet_manager.cc:1434] T 43f348635db64f2dafea2f7ce2f538a5 P c3abf1e576bb4f2bb5325812e8a63d79: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260203 09:16:12.575836 28426 tablet_bootstrap.cc:492] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79: Bootstrap starting.
I20260203 09:16:12.577842 28418 tablet_bootstrap.cc:654] T cd88a45cfab242e58705e11b11875298 P 19934d0e5f7d41a198ef452237e6a238: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.580948 28422 leader_election.cc:290] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:12.596984 28121 catalog_manager.cc:5654] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67). New cstate: current_term: 1 leader_uuid: "19934d0e5f7d41a198ef452237e6a238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:12.607730 28426 tablet_bootstrap.cc:654] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.619057 28417 tablet_bootstrap.cc:492] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50: No bootstrap required, opened a new log
I20260203 09:16:12.619123 28121 catalog_manager.cc:5654] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67). New cstate: current_term: 1 leader_uuid: "19934d0e5f7d41a198ef452237e6a238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:12.623987 28418 tablet_bootstrap.cc:492] T cd88a45cfab242e58705e11b11875298 P 19934d0e5f7d41a198ef452237e6a238: No bootstrap required, opened a new log
I20260203 09:16:12.624540 28418 ts_tablet_manager.cc:1403] T cd88a45cfab242e58705e11b11875298 P 19934d0e5f7d41a198ef452237e6a238: Time spent bootstrapping tablet: real 0.058s user 0.020s sys 0.013s
I20260203 09:16:12.627810 28377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd88a45cfab242e58705e11b11875298" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19934d0e5f7d41a198ef452237e6a238" is_pre_election: true
I20260203 09:16:12.628048 28418 raft_consensus.cc:359] T cd88a45cfab242e58705e11b11875298 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.628753 28418 raft_consensus.cc:385] T cd88a45cfab242e58705e11b11875298 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.629062 28418 raft_consensus.cc:740] T cd88a45cfab242e58705e11b11875298 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.629768 28418 consensus_queue.cc:260] T cd88a45cfab242e58705e11b11875298 P 19934d0e5f7d41a198ef452237e6a238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.630731 28377 raft_consensus.cc:2468] T cd88a45cfab242e58705e11b11875298 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 0.
I20260203 09:16:12.632568 28418 ts_tablet_manager.cc:1434] T cd88a45cfab242e58705e11b11875298 P 19934d0e5f7d41a198ef452237e6a238: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260203 09:16:12.632634 28417 ts_tablet_manager.cc:1403] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50: Time spent bootstrapping tablet: real 0.092s user 0.003s sys 0.013s
I20260203 09:16:12.633375 28300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd88a45cfab242e58705e11b11875298" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" is_pre_election: true
I20260203 09:16:12.633677 28418 tablet_bootstrap.cc:492] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238: Bootstrap starting.
W20260203 09:16:12.635110 28189 leader_election.cc:343] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:12.635510 28417 raft_consensus.cc:359] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.636091 28417 raft_consensus.cc:385] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.636322 28417 raft_consensus.cc:740] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.637085 28191 leader_election.cc:304] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50; no voters: c3abf1e576bb4f2bb5325812e8a63d79
I20260203 09:16:12.637938 28422 raft_consensus.cc:2804] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:12.638283 28422 raft_consensus.cc:493] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:12.638613 28422 raft_consensus.cc:3060] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:12.640519 28418 tablet_bootstrap.cc:654] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.645090 28422 raft_consensus.cc:515] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.646260 28418 tablet_bootstrap.cc:492] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238: No bootstrap required, opened a new log
I20260203 09:16:12.646965 28418 ts_tablet_manager.cc:1403] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238: Time spent bootstrapping tablet: real 0.013s user 0.011s sys 0.000s
I20260203 09:16:12.647375 28422 leader_election.cc:290] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 election: Requested vote from peers c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:12.647598 28377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd88a45cfab242e58705e11b11875298" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
I20260203 09:16:12.637290 28417 consensus_queue.cc:260] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.648255 28377 raft_consensus.cc:3060] T cd88a45cfab242e58705e11b11875298 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:12.649886 28417 ts_tablet_manager.cc:1434] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20260203 09:16:12.649811 28418 raft_consensus.cc:359] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.650571 28418 raft_consensus.cc:385] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.650849 28418 raft_consensus.cc:740] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.651530 28418 consensus_queue.cc:260] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.653868 28418 ts_tablet_manager.cc:1434] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238: Time spent starting tablet: real 0.007s user 0.005s sys 0.003s
I20260203 09:16:12.654837 28418 tablet_bootstrap.cc:492] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238: Bootstrap starting.
I20260203 09:16:12.655107 28377 raft_consensus.cc:2468] T cd88a45cfab242e58705e11b11875298 P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 1.
I20260203 09:16:12.647533 28300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd88a45cfab242e58705e11b11875298" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
I20260203 09:16:12.656386 28191 leader_election.cc:304] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50; no voters:
W20260203 09:16:12.657383 28189 leader_election.cc:343] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:12.657857 28422 raft_consensus.cc:2804] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:12.661334 28418 tablet_bootstrap.cc:654] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.664750 28430 raft_consensus.cc:493] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:12.665264 28430 raft_consensus.cc:515] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.667308 28430 leader_election.cc:290] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787)
I20260203 09:16:12.669005 28226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d01575aefc8413993898b91f0ee2881" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4961439bc01640ccb052971bca67aa50" is_pre_election: true
I20260203 09:16:12.669670 28226 raft_consensus.cc:2468] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19934d0e5f7d41a198ef452237e6a238 in term 0.
I20260203 09:16:12.671427 28300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d01575aefc8413993898b91f0ee2881" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" is_pre_election: true
I20260203 09:16:12.673223 28342 leader_election.cc:304] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50; no voters:
I20260203 09:16:12.673794 28418 tablet_bootstrap.cc:492] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238: No bootstrap required, opened a new log
W20260203 09:16:12.674299 28341 leader_election.cc:343] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:12.674506 28430 raft_consensus.cc:2804] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:12.675033 28430 raft_consensus.cc:493] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:12.674336 28418 ts_tablet_manager.cc:1403] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238: Time spent bootstrapping tablet: real 0.020s user 0.009s sys 0.008s
I20260203 09:16:12.675576 28430 raft_consensus.cc:3060] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:12.678362 28417 tablet_bootstrap.cc:492] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50: Bootstrap starting.
I20260203 09:16:12.678447 28418 raft_consensus.cc:359] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.679318 28418 raft_consensus.cc:385] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.679653 28418 raft_consensus.cc:740] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.680758 28418 consensus_queue.cc:260] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.683276 28430 raft_consensus.cc:515] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.686268 28226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d01575aefc8413993898b91f0ee2881" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4961439bc01640ccb052971bca67aa50"
I20260203 09:16:12.686904 28226 raft_consensus.cc:3060] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:12.687143 28422 raft_consensus.cc:697] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [term 1 LEADER]: Becoming Leader. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Running, Role: LEADER
I20260203 09:16:12.688045 28422 consensus_queue.cc:237] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.686280 28417 tablet_bootstrap.cc:654] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.690157 28426 tablet_bootstrap.cc:492] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79: No bootstrap required, opened a new log
I20260203 09:16:12.690685 28426 ts_tablet_manager.cc:1403] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79: Time spent bootstrapping tablet: real 0.115s user 0.033s sys 0.021s
I20260203 09:16:12.686865 28418 ts_tablet_manager.cc:1434] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260203 09:16:12.693499 28426 raft_consensus.cc:359] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.694182 28426 raft_consensus.cc:385] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.694528 28426 raft_consensus.cc:740] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3abf1e576bb4f2bb5325812e8a63d79, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.695425 28417 tablet_bootstrap.cc:492] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50: No bootstrap required, opened a new log
I20260203 09:16:12.695361 28426 consensus_queue.cc:260] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.696158 28417 ts_tablet_manager.cc:1403] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50: Time spent bootstrapping tablet: real 0.018s user 0.011s sys 0.000s
I20260203 09:16:12.696914 28418 tablet_bootstrap.cc:492] T bef87f4cbe204179ae62b2c0fcf03c52 P 19934d0e5f7d41a198ef452237e6a238: Bootstrap starting.
I20260203 09:16:12.699640 28417 raft_consensus.cc:359] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.701426 28417 raft_consensus.cc:385] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.701874 28426 ts_tablet_manager.cc:1434] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79: Time spent starting tablet: real 0.011s user 0.004s sys 0.004s
I20260203 09:16:12.700946 28430 leader_election.cc:290] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 election: Requested vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787)
I20260203 09:16:12.701838 28417 raft_consensus.cc:740] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.703002 28426 tablet_bootstrap.cc:492] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79: Bootstrap starting.
I20260203 09:16:12.703368 28417 consensus_queue.cc:260] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.703727 28300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d01575aefc8413993898b91f0ee2881" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
W20260203 09:16:12.705233 28341 leader_election.cc:343] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:12.706606 28417 ts_tablet_manager.cc:1434] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50: Time spent starting tablet: real 0.010s user 0.006s sys 0.001s
I20260203 09:16:12.707716 28417 tablet_bootstrap.cc:492] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50: Bootstrap starting.
I20260203 09:16:12.708041 28226 raft_consensus.cc:2468] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19934d0e5f7d41a198ef452237e6a238 in term 1.
I20260203 09:16:12.709336 28426 tablet_bootstrap.cc:654] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.710938 28342 leader_election.cc:304] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50; no voters: c3abf1e576bb4f2bb5325812e8a63d79
I20260203 09:16:12.711966 28418 tablet_bootstrap.cc:654] T bef87f4cbe204179ae62b2c0fcf03c52 P 19934d0e5f7d41a198ef452237e6a238: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.712210 28430 raft_consensus.cc:2804] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:12.712772 28430 raft_consensus.cc:697] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Becoming Leader. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Running, Role: LEADER
I20260203 09:16:12.713620 28430 consensus_queue.cc:237] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.714422 28417 tablet_bootstrap.cc:654] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.726879 28418 tablet_bootstrap.cc:492] T bef87f4cbe204179ae62b2c0fcf03c52 P 19934d0e5f7d41a198ef452237e6a238: No bootstrap required, opened a new log
I20260203 09:16:12.727414 28418 ts_tablet_manager.cc:1403] T bef87f4cbe204179ae62b2c0fcf03c52 P 19934d0e5f7d41a198ef452237e6a238: Time spent bootstrapping tablet: real 0.031s user 0.014s sys 0.002s
I20260203 09:16:12.727676 28426 tablet_bootstrap.cc:492] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79: No bootstrap required, opened a new log
I20260203 09:16:12.728161 28426 ts_tablet_manager.cc:1403] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79: Time spent bootstrapping tablet: real 0.025s user 0.019s sys 0.003s
I20260203 09:16:12.730609 28418 raft_consensus.cc:359] T bef87f4cbe204179ae62b2c0fcf03c52 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.731540 28418 raft_consensus.cc:385] T bef87f4cbe204179ae62b2c0fcf03c52 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.731845 28418 raft_consensus.cc:740] T bef87f4cbe204179ae62b2c0fcf03c52 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.732837 28418 consensus_queue.cc:260] T bef87f4cbe204179ae62b2c0fcf03c52 P 19934d0e5f7d41a198ef452237e6a238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.734531 28418 ts_tablet_manager.cc:1434] T bef87f4cbe204179ae62b2c0fcf03c52 P 19934d0e5f7d41a198ef452237e6a238: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
W20260203 09:16:12.732568 28170 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:16:12.735314 28418 tablet_bootstrap.cc:492] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238: Bootstrap starting.
I20260203 09:16:12.736577 28121 catalog_manager.cc:5654] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4961439bc01640ccb052971bca67aa50 (127.26.232.65). New cstate: current_term: 1 leader_uuid: "4961439bc01640ccb052971bca67aa50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:12.739390 28418 tablet_bootstrap.cc:654] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.730836 28426 raft_consensus.cc:359] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.742703 28426 raft_consensus.cc:385] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.743018 28426 raft_consensus.cc:740] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3abf1e576bb4f2bb5325812e8a63d79, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.743805 28426 consensus_queue.cc:260] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.744274 28417 tablet_bootstrap.cc:492] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50: No bootstrap required, opened a new log
I20260203 09:16:12.744833 28417 ts_tablet_manager.cc:1403] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50: Time spent bootstrapping tablet: real 0.037s user 0.017s sys 0.000s
I20260203 09:16:12.745751 28122 catalog_manager.cc:5654] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67). New cstate: current_term: 1 leader_uuid: "19934d0e5f7d41a198ef452237e6a238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:12.747738 28417 raft_consensus.cc:359] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.748543 28417 raft_consensus.cc:385] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.748829 28417 raft_consensus.cc:740] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.749516 28417 consensus_queue.cc:260] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.750141 28426 ts_tablet_manager.cc:1434] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79: Time spent starting tablet: real 0.022s user 0.008s sys 0.000s
I20260203 09:16:12.751350 28426 tablet_bootstrap.cc:492] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79: Bootstrap starting.
I20260203 09:16:12.751814 28417 ts_tablet_manager.cc:1434] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50: Time spent starting tablet: real 0.007s user 0.001s sys 0.003s
I20260203 09:16:12.752928 28417 tablet_bootstrap.cc:492] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50: Bootstrap starting.
I20260203 09:16:12.755585 28418 tablet_bootstrap.cc:492] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238: No bootstrap required, opened a new log
I20260203 09:16:12.756050 28418 ts_tablet_manager.cc:1403] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238: Time spent bootstrapping tablet: real 0.021s user 0.009s sys 0.000s
I20260203 09:16:12.757537 28426 tablet_bootstrap.cc:654] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.758610 28418 raft_consensus.cc:359] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.759263 28418 raft_consensus.cc:385] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.759536 28418 raft_consensus.cc:740] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.759506 28417 tablet_bootstrap.cc:654] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.760928 28422 raft_consensus.cc:493] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:12.760221 28418 consensus_queue.cc:260] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.761386 28422 raft_consensus.cc:515] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.763370 28422 leader_election.cc:290] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:12.763489 28418 ts_tablet_manager.cc:1434] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238: Time spent starting tablet: real 0.007s user 0.002s sys 0.003s
I20260203 09:16:12.764513 28418 tablet_bootstrap.cc:492] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238: Bootstrap starting.
I20260203 09:16:12.764477 28377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "749653feb73c4b79a3d9adf185404a54" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19934d0e5f7d41a198ef452237e6a238" is_pre_election: true
I20260203 09:16:12.764909 28300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "749653feb73c4b79a3d9adf185404a54" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" is_pre_election: true
I20260203 09:16:12.765192 28377 raft_consensus.cc:2468] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 0.
I20260203 09:16:12.765612 28300 raft_consensus.cc:2468] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 0.
I20260203 09:16:12.766439 28191 leader_election.cc:304] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50; no voters:
I20260203 09:16:12.767493 28422 raft_consensus.cc:2804] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:12.769950 28422 raft_consensus.cc:493] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:12.770409 28422 raft_consensus.cc:3060] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:12.772032 28418 tablet_bootstrap.cc:654] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.773720 28444 raft_consensus.cc:493] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:12.774288 28444 raft_consensus.cc:515] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.777938 28377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43f348635db64f2dafea2f7ce2f538a5" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19934d0e5f7d41a198ef452237e6a238" is_pre_election: true
I20260203 09:16:12.778774 28377 raft_consensus.cc:2468] T 43f348635db64f2dafea2f7ce2f538a5 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 0.
I20260203 09:16:12.780141 28191 leader_election.cc:304] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50; no voters:
I20260203 09:16:12.777947 28300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43f348635db64f2dafea2f7ce2f538a5" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" is_pre_election: true
I20260203 09:16:12.782037 28300 raft_consensus.cc:2468] T 43f348635db64f2dafea2f7ce2f538a5 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 0.
I20260203 09:16:12.785158 28417 tablet_bootstrap.cc:492] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50: No bootstrap required, opened a new log
I20260203 09:16:12.785717 28417 ts_tablet_manager.cc:1403] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50: Time spent bootstrapping tablet: real 0.033s user 0.017s sys 0.000s
I20260203 09:16:12.776597 28444 leader_election.cc:290] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:12.788861 28444 raft_consensus.cc:2804] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:12.789286 28444 raft_consensus.cc:493] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:12.789649 28444 raft_consensus.cc:3060] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:12.788519 28417 raft_consensus.cc:359] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.794432 28417 raft_consensus.cc:385] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.794755 28417 raft_consensus.cc:740] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.797300 28417 consensus_queue.cc:260] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.799886 28417 ts_tablet_manager.cc:1434] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20260203 09:16:12.803879 28417 tablet_bootstrap.cc:492] T 67eea80e9038484c98bbc3837d24448f P 4961439bc01640ccb052971bca67aa50: Bootstrap starting.
I20260203 09:16:12.805091 28418 tablet_bootstrap.cc:492] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238: No bootstrap required, opened a new log
I20260203 09:16:12.805671 28418 ts_tablet_manager.cc:1403] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238: Time spent bootstrapping tablet: real 0.041s user 0.015s sys 0.022s
I20260203 09:16:12.808264 28418 raft_consensus.cc:359] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.809144 28418 raft_consensus.cc:385] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.809348 28417 tablet_bootstrap.cc:654] T 67eea80e9038484c98bbc3837d24448f P 4961439bc01640ccb052971bca67aa50: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.809471 28418 raft_consensus.cc:740] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.810348 28418 consensus_queue.cc:260] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.813300 28418 ts_tablet_manager.cc:1434] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20260203 09:16:12.819657 28422 raft_consensus.cc:515] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.820941 28417 tablet_bootstrap.cc:492] T 67eea80e9038484c98bbc3837d24448f P 4961439bc01640ccb052971bca67aa50: No bootstrap required, opened a new log
I20260203 09:16:12.821623 28417 ts_tablet_manager.cc:1403] T 67eea80e9038484c98bbc3837d24448f P 4961439bc01640ccb052971bca67aa50: Time spent bootstrapping tablet: real 0.018s user 0.013s sys 0.002s
I20260203 09:16:12.823959 28417 raft_consensus.cc:359] T 67eea80e9038484c98bbc3837d24448f P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.825101 28417 raft_consensus.cc:385] T 67eea80e9038484c98bbc3837d24448f P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.825397 28417 raft_consensus.cc:740] T 67eea80e9038484c98bbc3837d24448f P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.826077 28417 consensus_queue.cc:260] T 67eea80e9038484c98bbc3837d24448f P 4961439bc01640ccb052971bca67aa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.828215 28422 leader_election.cc:290] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 election: Requested vote from peers c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:12.830210 28422 raft_consensus.cc:493] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:12.830776 28377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "749653feb73c4b79a3d9adf185404a54" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
I20260203 09:16:12.831382 28377 raft_consensus.cc:3060] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:12.831511 28300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "749653feb73c4b79a3d9adf185404a54" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
I20260203 09:16:12.832038 28300 raft_consensus.cc:3060] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:12.832329 28444 raft_consensus.cc:515] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.832777 28426 tablet_bootstrap.cc:492] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79: No bootstrap required, opened a new log
I20260203 09:16:12.833292 28426 ts_tablet_manager.cc:1403] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79: Time spent bootstrapping tablet: real 0.082s user 0.030s sys 0.046s
I20260203 09:16:12.835580 28301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43f348635db64f2dafea2f7ce2f538a5" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
I20260203 09:16:12.836455 28301 raft_consensus.cc:3060] T 43f348635db64f2dafea2f7ce2f538a5 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:12.830672 28422 raft_consensus.cc:515] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.836613 28426 raft_consensus.cc:359] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } }
I20260203 09:16:12.837437 28426 raft_consensus.cc:385] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.837743 28426 raft_consensus.cc:740] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3abf1e576bb4f2bb5325812e8a63d79, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.838444 28426 consensus_queue.cc:260] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } }
I20260203 09:16:12.839607 28299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bef87f4cbe204179ae62b2c0fcf03c52" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" is_pre_election: true
I20260203 09:16:12.840268 28422 leader_election.cc:290] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:12.839741 28376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bef87f4cbe204179ae62b2c0fcf03c52" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19934d0e5f7d41a198ef452237e6a238" is_pre_election: true
I20260203 09:16:12.841231 28376 raft_consensus.cc:2468] T bef87f4cbe204179ae62b2c0fcf03c52 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 0.
I20260203 09:16:12.841535 28377 raft_consensus.cc:2468] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 1.
I20260203 09:16:12.842449 28191 leader_election.cc:304] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50; no voters:
I20260203 09:16:12.843310 28430 raft_consensus.cc:493] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:12.843389 28191 leader_election.cc:304] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50; no voters:
I20260203 09:16:12.843708 28430 raft_consensus.cc:515] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.844285 28456 raft_consensus.cc:2804] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260203 09:16:12.844347 28189 leader_election.cc:343] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:12.844715 28456 raft_consensus.cc:493] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:12.845184 28456 raft_consensus.cc:3060] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:12.845286 28422 raft_consensus.cc:2804] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:12.845669 28430 leader_election.cc:290] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787)
I20260203 09:16:12.847157 28226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "67eea80e9038484c98bbc3837d24448f" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4961439bc01640ccb052971bca67aa50" is_pre_election: true
I20260203 09:16:12.847805 28226 raft_consensus.cc:2468] T 67eea80e9038484c98bbc3837d24448f P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19934d0e5f7d41a198ef452237e6a238 in term 0.
I20260203 09:16:12.848981 28342 leader_election.cc:304] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50; no voters:
I20260203 09:16:12.849787 28430 raft_consensus.cc:2804] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:12.850112 28430 raft_consensus.cc:493] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:12.850428 28430 raft_consensus.cc:3060] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:12.852036 28426 ts_tablet_manager.cc:1434] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79: Time spent starting tablet: real 0.018s user 0.003s sys 0.004s
I20260203 09:16:12.853077 28426 tablet_bootstrap.cc:492] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79: Bootstrap starting.
I20260203 09:16:12.852886 28456 raft_consensus.cc:515] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.853521 28299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "67eea80e9038484c98bbc3837d24448f" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" is_pre_election: true
W20260203 09:16:12.854677 28341 leader_election.cc:343] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:12.856861 28299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bef87f4cbe204179ae62b2c0fcf03c52" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
I20260203 09:16:12.857285 28300 raft_consensus.cc:2468] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 1.
I20260203 09:16:12.845297 28301 raft_consensus.cc:2468] T 43f348635db64f2dafea2f7ce2f538a5 P c3abf1e576bb4f2bb5325812e8a63d79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 1.
W20260203 09:16:12.858412 28189 leader_election.cc:343] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:12.859328 28417 ts_tablet_manager.cc:1434] T 67eea80e9038484c98bbc3837d24448f P 4961439bc01640ccb052971bca67aa50: Time spent starting tablet: real 0.037s user 0.006s sys 0.000s
I20260203 09:16:12.859655 28377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43f348635db64f2dafea2f7ce2f538a5" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
I20260203 09:16:12.860257 28417 tablet_bootstrap.cc:492] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50: Bootstrap starting.
I20260203 09:16:12.860507 28444 leader_election.cc:290] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 election: Requested vote from peers c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:12.859920 28189 leader_election.cc:304] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4961439bc01640ccb052971bca67aa50, c3abf1e576bb4f2bb5325812e8a63d79; no voters:
I20260203 09:16:12.863891 28426 tablet_bootstrap.cc:654] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.864537 28376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bef87f4cbe204179ae62b2c0fcf03c52" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
I20260203 09:16:12.860278 28377 raft_consensus.cc:3060] T 43f348635db64f2dafea2f7ce2f538a5 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:12.865130 28376 raft_consensus.cc:3060] T bef87f4cbe204179ae62b2c0fcf03c52 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:12.866694 28422 raft_consensus.cc:697] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 1 LEADER]: Becoming Leader. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Running, Role: LEADER
I20260203 09:16:12.866969 28430 raft_consensus.cc:515] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.867589 28422 consensus_queue.cc:237] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.869032 28458 raft_consensus.cc:2804] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:12.869529 28458 raft_consensus.cc:697] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50 [term 1 LEADER]: Becoming Leader. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Running, Role: LEADER
I20260203 09:16:12.870474 28226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "67eea80e9038484c98bbc3837d24448f" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4961439bc01640ccb052971bca67aa50"
I20260203 09:16:12.870340 28458 consensus_queue.cc:237] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.871059 28226 raft_consensus.cc:3060] T 67eea80e9038484c98bbc3837d24448f P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:12.872874 28376 raft_consensus.cc:2468] T bef87f4cbe204179ae62b2c0fcf03c52 P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 1.
I20260203 09:16:12.874168 28191 leader_election.cc:304] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50; no voters: c3abf1e576bb4f2bb5325812e8a63d79
I20260203 09:16:12.875383 28444 raft_consensus.cc:2804] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:12.877892 28456 leader_election.cc:290] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 election: Requested vote from peers c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:12.879638 28426 tablet_bootstrap.cc:492] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79: No bootstrap required, opened a new log
I20260203 09:16:12.881052 28426 ts_tablet_manager.cc:1403] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.004s
I20260203 09:16:12.883666 28377 raft_consensus.cc:2468] T 43f348635db64f2dafea2f7ce2f538a5 P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 1.
I20260203 09:16:12.878038 28226 raft_consensus.cc:2468] T 67eea80e9038484c98bbc3837d24448f P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19934d0e5f7d41a198ef452237e6a238 in term 1.
I20260203 09:16:12.883901 28444 raft_consensus.cc:697] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 1 LEADER]: Becoming Leader. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Running, Role: LEADER
I20260203 09:16:12.883942 28426 raft_consensus.cc:359] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.884784 28426 raft_consensus.cc:385] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.884958 28342 leader_election.cc:304] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50; no voters:
I20260203 09:16:12.885175 28426 raft_consensus.cc:740] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3abf1e576bb4f2bb5325812e8a63d79, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.884855 28444 consensus_queue.cc:237] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.885922 28429 raft_consensus.cc:2804] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:12.886422 28429 raft_consensus.cc:697] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Becoming Leader. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Running, Role: LEADER
I20260203 09:16:12.886072 28426 consensus_queue.cc:260] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.887238 28429 consensus_queue.cc:237] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.887598 28119 catalog_manager.cc:5654] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4961439bc01640ccb052971bca67aa50 (127.26.232.65). New cstate: current_term: 1 leader_uuid: "4961439bc01640ccb052971bca67aa50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:12.888913 28426 ts_tablet_manager.cc:1434] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79: Time spent starting tablet: real 0.008s user 0.005s sys 0.002s
I20260203 09:16:12.889914 28426 tablet_bootstrap.cc:492] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79: Bootstrap starting.
I20260203 09:16:12.889463 28119 catalog_manager.cc:5654] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4961439bc01640ccb052971bca67aa50 (127.26.232.65). New cstate: current_term: 1 leader_uuid: "4961439bc01640ccb052971bca67aa50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:12.894479 28301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "67eea80e9038484c98bbc3837d24448f" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
W20260203 09:16:12.896108 28341 leader_election.cc:343] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:12.896936 28426 tablet_bootstrap.cc:654] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.897140 28430 leader_election.cc:290] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 election: Requested vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787)
I20260203 09:16:12.897737 28430 raft_consensus.cc:493] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:12.898039 28430 raft_consensus.cc:515] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.900365 28226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7475c49386954b638b459eed5689e758" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4961439bc01640ccb052971bca67aa50" is_pre_election: true
I20260203 09:16:12.901054 28226 raft_consensus.cc:2468] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19934d0e5f7d41a198ef452237e6a238 in term 0.
I20260203 09:16:12.901856 28417 tablet_bootstrap.cc:654] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.901783 28301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7475c49386954b638b459eed5689e758" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" is_pre_election: true
I20260203 09:16:12.902242 28342 leader_election.cc:304] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50; no voters:
I20260203 09:16:12.902904 28301 raft_consensus.cc:2468] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19934d0e5f7d41a198ef452237e6a238 in term 0.
I20260203 09:16:12.903427 28432 raft_consensus.cc:2804] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:12.903792 28432 raft_consensus.cc:493] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:12.904114 28432 raft_consensus.cc:3060] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:12.910953 28426 tablet_bootstrap.cc:492] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79: No bootstrap required, opened a new log
I20260203 09:16:12.911546 28426 ts_tablet_manager.cc:1403] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79: Time spent bootstrapping tablet: real 0.022s user 0.011s sys 0.007s
I20260203 09:16:12.912506 28417 tablet_bootstrap.cc:492] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50: No bootstrap required, opened a new log
I20260203 09:16:12.912969 28417 ts_tablet_manager.cc:1403] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50: Time spent bootstrapping tablet: real 0.053s user 0.011s sys 0.000s
I20260203 09:16:12.914628 28426 raft_consensus.cc:359] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.914664 28432 raft_consensus.cc:515] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.900501 28430 leader_election.cc:290] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787)
I20260203 09:16:12.917719 28426 raft_consensus.cc:385] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.915732 28417 raft_consensus.cc:359] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.918061 28426 raft_consensus.cc:740] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3abf1e576bb4f2bb5325812e8a63d79, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.918344 28417 raft_consensus.cc:385] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.918658 28417 raft_consensus.cc:740] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.917057 28429 consensus_queue.cc:1048] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:12.918761 28426 consensus_queue.cc:260] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.921180 28426 ts_tablet_manager.cc:1434] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260203 09:16:12.922194 28426 tablet_bootstrap.cc:492] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79: Bootstrap starting.
I20260203 09:16:12.921526 28119 catalog_manager.cc:5654] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67). New cstate: current_term: 1 leader_uuid: "19934d0e5f7d41a198ef452237e6a238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:12.922287 28432 leader_election.cc:290] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 election: Requested vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787)
I20260203 09:16:12.923414 28301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7475c49386954b638b459eed5689e758" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
I20260203 09:16:12.923245 28417 consensus_queue.cc:260] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.923954 28301 raft_consensus.cc:3060] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:12.925802 28417 ts_tablet_manager.cc:1434] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50: Time spent starting tablet: real 0.013s user 0.005s sys 0.001s
I20260203 09:16:12.928839 28225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7475c49386954b638b459eed5689e758" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4961439bc01640ccb052971bca67aa50"
I20260203 09:16:12.929217 28426 tablet_bootstrap.cc:654] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.929428 28225 raft_consensus.cc:3060] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:12.933725 28301 raft_consensus.cc:2468] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19934d0e5f7d41a198ef452237e6a238 in term 1.
I20260203 09:16:12.935298 28341 leader_election.cc:304] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, c3abf1e576bb4f2bb5325812e8a63d79; no voters:
I20260203 09:16:12.936409 28432 raft_consensus.cc:2804] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:12.936905 28225 raft_consensus.cc:2468] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19934d0e5f7d41a198ef452237e6a238 in term 1.
I20260203 09:16:12.937223 28432 raft_consensus.cc:697] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Becoming Leader. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Running, Role: LEADER
I20260203 09:16:12.926729 28117 catalog_manager.cc:5654] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4961439bc01640ccb052971bca67aa50 (127.26.232.65). New cstate: current_term: 1 leader_uuid: "4961439bc01640ccb052971bca67aa50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:12.938352 28432 consensus_queue.cc:237] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.943084 28426 tablet_bootstrap.cc:492] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79: No bootstrap required, opened a new log
I20260203 09:16:12.943506 28426 ts_tablet_manager.cc:1403] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79: Time spent bootstrapping tablet: real 0.022s user 0.016s sys 0.004s
I20260203 09:16:12.945938 28426 raft_consensus.cc:359] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.946650 28426 raft_consensus.cc:385] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:12.946930 28426 raft_consensus.cc:740] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3abf1e576bb4f2bb5325812e8a63d79, State: Initialized, Role: FOLLOWER
I20260203 09:16:12.947618 28426 consensus_queue.cc:260] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.950557 28444 raft_consensus.cc:493] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:12.951103 28444 raft_consensus.cc:515] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.953313 28444 leader_election.cc:290] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:12.955268 28377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6875bd2def54a3daaa4149c7ced68ef" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19934d0e5f7d41a198ef452237e6a238" is_pre_election: true
I20260203 09:16:12.955900 28377 raft_consensus.cc:2468] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 0.
I20260203 09:16:12.957082 28191 leader_election.cc:304] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50; no voters:
I20260203 09:16:12.957650 28301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6875bd2def54a3daaa4149c7ced68ef" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" is_pre_election: true
I20260203 09:16:12.957892 28444 raft_consensus.cc:2804] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:12.958235 28444 raft_consensus.cc:493] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:12.950083 28426 ts_tablet_manager.cc:1434] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260203 09:16:12.958559 28444 raft_consensus.cc:3060] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:12.959673 28426 tablet_bootstrap.cc:492] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79: Bootstrap starting.
W20260203 09:16:12.961172 28189 leader_election.cc:343] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:12.965986 28301 raft_consensus.cc:3060] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:12.966693 28444 raft_consensus.cc:515] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.967556 28426 tablet_bootstrap.cc:654] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:12.969336 28300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6875bd2def54a3daaa4149c7ced68ef" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
I20260203 09:16:12.969785 28122 catalog_manager.cc:5654] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67). New cstate: current_term: 1 leader_uuid: "19934d0e5f7d41a198ef452237e6a238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: HEALTHY } } }
W20260203 09:16:12.970674 28189 leader_election.cc:343] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:12.972621 28377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6875bd2def54a3daaa4149c7ced68ef" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
I20260203 09:16:12.973179 28377 raft_consensus.cc:3060] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:12.979604 28377 raft_consensus.cc:2468] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 1.
I20260203 09:16:12.980773 28191 leader_election.cc:304] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50; no voters: c3abf1e576bb4f2bb5325812e8a63d79
I20260203 09:16:12.981737 28462 raft_consensus.cc:2804] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:12.982194 28462 raft_consensus.cc:697] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [term 1 LEADER]: Becoming Leader. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Running, Role: LEADER
I20260203 09:16:12.982980 28462 consensus_queue.cc:237] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:12.979544 28429 consensus_queue.cc:1048] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260203 09:16:12.992502 28444 leader_election.cc:290] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 1 election: Requested vote from peers c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:13.006770 28426 tablet_bootstrap.cc:492] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79: No bootstrap required, opened a new log
I20260203 09:16:13.007270 28426 ts_tablet_manager.cc:1403] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79: Time spent bootstrapping tablet: real 0.048s user 0.013s sys 0.023s
I20260203 09:16:13.010027 28426 raft_consensus.cc:359] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.010715 28426 raft_consensus.cc:385] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:13.010975 28426 raft_consensus.cc:740] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3abf1e576bb4f2bb5325812e8a63d79, State: Initialized, Role: FOLLOWER
I20260203 09:16:13.011565 28426 consensus_queue.cc:260] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.012375 28119 catalog_manager.cc:5654] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4961439bc01640ccb052971bca67aa50 (127.26.232.65). New cstate: current_term: 1 leader_uuid: "4961439bc01640ccb052971bca67aa50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:13.013290 28426 ts_tablet_manager.cc:1434] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
I20260203 09:16:13.014233 28426 tablet_bootstrap.cc:492] T c6875bd2def54a3daaa4149c7ced68ef P c3abf1e576bb4f2bb5325812e8a63d79: Bootstrap starting.
I20260203 09:16:13.019002 28426 tablet_bootstrap.cc:654] T c6875bd2def54a3daaa4149c7ced68ef P c3abf1e576bb4f2bb5325812e8a63d79: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:13.019312 28434 raft_consensus.cc:493] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:13.019820 28434 raft_consensus.cc:515] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.023918 28426 tablet_bootstrap.cc:492] T c6875bd2def54a3daaa4149c7ced68ef P c3abf1e576bb4f2bb5325812e8a63d79: No bootstrap required, opened a new log
I20260203 09:16:13.024506 28426 ts_tablet_manager.cc:1403] T c6875bd2def54a3daaa4149c7ced68ef P c3abf1e576bb4f2bb5325812e8a63d79: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.005s
I20260203 09:16:13.027303 28426 raft_consensus.cc:359] T c6875bd2def54a3daaa4149c7ced68ef P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.027964 28426 raft_consensus.cc:385] T c6875bd2def54a3daaa4149c7ced68ef P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:13.028205 28426 raft_consensus.cc:740] T c6875bd2def54a3daaa4149c7ced68ef P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3abf1e576bb4f2bb5325812e8a63d79, State: Initialized, Role: FOLLOWER
I20260203 09:16:13.028784 28426 consensus_queue.cc:260] T c6875bd2def54a3daaa4149c7ced68ef P c3abf1e576bb4f2bb5325812e8a63d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.030706 28301 raft_consensus.cc:3060] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:13.040711 28434 leader_election.cc:290] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:13.045706 28429 consensus_queue.cc:1048] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:13.056511 28225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "67eea80e9038484c98bbc3837d24448f" candidate_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4961439bc01640ccb052971bca67aa50" is_pre_election: true
I20260203 09:16:13.057607 28426 ts_tablet_manager.cc:1434] T c6875bd2def54a3daaa4149c7ced68ef P c3abf1e576bb4f2bb5325812e8a63d79: Time spent starting tablet: real 0.033s user 0.020s sys 0.012s
I20260203 09:16:13.057379 28225 raft_consensus.cc:2393] T 67eea80e9038484c98bbc3837d24448f P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c3abf1e576bb4f2bb5325812e8a63d79 in current term 1: Already voted for candidate 19934d0e5f7d41a198ef452237e6a238 in this term.
I20260203 09:16:13.064775 28377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "67eea80e9038484c98bbc3837d24448f" candidate_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19934d0e5f7d41a198ef452237e6a238" is_pre_election: true
I20260203 09:16:13.065271 28430 consensus_queue.cc:1048] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:13.067034 28267 leader_election.cc:304] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3abf1e576bb4f2bb5325812e8a63d79; no voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50
I20260203 09:16:13.067936 28434 raft_consensus.cc:3060] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:13.069375 28484 raft_consensus.cc:493] T c6875bd2def54a3daaa4149c7ced68ef P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:13.069912 28484 raft_consensus.cc:515] T c6875bd2def54a3daaa4149c7ced68ef P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.072149 28484 leader_election.cc:290] T c6875bd2def54a3daaa4149c7ced68ef P c3abf1e576bb4f2bb5325812e8a63d79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:13.073213 28377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6875bd2def54a3daaa4149c7ced68ef" candidate_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19934d0e5f7d41a198ef452237e6a238" is_pre_election: true
I20260203 09:16:13.074055 28377 raft_consensus.cc:2393] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c3abf1e576bb4f2bb5325812e8a63d79 in current term 1: Already voted for candidate 4961439bc01640ccb052971bca67aa50 in this term.
I20260203 09:16:13.076336 28226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6875bd2def54a3daaa4149c7ced68ef" candidate_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4961439bc01640ccb052971bca67aa50" is_pre_election: true
I20260203 09:16:13.077090 28434 raft_consensus.cc:2749] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:13.077829 28266 leader_election.cc:304] T c6875bd2def54a3daaa4149c7ced68ef P c3abf1e576bb4f2bb5325812e8a63d79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3abf1e576bb4f2bb5325812e8a63d79; no voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50
I20260203 09:16:13.078920 28434 raft_consensus.cc:3060] T c6875bd2def54a3daaa4149c7ced68ef P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:13.084806 28434 raft_consensus.cc:2749] T c6875bd2def54a3daaa4149c7ced68ef P c3abf1e576bb4f2bb5325812e8a63d79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:13.105279 28434 raft_consensus.cc:493] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:13.105796 28434 raft_consensus.cc:515] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.107547 28434 leader_election.cc:290] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:13.108765 28226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bef87f4cbe204179ae62b2c0fcf03c52" candidate_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4961439bc01640ccb052971bca67aa50" is_pre_election: true
I20260203 09:16:13.109005 28377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bef87f4cbe204179ae62b2c0fcf03c52" candidate_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19934d0e5f7d41a198ef452237e6a238" is_pre_election: true
I20260203 09:16:13.109710 28377 raft_consensus.cc:2393] T bef87f4cbe204179ae62b2c0fcf03c52 P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c3abf1e576bb4f2bb5325812e8a63d79 in current term 1: Already voted for candidate 4961439bc01640ccb052971bca67aa50 in this term.
I20260203 09:16:13.110538 28267 leader_election.cc:304] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3abf1e576bb4f2bb5325812e8a63d79; no voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50
I20260203 09:16:13.111145 28434 raft_consensus.cc:3060] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:13.116593 28434 raft_consensus.cc:2749] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:13.125379 28462 consensus_queue.cc:1048] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:13.134953 28301 raft_consensus.cc:3060] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:13.142452 28444 consensus_queue.cc:1048] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:13.148716 28434 raft_consensus.cc:493] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:13.149197 28434 raft_consensus.cc:515] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.150939 28434 leader_election.cc:290] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:13.152454 28226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d01575aefc8413993898b91f0ee2881" candidate_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4961439bc01640ccb052971bca67aa50" is_pre_election: true
I20260203 09:16:13.152493 28377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d01575aefc8413993898b91f0ee2881" candidate_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19934d0e5f7d41a198ef452237e6a238" is_pre_election: true
I20260203 09:16:13.153177 28226 raft_consensus.cc:2393] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c3abf1e576bb4f2bb5325812e8a63d79 in current term 1: Already voted for candidate 19934d0e5f7d41a198ef452237e6a238 in this term.
I20260203 09:16:13.154450 28266 leader_election.cc:304] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3abf1e576bb4f2bb5325812e8a63d79; no voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50
I20260203 09:16:13.155186 28434 raft_consensus.cc:3060] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:13.161348 28434 raft_consensus.cc:2749] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:13.164867 28377 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "feb960bd17de4e2bb654b6a5a87c4d43"
dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
mode: GRACEFUL
new_leader_uuid: "4961439bc01640ccb052971bca67aa50"
from {username='slave'} at 127.0.0.1:44358
I20260203 09:16:13.165403 28377 raft_consensus.cc:606] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Received request to transfer leadership to TS 4961439bc01640ccb052971bca67aa50
I20260203 09:16:13.170217 28377 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "cb7d38bef7ee47c1ade9124f4362d083"
dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
mode: GRACEFUL
new_leader_uuid: "4961439bc01640ccb052971bca67aa50"
from {username='slave'} at 127.0.0.1:44358
I20260203 09:16:13.170677 28377 raft_consensus.cc:606] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Received request to transfer leadership to TS 4961439bc01640ccb052971bca67aa50
I20260203 09:16:13.180549 28377 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "2d01575aefc8413993898b91f0ee2881"
dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
mode: GRACEFUL
new_leader_uuid: "4961439bc01640ccb052971bca67aa50"
from {username='slave'} at 127.0.0.1:44358
I20260203 09:16:13.181102 28377 raft_consensus.cc:606] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Received request to transfer leadership to TS 4961439bc01640ccb052971bca67aa50
I20260203 09:16:13.192828 28226 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "749653feb73c4b79a3d9adf185404a54"
dest_uuid: "4961439bc01640ccb052971bca67aa50"
mode: GRACEFUL
new_leader_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
from {username='slave'} at 127.0.0.1:36910
I20260203 09:16:13.193321 28226 raft_consensus.cc:606] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 1 LEADER]: Received request to transfer leadership to TS c3abf1e576bb4f2bb5325812e8a63d79
I20260203 09:16:13.198074 28226 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "bef87f4cbe204179ae62b2c0fcf03c52"
dest_uuid: "4961439bc01640ccb052971bca67aa50"
mode: GRACEFUL
new_leader_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
from {username='slave'} at 127.0.0.1:36910
I20260203 09:16:13.198585 28226 raft_consensus.cc:606] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 1 LEADER]: Received request to transfer leadership to TS c3abf1e576bb4f2bb5325812e8a63d79
I20260203 09:16:13.203491 28377 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "7475c49386954b638b459eed5689e758"
dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
mode: GRACEFUL
new_leader_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
from {username='slave'} at 127.0.0.1:44358
I20260203 09:16:13.203996 28377 raft_consensus.cc:606] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Received request to transfer leadership to TS c3abf1e576bb4f2bb5325812e8a63d79
I20260203 09:16:13.209250 28377 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "67eea80e9038484c98bbc3837d24448f"
dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
mode: GRACEFUL
new_leader_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
from {username='slave'} at 127.0.0.1:44358
I20260203 09:16:13.209802 28377 raft_consensus.cc:606] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Received request to transfer leadership to TS c3abf1e576bb4f2bb5325812e8a63d79
I20260203 09:16:13.212636 28430 consensus_queue.cc:1048] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:13.214996 28225 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c6875bd2def54a3daaa4149c7ced68ef"
dest_uuid: "4961439bc01640ccb052971bca67aa50"
mode: GRACEFUL
new_leader_uuid: "19934d0e5f7d41a198ef452237e6a238"
from {username='slave'} at 127.0.0.1:36910
I20260203 09:16:13.215611 28225 raft_consensus.cc:606] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [term 1 LEADER]: Received request to transfer leadership to TS 19934d0e5f7d41a198ef452237e6a238
I20260203 09:16:13.219035 28421 raft_consensus.cc:993] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238: : Instructing follower 4961439bc01640ccb052971bca67aa50 to start an election
I20260203 09:16:13.219535 28432 raft_consensus.cc:1081] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Signalling peer 4961439bc01640ccb052971bca67aa50 to start an election
I20260203 09:16:13.224498 28225 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "2d01575aefc8413993898b91f0ee2881"
dest_uuid: "4961439bc01640ccb052971bca67aa50"
from {username='slave'} at 127.0.0.1:36892
I20260203 09:16:13.225157 28225 raft_consensus.cc:493] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:16:13.225629 28225 raft_consensus.cc:3060] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:13.231644 28225 raft_consensus.cc:515] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.232806 28432 consensus_queue.cc:1048] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:13.234200 28225 leader_election.cc:290] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 2 election: Requested vote from peers c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:13.235163 28377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d01575aefc8413993898b91f0ee2881" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
I20260203 09:16:13.235128 28300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d01575aefc8413993898b91f0ee2881" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
I20260203 09:16:13.235836 28377 raft_consensus.cc:3055] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:16:13.236158 28377 raft_consensus.cc:740] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Running, Role: LEADER
I20260203 09:16:13.237044 28377 consensus_queue.cc:260] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.238113 28377 raft_consensus.cc:3060] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:13.243602 28377 raft_consensus.cc:2468] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 2.
I20260203 09:16:13.244714 28191 leader_election.cc:304] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50; no voters: c3abf1e576bb4f2bb5325812e8a63d79
I20260203 09:16:13.245355 28444 raft_consensus.cc:2804] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:16:13.245759 28444 raft_consensus.cc:697] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 2 LEADER]: Becoming Leader. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Running, Role: LEADER
I20260203 09:16:13.246361 28444 consensus_queue.cc:237] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.252310 28122 catalog_manager.cc:5654] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 reported cstate change: term changed from 1 to 2, leader changed from 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67) to 4961439bc01640ccb052971bca67aa50 (127.26.232.65). New cstate: current_term: 2 leader_uuid: "4961439bc01640ccb052971bca67aa50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:13.282596 28432 consensus_queue.cc:1048] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:13.288995 28430 raft_consensus.cc:993] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238: : Instructing follower c3abf1e576bb4f2bb5325812e8a63d79 to start an election
I20260203 09:16:13.289494 28429 raft_consensus.cc:1081] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Signalling peer c3abf1e576bb4f2bb5325812e8a63d79 to start an election
I20260203 09:16:13.290922 28300 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "67eea80e9038484c98bbc3837d24448f"
dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
from {username='slave'} at 127.0.0.1:59252
I20260203 09:16:13.291486 28300 raft_consensus.cc:493] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:16:13.291955 28300 raft_consensus.cc:3060] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:13.294134 28432 consensus_queue.cc:1048] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:13.301162 28300 raft_consensus.cc:515] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.302030 28301 raft_consensus.cc:1240] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Rejecting Update request from peer 19934d0e5f7d41a198ef452237e6a238 for earlier term 1. Current term is 2. Ops: []
I20260203 09:16:13.303071 28300 leader_election.cc:290] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79 [CANDIDATE]: Term 2 election: Requested vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:13.303690 28225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "67eea80e9038484c98bbc3837d24448f" candidate_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4961439bc01640ccb052971bca67aa50"
I20260203 09:16:13.305240 28225 raft_consensus.cc:3060] T 67eea80e9038484c98bbc3837d24448f P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:13.306254 28432 consensus_queue.cc:1059] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:13.307199 28430 raft_consensus.cc:3055] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:16:13.307545 28430 raft_consensus.cc:740] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Running, Role: LEADER
I20260203 09:16:13.308323 28430 consensus_queue.cc:260] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.309430 28430 raft_consensus.cc:3060] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:13.304416 28377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "67eea80e9038484c98bbc3837d24448f" candidate_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
I20260203 09:16:13.312698 28225 raft_consensus.cc:2468] T 67eea80e9038484c98bbc3837d24448f P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3abf1e576bb4f2bb5325812e8a63d79 in term 2.
I20260203 09:16:13.313822 28266 leader_election.cc:304] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4961439bc01640ccb052971bca67aa50, c3abf1e576bb4f2bb5325812e8a63d79; no voters:
I20260203 09:16:13.314796 28434 raft_consensus.cc:2804] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:16:13.315317 28434 raft_consensus.cc:697] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 LEADER]: Becoming Leader. State: Replica: c3abf1e576bb4f2bb5325812e8a63d79, State: Running, Role: LEADER
I20260203 09:16:13.316231 28434 consensus_queue.cc:237] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.318513 28444 consensus_queue.cc:1048] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:13.323405 28377 raft_consensus.cc:2468] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3abf1e576bb4f2bb5325812e8a63d79 in term 2.
I20260203 09:16:13.324851 28122 catalog_manager.cc:5654] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79 reported cstate change: term changed from 1 to 2, leader changed from 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67) to c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66). New cstate: current_term: 2 leader_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:13.326541 28458 raft_consensus.cc:993] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50: : Instructing follower c3abf1e576bb4f2bb5325812e8a63d79 to start an election
I20260203 09:16:13.326984 28458 raft_consensus.cc:1081] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 1 LEADER]: Signalling peer c3abf1e576bb4f2bb5325812e8a63d79 to start an election
I20260203 09:16:13.332913 28301 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "749653feb73c4b79a3d9adf185404a54"
dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
from {username='slave'} at 127.0.0.1:59268
I20260203 09:16:13.333495 28301 raft_consensus.cc:493] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:16:13.333853 28301 raft_consensus.cc:3060] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:13.340415 28301 raft_consensus.cc:515] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.343060 28301 leader_election.cc:290] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [CANDIDATE]: Term 2 election: Requested vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:13.342972 28225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "749653feb73c4b79a3d9adf185404a54" candidate_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4961439bc01640ccb052971bca67aa50"
I20260203 09:16:13.343709 28225 raft_consensus.cc:3055] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:16:13.344022 28225 raft_consensus.cc:740] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Running, Role: LEADER
I20260203 09:16:13.344050 28376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "749653feb73c4b79a3d9adf185404a54" candidate_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
I20260203 09:16:13.344866 28225 consensus_queue.cc:260] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.346001 28225 raft_consensus.cc:3060] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:13.350771 28225 raft_consensus.cc:2468] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3abf1e576bb4f2bb5325812e8a63d79 in term 2.
I20260203 09:16:13.351725 28266 leader_election.cc:304] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4961439bc01640ccb052971bca67aa50, c3abf1e576bb4f2bb5325812e8a63d79; no voters: 19934d0e5f7d41a198ef452237e6a238
I20260203 09:16:13.352409 28434 raft_consensus.cc:2804] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:16:13.352837 28434 raft_consensus.cc:697] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 LEADER]: Becoming Leader. State: Replica: c3abf1e576bb4f2bb5325812e8a63d79, State: Running, Role: LEADER
I20260203 09:16:13.353566 28434 consensus_queue.cc:237] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.360092 28122 catalog_manager.cc:5654] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 reported cstate change: term changed from 1 to 2, leader changed from 4961439bc01640ccb052971bca67aa50 (127.26.232.65) to c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66). New cstate: current_term: 2 leader_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:13.390908 28444 consensus_queue.cc:1048] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:13.391841 28456 consensus_queue.cc:1048] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:13.404407 28458 consensus_queue.cc:1048] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:13.406000 28458 consensus_queue.cc:1048] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:13.412796 28429 raft_consensus.cc:993] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238: : Instructing follower 4961439bc01640ccb052971bca67aa50 to start an election
I20260203 09:16:13.421047 28429 raft_consensus.cc:1081] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Signalling peer 4961439bc01640ccb052971bca67aa50 to start an election
I20260203 09:16:13.423915 28225 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "feb960bd17de4e2bb654b6a5a87c4d43"
dest_uuid: "4961439bc01640ccb052971bca67aa50"
from {username='slave'} at 127.0.0.1:36892
I20260203 09:16:13.424723 28225 raft_consensus.cc:493] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:16:13.425191 28225 raft_consensus.cc:3060] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:13.427974 28421 consensus_queue.cc:1048] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:13.437060 28444 raft_consensus.cc:993] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50: : Instructing follower 19934d0e5f7d41a198ef452237e6a238 to start an election
I20260203 09:16:13.432368 28225 raft_consensus.cc:515] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } }
I20260203 09:16:13.437669 28444 raft_consensus.cc:1081] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [term 1 LEADER]: Signalling peer 19934d0e5f7d41a198ef452237e6a238 to start an election
I20260203 09:16:13.439276 28225 leader_election.cc:290] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 2 election: Requested vote from peers 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755), c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787)
I20260203 09:16:13.439913 28376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "feb960bd17de4e2bb654b6a5a87c4d43" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
I20260203 09:16:13.440392 28376 raft_consensus.cc:3055] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:16:13.440608 28376 raft_consensus.cc:740] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Running, Role: LEADER
I20260203 09:16:13.440701 28301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "feb960bd17de4e2bb654b6a5a87c4d43" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
I20260203 09:16:13.440924 28377 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c6875bd2def54a3daaa4149c7ced68ef"
dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
from {username='slave'} at 127.0.0.1:44338
I20260203 09:16:13.441289 28301 raft_consensus.cc:3060] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:13.441480 28377 raft_consensus.cc:493] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:16:13.444674 28377 raft_consensus.cc:3060] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:13.441500 28376 consensus_queue.cc:260] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } }
I20260203 09:16:13.445652 28376 raft_consensus.cc:3060] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:13.447345 28301 raft_consensus.cc:2468] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 2.
I20260203 09:16:13.448486 28189 leader_election.cc:304] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4961439bc01640ccb052971bca67aa50, c3abf1e576bb4f2bb5325812e8a63d79; no voters:
I20260203 09:16:13.449357 28444 raft_consensus.cc:2804] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:16:13.449802 28444 raft_consensus.cc:697] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 2 LEADER]: Becoming Leader. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Running, Role: LEADER
I20260203 09:16:13.450649 28444 consensus_queue.cc:237] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } }
I20260203 09:16:13.451421 28377 raft_consensus.cc:515] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.452230 28376 raft_consensus.cc:2468] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 2.
I20260203 09:16:13.453414 28377 leader_election.cc:290] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 2 election: Requested vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787)
I20260203 09:16:13.454771 28299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6875bd2def54a3daaa4149c7ced68ef" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
I20260203 09:16:13.455358 28299 raft_consensus.cc:3060] T c6875bd2def54a3daaa4149c7ced68ef P c3abf1e576bb4f2bb5325812e8a63d79 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:13.456708 28429 raft_consensus.cc:993] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238: : Instructing follower c3abf1e576bb4f2bb5325812e8a63d79 to start an election
I20260203 09:16:13.455891 28225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6875bd2def54a3daaa4149c7ced68ef" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4961439bc01640ccb052971bca67aa50"
I20260203 09:16:13.457271 28429 raft_consensus.cc:1081] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Signalling peer c3abf1e576bb4f2bb5325812e8a63d79 to start an election
I20260203 09:16:13.457372 28225 raft_consensus.cc:3055] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:16:13.457794 28225 raft_consensus.cc:740] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Running, Role: LEADER
I20260203 09:16:13.458580 28225 consensus_queue.cc:260] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.459625 28225 raft_consensus.cc:3060] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:13.462726 28429 consensus_queue.cc:1048] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:13.464234 28300 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "7475c49386954b638b459eed5689e758"
dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
from {username='slave'} at 127.0.0.1:59252
I20260203 09:16:13.463554 28119 catalog_manager.cc:5654] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 reported cstate change: term changed from 1 to 2, leader changed from 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67) to 4961439bc01640ccb052971bca67aa50 (127.26.232.65). New cstate: current_term: 2 leader_uuid: "4961439bc01640ccb052971bca67aa50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:13.464701 28300 raft_consensus.cc:493] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:16:13.465068 28300 raft_consensus.cc:3060] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:13.473026 28225 raft_consensus.cc:2468] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19934d0e5f7d41a198ef452237e6a238 in term 2.
I20260203 09:16:13.473481 28300 raft_consensus.cc:515] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.474242 28342 leader_election.cc:304] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50; no voters:
I20260203 09:16:13.475134 28429 raft_consensus.cc:2804] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:16:13.475757 28429 raft_consensus.cc:697] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238 [term 2 LEADER]: Becoming Leader. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Running, Role: LEADER
I20260203 09:16:13.476574 28224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7475c49386954b638b459eed5689e758" candidate_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4961439bc01640ccb052971bca67aa50"
I20260203 09:16:13.476805 28429 consensus_queue.cc:237] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.479843 28376 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7475c49386954b638b459eed5689e758" candidate_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
I20260203 09:16:13.480407 28376 raft_consensus.cc:3055] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:16:13.480779 28376 raft_consensus.cc:740] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Running, Role: LEADER
I20260203 09:16:13.481217 28299 raft_consensus.cc:2468] T c6875bd2def54a3daaa4149c7ced68ef P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19934d0e5f7d41a198ef452237e6a238 in term 2.
I20260203 09:16:13.481760 28376 consensus_queue.cc:260] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.482813 28376 raft_consensus.cc:3060] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:13.488318 28300 leader_election.cc:290] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [CANDIDATE]: Term 2 election: Requested vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:13.489902 28462 consensus_queue.cc:1048] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:13.490981 28376 raft_consensus.cc:2468] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3abf1e576bb4f2bb5325812e8a63d79 in term 2.
I20260203 09:16:13.492058 28267 leader_election.cc:304] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, c3abf1e576bb4f2bb5325812e8a63d79; no voters: 4961439bc01640ccb052971bca67aa50
I20260203 09:16:13.493036 28434 raft_consensus.cc:2804] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:16:13.493474 28434 raft_consensus.cc:697] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 LEADER]: Becoming Leader. State: Replica: c3abf1e576bb4f2bb5325812e8a63d79, State: Running, Role: LEADER
I20260203 09:16:13.494237 28434 consensus_queue.cc:237] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.497334 28122 catalog_manager.cc:5654] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238 reported cstate change: term changed from 1 to 2, leader changed from 4961439bc01640ccb052971bca67aa50 (127.26.232.65) to 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67). New cstate: current_term: 2 leader_uuid: "19934d0e5f7d41a198ef452237e6a238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:13.506767 28444 consensus_queue.cc:1048] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:13.507793 28118 catalog_manager.cc:5654] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 reported cstate change: term changed from 1 to 2, leader changed from 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67) to c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66). New cstate: current_term: 2 leader_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:13.519662 28444 raft_consensus.cc:993] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50: : Instructing follower c3abf1e576bb4f2bb5325812e8a63d79 to start an election
I20260203 09:16:13.520386 28462 raft_consensus.cc:1081] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 1 LEADER]: Signalling peer c3abf1e576bb4f2bb5325812e8a63d79 to start an election
I20260203 09:16:13.521924 28300 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "bef87f4cbe204179ae62b2c0fcf03c52"
dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
from {username='slave'} at 127.0.0.1:59268
I20260203 09:16:13.522387 28300 raft_consensus.cc:493] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:16:13.522743 28300 raft_consensus.cc:3060] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:13.527701 28300 raft_consensus.cc:515] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.529397 28300 leader_election.cc:290] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [CANDIDATE]: Term 2 election: Requested vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:13.530287 28226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bef87f4cbe204179ae62b2c0fcf03c52" candidate_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4961439bc01640ccb052971bca67aa50"
I20260203 09:16:13.530373 28377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bef87f4cbe204179ae62b2c0fcf03c52" candidate_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
I20260203 09:16:13.530799 28226 raft_consensus.cc:3055] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:16:13.530920 28377 raft_consensus.cc:3060] T bef87f4cbe204179ae62b2c0fcf03c52 P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:13.531097 28226 raft_consensus.cc:740] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Running, Role: LEADER
I20260203 09:16:13.531824 28226 consensus_queue.cc:260] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.532770 28226 raft_consensus.cc:3060] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:13.535655 28377 raft_consensus.cc:2468] T bef87f4cbe204179ae62b2c0fcf03c52 P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3abf1e576bb4f2bb5325812e8a63d79 in term 2.
I20260203 09:16:13.536558 28267 leader_election.cc:304] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, c3abf1e576bb4f2bb5325812e8a63d79; no voters:
I20260203 09:16:13.537238 28434 raft_consensus.cc:2804] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:16:13.537395 28226 raft_consensus.cc:2468] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3abf1e576bb4f2bb5325812e8a63d79 in term 2.
I20260203 09:16:13.537727 28434 raft_consensus.cc:697] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 LEADER]: Becoming Leader. State: Replica: c3abf1e576bb4f2bb5325812e8a63d79, State: Running, Role: LEADER
I20260203 09:16:13.538647 28434 consensus_queue.cc:237] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.544451 28118 catalog_manager.cc:5654] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 reported cstate change: term changed from 1 to 2, leader changed from 4961439bc01640ccb052971bca67aa50 (127.26.232.65) to c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66). New cstate: current_term: 2 leader_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:13.690092 28432 raft_consensus.cc:993] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238: : Instructing follower 4961439bc01640ccb052971bca67aa50 to start an election
I20260203 09:16:13.690598 28429 raft_consensus.cc:1081] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Signalling peer 4961439bc01640ccb052971bca67aa50 to start an election
I20260203 09:16:13.692178 28226 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "cb7d38bef7ee47c1ade9124f4362d083"
dest_uuid: "4961439bc01640ccb052971bca67aa50"
from {username='slave'} at 127.0.0.1:36892
I20260203 09:16:13.692858 28226 raft_consensus.cc:493] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:16:13.693130 28226 raft_consensus.cc:3060] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:13.697772 28226 raft_consensus.cc:515] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.699170 28226 leader_election.cc:290] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 2 election: Requested vote from peers c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:13.700107 28300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb7d38bef7ee47c1ade9124f4362d083" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
I20260203 09:16:13.700193 28377 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb7d38bef7ee47c1ade9124f4362d083" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
I20260203 09:16:13.700551 28300 raft_consensus.cc:3060] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:13.700737 28377 raft_consensus.cc:3055] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:16:13.701073 28377 raft_consensus.cc:740] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Running, Role: LEADER
I20260203 09:16:13.701725 28377 consensus_queue.cc:260] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.702646 28377 raft_consensus.cc:3060] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:13.705284 28300 raft_consensus.cc:2468] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 2.
I20260203 09:16:13.706305 28189 leader_election.cc:304] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4961439bc01640ccb052971bca67aa50, c3abf1e576bb4f2bb5325812e8a63d79; no voters:
I20260203 09:16:13.706961 28462 raft_consensus.cc:2804] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:16:13.707428 28462 raft_consensus.cc:697] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [term 2 LEADER]: Becoming Leader. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Running, Role: LEADER
I20260203 09:16:13.707705 28377 raft_consensus.cc:2468] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 2.
I20260203 09:16:13.708192 28462 consensus_queue.cc:237] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:13.714566 28118 catalog_manager.cc:5654] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 reported cstate change: term changed from 1 to 2, leader changed from 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67) to 4961439bc01640ccb052971bca67aa50 (127.26.232.65). New cstate: current_term: 2 leader_uuid: "4961439bc01640ccb052971bca67aa50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:13.739915 28226 raft_consensus.cc:1275] T 67eea80e9038484c98bbc3837d24448f P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Refusing update from remote peer c3abf1e576bb4f2bb5325812e8a63d79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:13.741133 28434 consensus_queue.cc:1048] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:13.750324 28377 raft_consensus.cc:1275] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Refusing update from remote peer c3abf1e576bb4f2bb5325812e8a63d79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:13.751859 28503 consensus_queue.cc:1048] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:13.771070 28377 raft_consensus.cc:3060] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:13.776268 28377 raft_consensus.cc:1275] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Refusing update from remote peer c3abf1e576bb4f2bb5325812e8a63d79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:13.777734 28503 consensus_queue.cc:1048] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:13.786706 28226 raft_consensus.cc:1275] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Refusing update from remote peer c3abf1e576bb4f2bb5325812e8a63d79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:13.788170 28503 consensus_queue.cc:1048] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:13.788580 28300 raft_consensus.cc:3060] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:13.797186 28300 raft_consensus.cc:1275] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Refusing update from remote peer 4961439bc01640ccb052971bca67aa50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:13.798477 28462 consensus_queue.cc:1048] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:13.808077 28377 raft_consensus.cc:1275] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Refusing update from remote peer 4961439bc01640ccb052971bca67aa50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:13.809268 28496 consensus_queue.cc:1048] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:13.832212 28377 raft_consensus.cc:1275] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Refusing update from remote peer 4961439bc01640ccb052971bca67aa50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:13.833339 28496 consensus_queue.cc:1048] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:13.840253 28300 raft_consensus.cc:1275] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Refusing update from remote peer 4961439bc01640ccb052971bca67aa50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:13.841701 28456 consensus_queue.cc:1048] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:13.924810 28377 raft_consensus.cc:1275] T bef87f4cbe204179ae62b2c0fcf03c52 P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Refusing update from remote peer c3abf1e576bb4f2bb5325812e8a63d79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:13.926007 28503 consensus_queue.cc:1048] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:13.932960 28226 raft_consensus.cc:1275] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Refusing update from remote peer c3abf1e576bb4f2bb5325812e8a63d79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:13.934841 28434 consensus_queue.cc:1048] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:13.970584 28226 raft_consensus.cc:1275] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Refusing update from remote peer 19934d0e5f7d41a198ef452237e6a238: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:13.971861 28429 consensus_queue.cc:1048] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:13.978718 28300 raft_consensus.cc:1275] T c6875bd2def54a3daaa4149c7ced68ef P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Refusing update from remote peer 19934d0e5f7d41a198ef452237e6a238: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:13.980269 28421 consensus_queue.cc:1048] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:14.004149 28226 raft_consensus.cc:3060] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:14.006635 28377 raft_consensus.cc:1275] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Refusing update from remote peer c3abf1e576bb4f2bb5325812e8a63d79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:14.007967 28434 consensus_queue.cc:1048] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:14.011150 28226 raft_consensus.cc:1275] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Refusing update from remote peer c3abf1e576bb4f2bb5325812e8a63d79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:14.012452 28434 consensus_queue.cc:1048] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:14.265627 28300 raft_consensus.cc:1275] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Refusing update from remote peer 4961439bc01640ccb052971bca67aa50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:14.267042 28444 consensus_queue.cc:1048] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:14.276809 28376 raft_consensus.cc:1275] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Refusing update from remote peer 4961439bc01640ccb052971bca67aa50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:14.278240 28456 consensus_queue.cc:1048] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260203 09:16:16.241146 28153 debug-util.cc:398] Leaking SignalData structure 0x7b0800056260 after lost signal to thread 27556
W20260203 09:16:16.241963 28153 debug-util.cc:398] Leaking SignalData structure 0x7b0800056940 after lost signal to thread 28156
W20260203 09:16:16.242758 28153 debug-util.cc:398] Leaking SignalData structure 0x7b08000bede0 after lost signal to thread 28250
W20260203 09:16:16.243472 28153 debug-util.cc:398] Leaking SignalData structure 0x7b08001aac40 after lost signal to thread 28326
W20260203 09:16:16.244174 28153 debug-util.cc:398] Leaking SignalData structure 0x7b08001bd3c0 after lost signal to thread 28401
I20260203 09:16:16.389664 27553 auto_leader_rebalancer-test.cc:343] The leader distribution is
I20260203 09:16:16.390530 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:16.419865 28225 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "2d01575aefc8413993898b91f0ee2881"
dest_uuid: "4961439bc01640ccb052971bca67aa50"
mode: GRACEFUL
new_leader_uuid: "19934d0e5f7d41a198ef452237e6a238"
from {username='slave'} at 127.0.0.1:37006
I20260203 09:16:16.420377 28225 raft_consensus.cc:606] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 2 LEADER]: Received request to transfer leadership to TS 19934d0e5f7d41a198ef452237e6a238
I20260203 09:16:16.422833 28225 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "feb960bd17de4e2bb654b6a5a87c4d43"
dest_uuid: "4961439bc01640ccb052971bca67aa50"
mode: GRACEFUL
new_leader_uuid: "19934d0e5f7d41a198ef452237e6a238"
from {username='slave'} at 127.0.0.1:37006
I20260203 09:16:16.423336 28225 raft_consensus.cc:606] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 2 LEADER]: Received request to transfer leadership to TS 19934d0e5f7d41a198ef452237e6a238
I20260203 09:16:16.424528 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260203 09:16:16.425076 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:16.809676 28456 raft_consensus.cc:993] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50: : Instructing follower 19934d0e5f7d41a198ef452237e6a238 to start an election
I20260203 09:16:16.810110 28456 raft_consensus.cc:1081] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 2 LEADER]: Signalling peer 19934d0e5f7d41a198ef452237e6a238 to start an election
I20260203 09:16:16.811403 28374 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "2d01575aefc8413993898b91f0ee2881"
dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
from {username='slave'} at 127.0.0.1:44338
I20260203 09:16:16.811841 28374 raft_consensus.cc:493] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:16:16.812105 28374 raft_consensus.cc:3060] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:16:16.817083 28374 raft_consensus.cc:515] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:16.818632 28374 leader_election.cc:290] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 3 election: Requested vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787)
I20260203 09:16:16.819814 28300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d01575aefc8413993898b91f0ee2881" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
I20260203 09:16:16.820012 28225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d01575aefc8413993898b91f0ee2881" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4961439bc01640ccb052971bca67aa50"
I20260203 09:16:16.820281 28300 raft_consensus.cc:3060] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:16:16.820621 28225 raft_consensus.cc:3055] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:16:16.820987 28225 raft_consensus.cc:740] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Running, Role: LEADER
I20260203 09:16:16.821897 28225 consensus_queue.cc:260] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:16.823127 28225 raft_consensus.cc:3060] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:16:16.826229 28300 raft_consensus.cc:2468] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19934d0e5f7d41a198ef452237e6a238 in term 3.
I20260203 09:16:16.827780 28341 leader_election.cc:304] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, c3abf1e576bb4f2bb5325812e8a63d79; no voters:
I20260203 09:16:16.828585 28508 raft_consensus.cc:2804] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:16:16.829828 28508 raft_consensus.cc:697] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 3 LEADER]: Becoming Leader. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Running, Role: LEADER
I20260203 09:16:16.830394 28225 raft_consensus.cc:2468] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19934d0e5f7d41a198ef452237e6a238 in term 3.
I20260203 09:16:16.830636 28508 consensus_queue.cc:237] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:16.840087 28119 catalog_manager.cc:5654] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 reported cstate change: term changed from 2 to 3, leader changed from 4961439bc01640ccb052971bca67aa50 (127.26.232.65) to 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67). New cstate: current_term: 3 leader_uuid: "19934d0e5f7d41a198ef452237e6a238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:16.938323 28517 raft_consensus.cc:993] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50: : Instructing follower 19934d0e5f7d41a198ef452237e6a238 to start an election
I20260203 09:16:16.938757 28456 raft_consensus.cc:1081] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 2 LEADER]: Signalling peer 19934d0e5f7d41a198ef452237e6a238 to start an election
I20260203 09:16:16.940299 28374 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "feb960bd17de4e2bb654b6a5a87c4d43"
dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
from {username='slave'} at 127.0.0.1:44338
I20260203 09:16:16.940793 28374 raft_consensus.cc:493] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:16:16.941072 28374 raft_consensus.cc:3060] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:16:16.946214 28374 raft_consensus.cc:515] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } }
I20260203 09:16:16.948215 28374 leader_election.cc:290] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 3 election: Requested vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787)
I20260203 09:16:16.949494 28225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "feb960bd17de4e2bb654b6a5a87c4d43" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4961439bc01640ccb052971bca67aa50"
I20260203 09:16:16.949520 28299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "feb960bd17de4e2bb654b6a5a87c4d43" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
I20260203 09:16:16.950384 28299 raft_consensus.cc:3060] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:16:16.950347 28225 raft_consensus.cc:3055] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:16:16.950922 28225 raft_consensus.cc:740] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Running, Role: LEADER
I20260203 09:16:16.951807 28225 consensus_queue.cc:260] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } }
I20260203 09:16:16.953202 28225 raft_consensus.cc:3060] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:16:16.959025 28299 raft_consensus.cc:2468] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19934d0e5f7d41a198ef452237e6a238 in term 3.
I20260203 09:16:16.960206 28341 leader_election.cc:304] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, c3abf1e576bb4f2bb5325812e8a63d79; no voters:
I20260203 09:16:16.961174 28508 raft_consensus.cc:2804] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:16:16.961629 28508 raft_consensus.cc:697] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 3 LEADER]: Becoming Leader. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Running, Role: LEADER
I20260203 09:16:16.961863 28225 raft_consensus.cc:2468] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19934d0e5f7d41a198ef452237e6a238 in term 3.
I20260203 09:16:16.962411 28508 consensus_queue.cc:237] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } }
I20260203 09:16:16.969414 28119 catalog_manager.cc:5654] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 reported cstate change: term changed from 2 to 3, leader changed from 4961439bc01640ccb052971bca67aa50 (127.26.232.65) to 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67). New cstate: current_term: 3 leader_uuid: "19934d0e5f7d41a198ef452237e6a238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:17.278044 28300 raft_consensus.cc:1275] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79 [term 3 FOLLOWER]: Refusing update from remote peer 19934d0e5f7d41a198ef452237e6a238: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:16:17.279165 28508 consensus_queue.cc:1048] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:16:17.303283 28225 raft_consensus.cc:1275] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 3 FOLLOWER]: Refusing update from remote peer 19934d0e5f7d41a198ef452237e6a238: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:16:17.308238 28528 consensus_queue.cc:1048] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:16:17.426307 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:17.431838 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:17.432260 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:17.503949 28300 raft_consensus.cc:1275] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79 [term 3 FOLLOWER]: Refusing update from remote peer 19934d0e5f7d41a198ef452237e6a238: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:16:17.505089 28508 consensus_queue.cc:1048] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:16:17.513442 28225 raft_consensus.cc:1275] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 3 FOLLOWER]: Refusing update from remote peer 19934d0e5f7d41a198ef452237e6a238: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:16:17.515089 28528 consensus_queue.cc:1048] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:16:18.433512 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:18.440296 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:18.440773 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:19.441602 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:19.447016 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:19.447517 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:20.448634 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:20.455307 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:20.455724 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:21.457003 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:21.462637 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:21.463068 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:22.464133 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:22.472160 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:22.472735 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:23.473663 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:23.478929 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:23.479317 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:24.480161 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:24.485335 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:24.485860 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:25.486804 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:25.492993 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:25.493388 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:26.524672 27553 auto_leader_rebalancer-test.cc:362] The leader distribution is
I20260203 09:16:26.529541 28375 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "feb960bd17de4e2bb654b6a5a87c4d43"
dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
mode: GRACEFUL
new_leader_uuid: "4961439bc01640ccb052971bca67aa50"
from {username='slave'} at 127.0.0.1:44358
I20260203 09:16:26.530457 28375 raft_consensus.cc:606] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 3 LEADER]: Received request to transfer leadership to TS 4961439bc01640ccb052971bca67aa50
I20260203 09:16:26.543721 28375 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "2d01575aefc8413993898b91f0ee2881"
dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
mode: GRACEFUL
new_leader_uuid: "4961439bc01640ccb052971bca67aa50"
from {username='slave'} at 127.0.0.1:44358
I20260203 09:16:26.544250 28375 raft_consensus.cc:606] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 3 LEADER]: Received request to transfer leadership to TS 4961439bc01640ccb052971bca67aa50
I20260203 09:16:26.566776 28300 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "749653feb73c4b79a3d9adf185404a54"
dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
mode: GRACEFUL
new_leader_uuid: "4961439bc01640ccb052971bca67aa50"
from {username='slave'} at 127.0.0.1:35032
I20260203 09:16:26.567270 28300 raft_consensus.cc:606] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 LEADER]: Received request to transfer leadership to TS 4961439bc01640ccb052971bca67aa50
I20260203 09:16:26.573133 28300 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "bef87f4cbe204179ae62b2c0fcf03c52"
dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
mode: GRACEFUL
new_leader_uuid: "4961439bc01640ccb052971bca67aa50"
from {username='slave'} at 127.0.0.1:35032
I20260203 09:16:26.573702 28300 raft_consensus.cc:606] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 LEADER]: Received request to transfer leadership to TS 4961439bc01640ccb052971bca67aa50
I20260203 09:16:26.578783 28300 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "7475c49386954b638b459eed5689e758"
dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
mode: GRACEFUL
new_leader_uuid: "4961439bc01640ccb052971bca67aa50"
from {username='slave'} at 127.0.0.1:35032
I20260203 09:16:26.579192 28300 raft_consensus.cc:606] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 LEADER]: Received request to transfer leadership to TS 4961439bc01640ccb052971bca67aa50
I20260203 09:16:26.604624 28508 raft_consensus.cc:993] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238: : Instructing follower 4961439bc01640ccb052971bca67aa50 to start an election
I20260203 09:16:26.605023 28508 raft_consensus.cc:1081] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 3 LEADER]: Signalling peer 4961439bc01640ccb052971bca67aa50 to start an election
I20260203 09:16:26.606403 28226 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "feb960bd17de4e2bb654b6a5a87c4d43"
dest_uuid: "4961439bc01640ccb052971bca67aa50"
from {username='slave'} at 127.0.0.1:36892
I20260203 09:16:26.606801 28226 raft_consensus.cc:493] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:16:26.607062 28226 raft_consensus.cc:3060] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:16:26.612422 28226 raft_consensus.cc:515] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } }
I20260203 09:16:26.614084 28226 leader_election.cc:290] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 4 election: Requested vote from peers 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755), c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787)
I20260203 09:16:26.615190 28300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "feb960bd17de4e2bb654b6a5a87c4d43" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
I20260203 09:16:26.615268 28375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "feb960bd17de4e2bb654b6a5a87c4d43" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
I20260203 09:16:26.616016 28300 raft_consensus.cc:3060] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79 [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:16:26.616174 28375 raft_consensus.cc:3055] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:16:26.616751 28375 raft_consensus.cc:740] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Running, Role: LEADER
I20260203 09:16:26.617646 28375 consensus_queue.cc:260] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } }
I20260203 09:16:26.618636 28375 raft_consensus.cc:3060] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:16:26.620616 28300 raft_consensus.cc:2468] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 4.
I20260203 09:16:26.621791 28189 leader_election.cc:304] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4961439bc01640ccb052971bca67aa50, c3abf1e576bb4f2bb5325812e8a63d79; no voters:
I20260203 09:16:26.622790 28538 raft_consensus.cc:2804] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:16:26.623799 28538 raft_consensus.cc:697] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 4 LEADER]: Becoming Leader. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Running, Role: LEADER
I20260203 09:16:26.623966 28375 raft_consensus.cc:2468] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 4.
I20260203 09:16:26.624831 28538 consensus_queue.cc:237] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } }
I20260203 09:16:26.631870 28118 catalog_manager.cc:5654] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 reported cstate change: term changed from 3 to 4, leader changed from 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67) to 4961439bc01640ccb052971bca67aa50 (127.26.232.65). New cstate: current_term: 4 leader_uuid: "4961439bc01640ccb052971bca67aa50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:26.705122 28537 raft_consensus.cc:993] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79: : Instructing follower 4961439bc01640ccb052971bca67aa50 to start an election
I20260203 09:16:26.705600 28549 raft_consensus.cc:1081] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 LEADER]: Signalling peer 4961439bc01640ccb052971bca67aa50 to start an election
I20260203 09:16:26.706971 28226 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "7475c49386954b638b459eed5689e758"
dest_uuid: "4961439bc01640ccb052971bca67aa50"
from {username='slave'} at 127.0.0.1:36902
I20260203 09:16:26.707384 28226 raft_consensus.cc:493] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:16:26.707638 28226 raft_consensus.cc:3060] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:16:26.711813 28226 raft_consensus.cc:515] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:26.713148 28226 leader_election.cc:290] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 3 election: Requested vote from peers c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:26.713874 28300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7475c49386954b638b459eed5689e758" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
I20260203 09:16:26.714356 28300 raft_consensus.cc:3055] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:16:26.714195 28375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7475c49386954b638b459eed5689e758" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
I20260203 09:16:26.714633 28300 raft_consensus.cc:740] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c3abf1e576bb4f2bb5325812e8a63d79, State: Running, Role: LEADER
I20260203 09:16:26.714820 28375 raft_consensus.cc:3060] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:16:26.715284 28300 consensus_queue.cc:260] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:26.716122 28300 raft_consensus.cc:3060] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:16:26.719393 28375 raft_consensus.cc:2468] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 3.
I20260203 09:16:26.720003 28300 raft_consensus.cc:2468] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 3.
I20260203 09:16:26.720487 28191 leader_election.cc:304] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50; no voters:
I20260203 09:16:26.721243 28538 raft_consensus.cc:2804] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50 [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:16:26.721602 28538 raft_consensus.cc:697] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50 [term 3 LEADER]: Becoming Leader. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Running, Role: LEADER
I20260203 09:16:26.722333 28538 consensus_queue.cc:237] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:26.728663 28118 catalog_manager.cc:5654] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50 reported cstate change: term changed from 2 to 3, leader changed from c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66) to 4961439bc01640ccb052971bca67aa50 (127.26.232.65). New cstate: current_term: 3 leader_uuid: "4961439bc01640ccb052971bca67aa50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:26.742432 28537 raft_consensus.cc:993] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79: : Instructing follower 4961439bc01640ccb052971bca67aa50 to start an election
I20260203 09:16:26.742847 28549 raft_consensus.cc:1081] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 LEADER]: Signalling peer 4961439bc01640ccb052971bca67aa50 to start an election
I20260203 09:16:26.744235 28226 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "bef87f4cbe204179ae62b2c0fcf03c52"
dest_uuid: "4961439bc01640ccb052971bca67aa50"
from {username='slave'} at 127.0.0.1:36902
I20260203 09:16:26.744690 28226 raft_consensus.cc:493] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:16:26.744954 28226 raft_consensus.cc:3060] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:16:26.749851 28226 raft_consensus.cc:515] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:26.751216 28226 leader_election.cc:290] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 3 election: Requested vote from peers c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:26.752163 28300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bef87f4cbe204179ae62b2c0fcf03c52" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
I20260203 09:16:26.752312 28375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bef87f4cbe204179ae62b2c0fcf03c52" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
I20260203 09:16:26.752664 28300 raft_consensus.cc:3055] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:16:26.752779 28375 raft_consensus.cc:3060] T bef87f4cbe204179ae62b2c0fcf03c52 P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:16:26.752926 28300 raft_consensus.cc:740] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c3abf1e576bb4f2bb5325812e8a63d79, State: Running, Role: LEADER
I20260203 09:16:26.753598 28300 consensus_queue.cc:260] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:26.754406 28300 raft_consensus.cc:3060] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:16:26.757475 28375 raft_consensus.cc:2468] T bef87f4cbe204179ae62b2c0fcf03c52 P 19934d0e5f7d41a198ef452237e6a238 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 3.
I20260203 09:16:26.758419 28300 raft_consensus.cc:2468] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 3.
I20260203 09:16:26.758419 28191 leader_election.cc:304] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, 4961439bc01640ccb052971bca67aa50; no voters:
I20260203 09:16:26.759301 28538 raft_consensus.cc:2804] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:16:26.759690 28538 raft_consensus.cc:697] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 3 LEADER]: Becoming Leader. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Running, Role: LEADER
I20260203 09:16:26.760311 28538 consensus_queue.cc:237] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:26.766548 28118 catalog_manager.cc:5654] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 reported cstate change: term changed from 2 to 3, leader changed from c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66) to 4961439bc01640ccb052971bca67aa50 (127.26.232.65). New cstate: current_term: 3 leader_uuid: "4961439bc01640ccb052971bca67aa50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:26.928721 28542 raft_consensus.cc:993] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238: : Instructing follower 4961439bc01640ccb052971bca67aa50 to start an election
I20260203 09:16:26.929138 28508 raft_consensus.cc:1081] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 3 LEADER]: Signalling peer 4961439bc01640ccb052971bca67aa50 to start an election
I20260203 09:16:26.931032 28226 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "2d01575aefc8413993898b91f0ee2881"
dest_uuid: "4961439bc01640ccb052971bca67aa50"
from {username='slave'} at 127.0.0.1:36892
I20260203 09:16:26.931450 28226 raft_consensus.cc:493] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:16:26.931699 28226 raft_consensus.cc:3060] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:16:26.936866 28226 raft_consensus.cc:515] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:26.938174 28226 leader_election.cc:290] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 4 election: Requested vote from peers c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:26.939016 28300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d01575aefc8413993898b91f0ee2881" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
I20260203 09:16:26.939118 28375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d01575aefc8413993898b91f0ee2881" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
I20260203 09:16:26.939469 28300 raft_consensus.cc:3060] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79 [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:16:26.939603 28375 raft_consensus.cc:3055] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:16:26.939918 28375 raft_consensus.cc:740] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Running, Role: LEADER
I20260203 09:16:26.940549 28375 consensus_queue.cc:260] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:26.941506 28375 raft_consensus.cc:3060] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:16:26.944875 28300 raft_consensus.cc:2468] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 4.
I20260203 09:16:26.945807 28189 leader_election.cc:304] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4961439bc01640ccb052971bca67aa50, c3abf1e576bb4f2bb5325812e8a63d79; no voters:
I20260203 09:16:26.946647 28538 raft_consensus.cc:2804] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:16:26.946611 28375 raft_consensus.cc:2468] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 4.
I20260203 09:16:26.947160 28538 raft_consensus.cc:697] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 4 LEADER]: Becoming Leader. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Running, Role: LEADER
I20260203 09:16:26.948057 28538 consensus_queue.cc:237] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:26.955036 28118 catalog_manager.cc:5654] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 reported cstate change: term changed from 3 to 4, leader changed from 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67) to 4961439bc01640ccb052971bca67aa50 (127.26.232.65). New cstate: current_term: 4 leader_uuid: "4961439bc01640ccb052971bca67aa50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:27.014346 28537 raft_consensus.cc:993] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79: : Instructing follower 4961439bc01640ccb052971bca67aa50 to start an election
I20260203 09:16:27.014814 28549 raft_consensus.cc:1081] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 LEADER]: Signalling peer 4961439bc01640ccb052971bca67aa50 to start an election
I20260203 09:16:27.016186 28226 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "749653feb73c4b79a3d9adf185404a54"
dest_uuid: "4961439bc01640ccb052971bca67aa50"
from {username='slave'} at 127.0.0.1:36902
I20260203 09:16:27.016724 28226 raft_consensus.cc:493] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:16:27.016993 28226 raft_consensus.cc:3060] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:16:27.021061 28226 raft_consensus.cc:515] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:27.022492 28226 leader_election.cc:290] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 3 election: Requested vote from peers c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:27.023284 28300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "749653feb73c4b79a3d9adf185404a54" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
I20260203 09:16:27.023447 28375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "749653feb73c4b79a3d9adf185404a54" candidate_uuid: "4961439bc01640ccb052971bca67aa50" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
I20260203 09:16:27.023746 28300 raft_consensus.cc:3055] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:16:27.023938 28375 raft_consensus.cc:3060] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:16:27.024042 28300 raft_consensus.cc:740] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c3abf1e576bb4f2bb5325812e8a63d79, State: Running, Role: LEADER
I20260203 09:16:27.024713 28300 consensus_queue.cc:260] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:27.025561 28300 raft_consensus.cc:3060] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:16:27.029696 28300 raft_consensus.cc:2468] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 3.
I20260203 09:16:27.029722 28375 raft_consensus.cc:2468] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4961439bc01640ccb052971bca67aa50 in term 3.
I20260203 09:16:27.030946 28189 leader_election.cc:304] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4961439bc01640ccb052971bca67aa50, c3abf1e576bb4f2bb5325812e8a63d79; no voters:
I20260203 09:16:27.031715 28538 raft_consensus.cc:2804] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:16:27.031872 28375 raft_consensus.cc:1275] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 4 FOLLOWER]: Refusing update from remote peer 4961439bc01640ccb052971bca67aa50: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260203 09:16:27.032181 28538 raft_consensus.cc:697] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 3 LEADER]: Becoming Leader. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Running, Role: LEADER
I20260203 09:16:27.033063 28538 consensus_queue.cc:237] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:27.033227 28543 consensus_queue.cc:1048] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:16:27.040669 28118 catalog_manager.cc:5654] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 reported cstate change: term changed from 2 to 3, leader changed from c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66) to 4961439bc01640ccb052971bca67aa50 (127.26.232.65). New cstate: current_term: 3 leader_uuid: "4961439bc01640ccb052971bca67aa50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:27.046999 28300 raft_consensus.cc:1275] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79 [term 4 FOLLOWER]: Refusing update from remote peer 4961439bc01640ccb052971bca67aa50: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260203 09:16:27.052933 28538 consensus_queue.cc:1048] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:16:27.115614 28300 raft_consensus.cc:1275] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [term 3 FOLLOWER]: Refusing update from remote peer 4961439bc01640ccb052971bca67aa50: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:16:27.116879 28538 consensus_queue.cc:1048] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:16:27.125713 28375 raft_consensus.cc:1275] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [term 3 FOLLOWER]: Refusing update from remote peer 4961439bc01640ccb052971bca67aa50: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:16:27.126974 28538 consensus_queue.cc:1048] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:16:27.200771 28375 raft_consensus.cc:1275] T bef87f4cbe204179ae62b2c0fcf03c52 P 19934d0e5f7d41a198ef452237e6a238 [term 3 FOLLOWER]: Refusing update from remote peer 4961439bc01640ccb052971bca67aa50: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:16:27.201927 28538 consensus_queue.cc:1048] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:16:27.210526 28299 raft_consensus.cc:1275] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [term 3 FOLLOWER]: Refusing update from remote peer 4961439bc01640ccb052971bca67aa50: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:16:27.212105 28538 consensus_queue.cc:1048] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:16:27.387091 28299 raft_consensus.cc:1275] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79 [term 4 FOLLOWER]: Refusing update from remote peer 4961439bc01640ccb052971bca67aa50: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260203 09:16:27.388271 28538 consensus_queue.cc:1048] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:16:27.398090 28375 raft_consensus.cc:1275] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 4 FOLLOWER]: Refusing update from remote peer 4961439bc01640ccb052971bca67aa50: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260203 09:16:27.400262 28565 consensus_queue.cc:1048] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:16:27.422545 28375 raft_consensus.cc:1275] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 [term 3 FOLLOWER]: Refusing update from remote peer 4961439bc01640ccb052971bca67aa50: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:16:27.423940 28565 consensus_queue.cc:1048] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:16:27.434505 28299 raft_consensus.cc:1275] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [term 3 FOLLOWER]: Refusing update from remote peer 4961439bc01640ccb052971bca67aa50: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:16:27.436144 28565 consensus_queue.cc:1048] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:16:29.622464 27553 auto_leader_rebalancer-test.cc:377] The leader distribution is
I20260203 09:16:29.623128 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:29.630239 28226 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "749653feb73c4b79a3d9adf185404a54"
dest_uuid: "4961439bc01640ccb052971bca67aa50"
mode: GRACEFUL
new_leader_uuid: "19934d0e5f7d41a198ef452237e6a238"
from {username='slave'} at 127.0.0.1:37006
I20260203 09:16:29.630780 28226 raft_consensus.cc:606] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 3 LEADER]: Received request to transfer leadership to TS 19934d0e5f7d41a198ef452237e6a238
I20260203 09:16:29.633251 28226 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "cb7d38bef7ee47c1ade9124f4362d083"
dest_uuid: "4961439bc01640ccb052971bca67aa50"
mode: GRACEFUL
new_leader_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
from {username='slave'} at 127.0.0.1:37006
I20260203 09:16:29.633780 28226 raft_consensus.cc:606] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [term 2 LEADER]: Received request to transfer leadership to TS c3abf1e576bb4f2bb5325812e8a63d79
I20260203 09:16:29.636520 28226 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "cd88a45cfab242e58705e11b11875298"
dest_uuid: "4961439bc01640ccb052971bca67aa50"
mode: GRACEFUL
new_leader_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
from {username='slave'} at 127.0.0.1:37006
I20260203 09:16:29.637051 28226 raft_consensus.cc:606] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [term 1 LEADER]: Received request to transfer leadership to TS c3abf1e576bb4f2bb5325812e8a63d79
I20260203 09:16:29.639598 28226 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "feb960bd17de4e2bb654b6a5a87c4d43"
dest_uuid: "4961439bc01640ccb052971bca67aa50"
mode: GRACEFUL
new_leader_uuid: "19934d0e5f7d41a198ef452237e6a238"
from {username='slave'} at 127.0.0.1:37006
I20260203 09:16:29.640105 28226 raft_consensus.cc:606] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 4 LEADER]: Received request to transfer leadership to TS 19934d0e5f7d41a198ef452237e6a238
I20260203 09:16:29.641170 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260203 09:16:29.641665 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:29.718294 28565 raft_consensus.cc:993] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50: : Instructing follower c3abf1e576bb4f2bb5325812e8a63d79 to start an election
I20260203 09:16:29.718762 28538 raft_consensus.cc:1081] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [term 1 LEADER]: Signalling peer c3abf1e576bb4f2bb5325812e8a63d79 to start an election
I20260203 09:16:29.720458 28300 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "cd88a45cfab242e58705e11b11875298"
dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
from {username='slave'} at 127.0.0.1:59268
I20260203 09:16:29.721068 28300 raft_consensus.cc:493] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:16:29.721382 28300 raft_consensus.cc:3060] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:29.726668 28300 raft_consensus.cc:515] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:29.728761 28300 leader_election.cc:290] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79 [CANDIDATE]: Term 2 election: Requested vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:29.729907 28226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd88a45cfab242e58705e11b11875298" candidate_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4961439bc01640ccb052971bca67aa50"
I20260203 09:16:29.729885 28375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd88a45cfab242e58705e11b11875298" candidate_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
I20260203 09:16:29.730495 28226 raft_consensus.cc:3055] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:16:29.730765 28375 raft_consensus.cc:3060] T cd88a45cfab242e58705e11b11875298 P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:29.730799 28226 raft_consensus.cc:740] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Running, Role: LEADER
I20260203 09:16:29.731825 28226 consensus_queue.cc:260] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:29.732894 28226 raft_consensus.cc:3060] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:29.736830 28375 raft_consensus.cc:2468] T cd88a45cfab242e58705e11b11875298 P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3abf1e576bb4f2bb5325812e8a63d79 in term 2.
I20260203 09:16:29.737639 28226 raft_consensus.cc:2468] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3abf1e576bb4f2bb5325812e8a63d79 in term 2.
I20260203 09:16:29.738138 28267 leader_election.cc:304] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, c3abf1e576bb4f2bb5325812e8a63d79; no voters:
I20260203 09:16:29.738996 28549 raft_consensus.cc:2804] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:16:29.739817 28549 raft_consensus.cc:697] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 LEADER]: Becoming Leader. State: Replica: c3abf1e576bb4f2bb5325812e8a63d79, State: Running, Role: LEADER
I20260203 09:16:29.740689 28549 consensus_queue.cc:237] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:29.747041 28118 catalog_manager.cc:5654] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79 reported cstate change: term changed from 1 to 2, leader changed from 4961439bc01640ccb052971bca67aa50 (127.26.232.65) to c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66). New cstate: current_term: 2 leader_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:29.928809 28565 raft_consensus.cc:993] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50: : Instructing follower 19934d0e5f7d41a198ef452237e6a238 to start an election
I20260203 09:16:29.929201 28538 raft_consensus.cc:1081] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 3 LEADER]: Signalling peer 19934d0e5f7d41a198ef452237e6a238 to start an election
I20260203 09:16:29.930454 28375 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "749653feb73c4b79a3d9adf185404a54"
dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
from {username='slave'} at 127.0.0.1:44338
I20260203 09:16:29.930896 28375 raft_consensus.cc:493] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:16:29.931128 28375 raft_consensus.cc:3060] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:16:29.936331 28375 raft_consensus.cc:515] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:29.938223 28375 leader_election.cc:290] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 4 election: Requested vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787)
I20260203 09:16:29.939034 28226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "749653feb73c4b79a3d9adf185404a54" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4961439bc01640ccb052971bca67aa50"
I20260203 09:16:29.939256 28300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "749653feb73c4b79a3d9adf185404a54" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
I20260203 09:16:29.939524 28226 raft_consensus.cc:3055] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:16:29.939749 28300 raft_consensus.cc:3060] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:16:29.939798 28226 raft_consensus.cc:740] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Running, Role: LEADER
I20260203 09:16:29.940513 28226 consensus_queue.cc:260] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:29.941367 28226 raft_consensus.cc:3060] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:16:29.944697 28300 raft_consensus.cc:2468] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19934d0e5f7d41a198ef452237e6a238 in term 4.
I20260203 09:16:29.945444 28226 raft_consensus.cc:2468] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19934d0e5f7d41a198ef452237e6a238 in term 4.
I20260203 09:16:29.945881 28341 leader_election.cc:304] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, c3abf1e576bb4f2bb5325812e8a63d79; no voters:
I20260203 09:16:29.946611 28508 raft_consensus.cc:2804] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:16:29.947638 28508 raft_consensus.cc:697] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 [term 4 LEADER]: Becoming Leader. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Running, Role: LEADER
I20260203 09:16:29.948267 28508 consensus_queue.cc:237] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:29.956117 28118 catalog_manager.cc:5654] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 reported cstate change: term changed from 3 to 4, leader changed from 4961439bc01640ccb052971bca67aa50 (127.26.232.65) to 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67). New cstate: current_term: 4 leader_uuid: "19934d0e5f7d41a198ef452237e6a238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:30.024796 28565 raft_consensus.cc:993] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50: : Instructing follower c3abf1e576bb4f2bb5325812e8a63d79 to start an election
I20260203 09:16:30.025226 28565 raft_consensus.cc:1081] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [term 2 LEADER]: Signalling peer c3abf1e576bb4f2bb5325812e8a63d79 to start an election
I20260203 09:16:30.026551 28300 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "cb7d38bef7ee47c1ade9124f4362d083"
dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
from {username='slave'} at 127.0.0.1:59268
I20260203 09:16:30.026971 28300 raft_consensus.cc:493] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:16:30.027253 28300 raft_consensus.cc:3060] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:16:30.031790 28300 raft_consensus.cc:515] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:30.033268 28300 leader_election.cc:290] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79 [CANDIDATE]: Term 3 election: Requested vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67:37755)
I20260203 09:16:30.034462 28375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb7d38bef7ee47c1ade9124f4362d083" candidate_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
I20260203 09:16:30.034471 28226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb7d38bef7ee47c1ade9124f4362d083" candidate_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4961439bc01640ccb052971bca67aa50"
I20260203 09:16:30.035198 28226 raft_consensus.cc:3055] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:16:30.035478 28226 raft_consensus.cc:740] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Running, Role: LEADER
I20260203 09:16:30.034936 28375 raft_consensus.cc:3060] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:16:30.036137 28226 consensus_queue.cc:260] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:30.037365 28226 raft_consensus.cc:3060] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:16:30.042649 28375 raft_consensus.cc:2468] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3abf1e576bb4f2bb5325812e8a63d79 in term 3.
I20260203 09:16:30.043818 28267 leader_election.cc:304] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, c3abf1e576bb4f2bb5325812e8a63d79; no voters:
I20260203 09:16:30.043938 28226 raft_consensus.cc:2468] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3abf1e576bb4f2bb5325812e8a63d79 in term 3.
I20260203 09:16:30.044731 28549 raft_consensus.cc:2804] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79 [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:16:30.045181 28549 raft_consensus.cc:697] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79 [term 3 LEADER]: Becoming Leader. State: Replica: c3abf1e576bb4f2bb5325812e8a63d79, State: Running, Role: LEADER
I20260203 09:16:30.045966 28549 consensus_queue.cc:237] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } }
I20260203 09:16:30.053828 28118 catalog_manager.cc:5654] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79 reported cstate change: term changed from 2 to 3, leader changed from 4961439bc01640ccb052971bca67aa50 (127.26.232.65) to c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66). New cstate: current_term: 3 leader_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:30.100221 28538 raft_consensus.cc:993] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50: : Instructing follower 19934d0e5f7d41a198ef452237e6a238 to start an election
I20260203 09:16:30.100737 28538 raft_consensus.cc:1081] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 4 LEADER]: Signalling peer 19934d0e5f7d41a198ef452237e6a238 to start an election
I20260203 09:16:30.102108 28375 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "feb960bd17de4e2bb654b6a5a87c4d43"
dest_uuid: "19934d0e5f7d41a198ef452237e6a238"
from {username='slave'} at 127.0.0.1:44338
I20260203 09:16:30.102648 28375 raft_consensus.cc:493] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:16:30.102939 28375 raft_consensus.cc:3060] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:16:30.108093 28375 raft_consensus.cc:515] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } }
I20260203 09:16:30.110621 28375 leader_election.cc:290] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 5 election: Requested vote from peers 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937), c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787)
I20260203 09:16:30.111613 28226 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "feb960bd17de4e2bb654b6a5a87c4d43" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4961439bc01640ccb052971bca67aa50"
I20260203 09:16:30.112017 28300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "feb960bd17de4e2bb654b6a5a87c4d43" candidate_uuid: "19934d0e5f7d41a198ef452237e6a238" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c3abf1e576bb4f2bb5325812e8a63d79"
I20260203 09:16:30.112290 28226 raft_consensus.cc:3055] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 4 LEADER]: Stepping down as leader of term 4
I20260203 09:16:30.112579 28300 raft_consensus.cc:3060] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79 [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:16:30.112617 28226 raft_consensus.cc:740] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4961439bc01640ccb052971bca67aa50, State: Running, Role: LEADER
I20260203 09:16:30.113490 28226 consensus_queue.cc:260] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } }
I20260203 09:16:30.114665 28226 raft_consensus.cc:3060] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:16:30.119685 28300 raft_consensus.cc:2468] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19934d0e5f7d41a198ef452237e6a238 in term 5.
I20260203 09:16:30.120968 28226 raft_consensus.cc:2468] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19934d0e5f7d41a198ef452237e6a238 in term 5.
I20260203 09:16:30.120812 28341 leader_election.cc:304] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19934d0e5f7d41a198ef452237e6a238, c3abf1e576bb4f2bb5325812e8a63d79; no voters:
I20260203 09:16:30.121794 28508 raft_consensus.cc:2804] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 5 FOLLOWER]: Leader election won for term 5
I20260203 09:16:30.122246 28508 raft_consensus.cc:697] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 5 LEADER]: Becoming Leader. State: Replica: 19934d0e5f7d41a198ef452237e6a238, State: Running, Role: LEADER
I20260203 09:16:30.122911 28508 consensus_queue.cc:237] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } }
I20260203 09:16:30.130348 28118 catalog_manager.cc:5654] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 reported cstate change: term changed from 4 to 5, leader changed from 4961439bc01640ccb052971bca67aa50 (127.26.232.65) to 19934d0e5f7d41a198ef452237e6a238 (127.26.232.67). New cstate: current_term: 5 leader_uuid: "19934d0e5f7d41a198ef452237e6a238" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:30.163973 28226 raft_consensus.cc:1275] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Refusing update from remote peer c3abf1e576bb4f2bb5325812e8a63d79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:30.165367 28569 consensus_queue.cc:1048] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:30.177685 28375 raft_consensus.cc:1275] T cd88a45cfab242e58705e11b11875298 P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Refusing update from remote peer c3abf1e576bb4f2bb5325812e8a63d79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:30.179018 28569 consensus_queue.cc:1048] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:30.482591 28300 raft_consensus.cc:1275] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [term 4 FOLLOWER]: Refusing update from remote peer 19934d0e5f7d41a198ef452237e6a238: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260203 09:16:30.484496 28508 consensus_queue.cc:1048] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:16:30.490556 28226 raft_consensus.cc:1275] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [term 3 FOLLOWER]: Refusing update from remote peer c3abf1e576bb4f2bb5325812e8a63d79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:16:30.492976 28569 consensus_queue.cc:1048] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:16:30.503821 28225 raft_consensus.cc:1275] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 4 FOLLOWER]: Refusing update from remote peer 19934d0e5f7d41a198ef452237e6a238: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260203 09:16:30.506095 28587 consensus_queue.cc:1048] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:16:30.525096 28375 raft_consensus.cc:1275] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [term 3 FOLLOWER]: Refusing update from remote peer c3abf1e576bb4f2bb5325812e8a63d79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:16:30.528514 28569 consensus_queue.cc:1048] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19934d0e5f7d41a198ef452237e6a238" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:16:30.573895 28226 raft_consensus.cc:1275] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 5 FOLLOWER]: Refusing update from remote peer 19934d0e5f7d41a198ef452237e6a238: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260203 09:16:30.575678 28587 consensus_queue.cc:1048] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4961439bc01640ccb052971bca67aa50" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 32937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:16:30.590603 28300 raft_consensus.cc:1275] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79 [term 5 FOLLOWER]: Refusing update from remote peer 19934d0e5f7d41a198ef452237e6a238: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260203 09:16:30.591928 28508 consensus_queue.cc:1048] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3abf1e576bb4f2bb5325812e8a63d79" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 36787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260203 09:16:30.642830 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:30.651933 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:30.653102 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:31.654785 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:31.661026 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:31.661449 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:32.662237 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:32.667352 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:32.667768 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:33.668601 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:33.673759 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:33.674150 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:34.675415 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:34.681615 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:34.682044 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:35.682956 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:35.688196 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:35.688666 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:36.689574 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:36.695983 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:36.696676 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:37.697927 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:37.703473 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:37.703896 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:38.704845 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:16:38.710408 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:16:38.710816 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:16:39.744501 27553 auto_leader_rebalancer-test.cc:388] The leader distribution is
I20260203 09:16:39.744999 27553 tablet_server.cc:178] TabletServer@127.26.232.65:0 shutting down...
W20260203 09:16:39.768044 28266 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
I20260203 09:16:39.775471 27553 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260203 09:16:39.776562 27553 tablet_replica.cc:333] T 67eea80e9038484c98bbc3837d24448f P 4961439bc01640ccb052971bca67aa50: stopping tablet replica
I20260203 09:16:39.777547 27553 raft_consensus.cc:2243] T 67eea80e9038484c98bbc3837d24448f P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260203 09:16:39.777927 28266 consensus_peers.cc:597] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79 -> Peer 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937): Couldn't send request to peer 4961439bc01640ccb052971bca67aa50. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:16:39.778156 27553 raft_consensus.cc:2272] T 67eea80e9038484c98bbc3837d24448f P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:39.780845 27553 tablet_replica.cc:333] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50: stopping tablet replica
I20260203 09:16:39.781421 27553 raft_consensus.cc:2243] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:39.781858 27553 raft_consensus.cc:2272] T 749653feb73c4b79a3d9adf185404a54 P 4961439bc01640ccb052971bca67aa50 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:39.783912 27553 tablet_replica.cc:333] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50: stopping tablet replica
I20260203 09:16:39.784539 27553 raft_consensus.cc:2243] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:39.785053 27553 raft_consensus.cc:2272] T c6875bd2def54a3daaa4149c7ced68ef P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:39.787175 27553 tablet_replica.cc:333] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50: stopping tablet replica
I20260203 09:16:39.787669 27553 raft_consensus.cc:2243] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:16:39.788432 27553 raft_consensus.cc:2272] T bef87f4cbe204179ae62b2c0fcf03c52 P 4961439bc01640ccb052971bca67aa50 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:39.791013 27553 tablet_replica.cc:333] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50: stopping tablet replica
I20260203 09:16:39.791714 27553 raft_consensus.cc:2243] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:39.792224 27553 raft_consensus.cc:2272] T cb7d38bef7ee47c1ade9124f4362d083 P 4961439bc01640ccb052971bca67aa50 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:39.794236 27553 tablet_replica.cc:333] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50: stopping tablet replica
I20260203 09:16:39.794798 27553 raft_consensus.cc:2243] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50 [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:16:39.795645 27553 raft_consensus.cc:2272] T 43f348635db64f2dafea2f7ce2f538a5 P 4961439bc01640ccb052971bca67aa50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:39.797547 27553 tablet_replica.cc:333] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50: stopping tablet replica
I20260203 09:16:39.798029 27553 raft_consensus.cc:2243] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:39.798420 27553 raft_consensus.cc:2272] T cd88a45cfab242e58705e11b11875298 P 4961439bc01640ccb052971bca67aa50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:39.800027 27553 tablet_replica.cc:333] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50: stopping tablet replica
I20260203 09:16:39.800491 27553 raft_consensus.cc:2243] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50 [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:16:39.801220 27553 raft_consensus.cc:2272] T 7475c49386954b638b459eed5689e758 P 4961439bc01640ccb052971bca67aa50 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:39.802839 27553 tablet_replica.cc:333] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50: stopping tablet replica
I20260203 09:16:39.803256 27553 raft_consensus.cc:2243] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:16:39.803994 27553 raft_consensus.cc:2272] T 2d01575aefc8413993898b91f0ee2881 P 4961439bc01640ccb052971bca67aa50 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:39.805586 27553 tablet_replica.cc:333] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50: stopping tablet replica
I20260203 09:16:39.805976 27553 raft_consensus.cc:2243] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:39.806341 27553 raft_consensus.cc:2272] T feb960bd17de4e2bb654b6a5a87c4d43 P 4961439bc01640ccb052971bca67aa50 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:39.837584 27553 tablet_server.cc:195] TabletServer@127.26.232.65:0 shutdown complete.
W20260203 09:16:39.842131 28342 consensus_peers.cc:597] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 -> Peer 4961439bc01640ccb052971bca67aa50 (127.26.232.65:32937): Couldn't send request to peer 4961439bc01640ccb052971bca67aa50. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:32937: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:16:39.858250 27553 tablet_server.cc:178] TabletServer@127.26.232.66:0 shutting down...
I20260203 09:16:39.888520 27553 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260203 09:16:39.889231 27553 tablet_replica.cc:333] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79: stopping tablet replica
I20260203 09:16:39.890065 27553 raft_consensus.cc:2243] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:16:39.891093 27553 raft_consensus.cc:2272] T 67eea80e9038484c98bbc3837d24448f P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:39.892908 27553 tablet_replica.cc:333] T c6875bd2def54a3daaa4149c7ced68ef P c3abf1e576bb4f2bb5325812e8a63d79: stopping tablet replica
I20260203 09:16:39.893380 27553 raft_consensus.cc:2243] T c6875bd2def54a3daaa4149c7ced68ef P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:39.893746 27553 raft_consensus.cc:2272] T c6875bd2def54a3daaa4149c7ced68ef P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:39.895376 27553 tablet_replica.cc:333] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79: stopping tablet replica
I20260203 09:16:39.895828 27553 raft_consensus.cc:2243] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:39.896162 27553 raft_consensus.cc:2272] T bef87f4cbe204179ae62b2c0fcf03c52 P c3abf1e576bb4f2bb5325812e8a63d79 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:39.897751 27553 tablet_replica.cc:333] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79: stopping tablet replica
I20260203 09:16:39.898187 27553 raft_consensus.cc:2243] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:39.898511 27553 raft_consensus.cc:2272] T feb960bd17de4e2bb654b6a5a87c4d43 P c3abf1e576bb4f2bb5325812e8a63d79 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:39.899981 27553 tablet_replica.cc:333] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79: stopping tablet replica
I20260203 09:16:39.900432 27553 raft_consensus.cc:2243] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:39.900805 27553 raft_consensus.cc:2272] T 7475c49386954b638b459eed5689e758 P c3abf1e576bb4f2bb5325812e8a63d79 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:39.902720 27553 tablet_replica.cc:333] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79: stopping tablet replica
I20260203 09:16:39.903198 27553 raft_consensus.cc:2243] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:39.903646 27553 raft_consensus.cc:2272] T 2d01575aefc8413993898b91f0ee2881 P c3abf1e576bb4f2bb5325812e8a63d79 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:39.905269 27553 tablet_replica.cc:333] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79: stopping tablet replica
I20260203 09:16:39.905818 27553 raft_consensus.cc:2243] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:39.906216 27553 raft_consensus.cc:2272] T 749653feb73c4b79a3d9adf185404a54 P c3abf1e576bb4f2bb5325812e8a63d79 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:39.907714 27553 tablet_replica.cc:333] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79: stopping tablet replica
I20260203 09:16:39.908155 27553 raft_consensus.cc:2243] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79 [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:16:39.908883 27553 raft_consensus.cc:2272] T cb7d38bef7ee47c1ade9124f4362d083 P c3abf1e576bb4f2bb5325812e8a63d79 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:39.910452 27553 tablet_replica.cc:333] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79: stopping tablet replica
I20260203 09:16:39.910890 27553 raft_consensus.cc:2243] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:16:39.911561 27553 raft_consensus.cc:2272] T cd88a45cfab242e58705e11b11875298 P c3abf1e576bb4f2bb5325812e8a63d79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:39.913297 27553 tablet_replica.cc:333] T 43f348635db64f2dafea2f7ce2f538a5 P c3abf1e576bb4f2bb5325812e8a63d79: stopping tablet replica
I20260203 09:16:39.913715 27553 raft_consensus.cc:2243] T 43f348635db64f2dafea2f7ce2f538a5 P c3abf1e576bb4f2bb5325812e8a63d79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:39.914091 27553 raft_consensus.cc:2272] T 43f348635db64f2dafea2f7ce2f538a5 P c3abf1e576bb4f2bb5325812e8a63d79 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260203 09:16:39.932358 28341 consensus_peers.cc:597] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 -> Peer c3abf1e576bb4f2bb5325812e8a63d79 (127.26.232.66:36787): Couldn't send request to peer c3abf1e576bb4f2bb5325812e8a63d79. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.66:36787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:16:39.943740 27553 tablet_server.cc:195] TabletServer@127.26.232.66:0 shutdown complete.
I20260203 09:16:39.965075 27553 tablet_server.cc:178] TabletServer@127.26.232.67:0 shutting down...
I20260203 09:16:39.992367 27553 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260203 09:16:39.993050 27553 tablet_replica.cc:333] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238: stopping tablet replica
I20260203 09:16:39.993693 27553 raft_consensus.cc:2243] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:16:39.994418 27553 raft_consensus.cc:2272] T 749653feb73c4b79a3d9adf185404a54 P 19934d0e5f7d41a198ef452237e6a238 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:39.996057 27553 tablet_replica.cc:333] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238: stopping tablet replica
I20260203 09:16:39.996536 27553 raft_consensus.cc:2243] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238 [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:16:39.997314 27553 raft_consensus.cc:2272] T c6875bd2def54a3daaa4149c7ced68ef P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:39.998965 27553 tablet_replica.cc:333] T bef87f4cbe204179ae62b2c0fcf03c52 P 19934d0e5f7d41a198ef452237e6a238: stopping tablet replica
I20260203 09:16:39.999429 27553 raft_consensus.cc:2243] T bef87f4cbe204179ae62b2c0fcf03c52 P 19934d0e5f7d41a198ef452237e6a238 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:39.999827 27553 raft_consensus.cc:2272] T bef87f4cbe204179ae62b2c0fcf03c52 P 19934d0e5f7d41a198ef452237e6a238 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:40.001410 27553 tablet_replica.cc:333] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238: stopping tablet replica
I20260203 09:16:40.001932 27553 raft_consensus.cc:2243] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:40.002322 27553 raft_consensus.cc:2272] T 67eea80e9038484c98bbc3837d24448f P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:40.003962 27553 tablet_replica.cc:333] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238: stopping tablet replica
I20260203 09:16:40.004441 27553 raft_consensus.cc:2243] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:40.004856 27553 raft_consensus.cc:2272] T cb7d38bef7ee47c1ade9124f4362d083 P 19934d0e5f7d41a198ef452237e6a238 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:40.006466 27553 tablet_replica.cc:333] T 43f348635db64f2dafea2f7ce2f538a5 P 19934d0e5f7d41a198ef452237e6a238: stopping tablet replica
I20260203 09:16:40.006924 27553 raft_consensus.cc:2243] T 43f348635db64f2dafea2f7ce2f538a5 P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:40.007298 27553 raft_consensus.cc:2272] T 43f348635db64f2dafea2f7ce2f538a5 P 19934d0e5f7d41a198ef452237e6a238 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:40.008957 27553 tablet_replica.cc:333] T cd88a45cfab242e58705e11b11875298 P 19934d0e5f7d41a198ef452237e6a238: stopping tablet replica
I20260203 09:16:40.009462 27553 raft_consensus.cc:2243] T cd88a45cfab242e58705e11b11875298 P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:40.009829 27553 raft_consensus.cc:2272] T cd88a45cfab242e58705e11b11875298 P 19934d0e5f7d41a198ef452237e6a238 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:40.011335 27553 tablet_replica.cc:333] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238: stopping tablet replica
I20260203 09:16:40.011783 27553 raft_consensus.cc:2243] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:40.012243 27553 raft_consensus.cc:2272] T 7475c49386954b638b459eed5689e758 P 19934d0e5f7d41a198ef452237e6a238 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:40.013854 27553 tablet_replica.cc:333] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238: stopping tablet replica
I20260203 09:16:40.014422 27553 raft_consensus.cc:2243] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:40.014914 27553 raft_consensus.cc:2272] T 2d01575aefc8413993898b91f0ee2881 P 19934d0e5f7d41a198ef452237e6a238 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:40.017222 27553 tablet_replica.cc:333] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238: stopping tablet replica
I20260203 09:16:40.018052 27553 raft_consensus.cc:2243] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 5 LEADER]: Raft consensus shutting down.
I20260203 09:16:40.019173 27553 raft_consensus.cc:2272] T feb960bd17de4e2bb654b6a5a87c4d43 P 19934d0e5f7d41a198ef452237e6a238 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:40.050623 27553 tablet_server.cc:195] TabletServer@127.26.232.67:0 shutdown complete.
I20260203 09:16:40.069069 27553 master.cc:561] Master@127.26.232.126:40205 shutting down...
I20260203 09:16:40.089450 27553 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83 [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:16:40.090005 27553 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:40.090312 27553 tablet_replica.cc:333] T 00000000000000000000000000000000 P 957fa947a0e64391972969c3559e0d83: stopping tablet replica
I20260203 09:16:40.128337 27553 master.cc:583] Master@127.26.232.126:40205 shutdown complete.
19934d0e5f7d41a198ef452237e6a238 1
4961439bc01640ccb052971bca67aa50 5
c3abf1e576bb4f2bb5325812e8a63d79 4
19934d0e5f7d41a198ef452237e6a238 3
4961439bc01640ccb052971bca67aa50 3
c3abf1e576bb4f2bb5325812e8a63d79 4
19934d0e5f7d41a198ef452237e6a238 1
4961439bc01640ccb052971bca67aa50 8
c3abf1e576bb4f2bb5325812e8a63d79 1
19934d0e5f7d41a198ef452237e6a238 3
4961439bc01640ccb052971bca67aa50 4
c3abf1e576bb4f2bb5325812e8a63d79 3
[ OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28593 ms)
[ RUN ] LeaderRebalancerTest.AddTserver
I20260203 09:16:40.170444 27553 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.26.232.126:35239
I20260203 09:16:40.171553 27553 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 09:16:40.176967 28609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:16:40.177846 28610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:16:40.178622 27553 server_base.cc:1060] running on GCE node
W20260203 09:16:40.178573 28612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:16:40.179756 27553 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260203 09:16:40.179942 27553 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260203 09:16:40.180089 27553 hybrid_clock.cc:648] HybridClock initialized: now 1770110200180072 us; error 0 us; skew 500 ppm
I20260203 09:16:40.180594 27553 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260203 09:16:40.183175 27553 webserver.cc:492] Webserver started at http://127.26.232.126:39401/ using document root <none> and password file <none>
I20260203 09:16:40.183665 27553 fs_manager.cc:362] Metadata directory not provided
I20260203 09:16:40.183838 27553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 09:16:40.184087 27553 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 09:16:40.185212 27553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/master-0-root/instance:
uuid: "05c246c53fdc4d75bc7c798afa64084f"
format_stamp: "Formatted at 2026-02-03 09:16:40 on dist-test-slave-x12j"
I20260203 09:16:40.189502 27553 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260203 09:16:40.192785 28617 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 09:16:40.193574 27553 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260203 09:16:40.193871 27553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/master-0-root
uuid: "05c246c53fdc4d75bc7c798afa64084f"
format_stamp: "Formatted at 2026-02-03 09:16:40 on dist-test-slave-x12j"
I20260203 09:16:40.194128 27553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 09:16:40.218374 27553 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 09:16:40.219565 27553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 09:16:40.256385 27553 rpc_server.cc:307] RPC server started. Bound to: 127.26.232.126:35239
I20260203 09:16:40.256552 28669 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.232.126:35239 every 8 connection(s)
I20260203 09:16:40.260285 28670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:40.270525 28670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f: Bootstrap starting.
I20260203 09:16:40.275282 28670 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:40.279359 28670 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f: No bootstrap required, opened a new log
I20260203 09:16:40.281404 28670 raft_consensus.cc:359] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05c246c53fdc4d75bc7c798afa64084f" member_type: VOTER }
I20260203 09:16:40.281782 28670 raft_consensus.cc:385] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:40.281961 28670 raft_consensus.cc:740] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05c246c53fdc4d75bc7c798afa64084f, State: Initialized, Role: FOLLOWER
I20260203 09:16:40.282414 28670 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05c246c53fdc4d75bc7c798afa64084f" member_type: VOTER }
I20260203 09:16:40.282812 28670 raft_consensus.cc:399] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260203 09:16:40.282991 28670 raft_consensus.cc:493] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260203 09:16:40.283201 28670 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:40.287665 28670 raft_consensus.cc:515] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05c246c53fdc4d75bc7c798afa64084f" member_type: VOTER }
I20260203 09:16:40.288147 28670 leader_election.cc:304] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05c246c53fdc4d75bc7c798afa64084f; no voters:
I20260203 09:16:40.289223 28670 leader_election.cc:290] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260203 09:16:40.289588 28673 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:40.290838 28673 raft_consensus.cc:697] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f [term 1 LEADER]: Becoming Leader. State: Replica: 05c246c53fdc4d75bc7c798afa64084f, State: Running, Role: LEADER
I20260203 09:16:40.291399 28673 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05c246c53fdc4d75bc7c798afa64084f" member_type: VOTER }
I20260203 09:16:40.292052 28670 sys_catalog.cc:565] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f [sys.catalog]: configured and running, proceeding with master startup.
I20260203 09:16:40.296186 28674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05c246c53fdc4d75bc7c798afa64084f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05c246c53fdc4d75bc7c798afa64084f" member_type: VOTER } }
I20260203 09:16:40.297267 28674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f [sys.catalog]: This master's current role is: LEADER
I20260203 09:16:40.296623 28675 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05c246c53fdc4d75bc7c798afa64084f. Latest consensus state: current_term: 1 leader_uuid: "05c246c53fdc4d75bc7c798afa64084f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05c246c53fdc4d75bc7c798afa64084f" member_type: VOTER } }
I20260203 09:16:40.298779 28675 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f [sys.catalog]: This master's current role is: LEADER
I20260203 09:16:40.299227 28681 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260203 09:16:40.304107 28681 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260203 09:16:40.305697 27553 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260203 09:16:40.312618 28681 catalog_manager.cc:1357] Generated new cluster ID: 2639578ea1b74e64ac04fa7b43d7ed05
I20260203 09:16:40.312940 28681 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260203 09:16:40.332556 28681 catalog_manager.cc:1380] Generated new certificate authority record
I20260203 09:16:40.333832 28681 catalog_manager.cc:1514] Loading token signing keys...
I20260203 09:16:40.351936 28681 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f: Generated new TSK 0
I20260203 09:16:40.352542 28681 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260203 09:16:40.371925 27553 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 09:16:40.377897 28691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:16:40.378896 28692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:16:40.380095 28694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:16:40.380385 27553 server_base.cc:1060] running on GCE node
I20260203 09:16:40.381317 27553 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260203 09:16:40.381493 27553 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260203 09:16:40.381615 27553 hybrid_clock.cc:648] HybridClock initialized: now 1770110200381604 us; error 0 us; skew 500 ppm
I20260203 09:16:40.382077 27553 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260203 09:16:40.384356 27553 webserver.cc:492] Webserver started at http://127.26.232.65:32999/ using document root <none> and password file <none>
I20260203 09:16:40.384850 27553 fs_manager.cc:362] Metadata directory not provided
I20260203 09:16:40.385012 27553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 09:16:40.385221 27553 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 09:16:40.386227 27553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-0-root/instance:
uuid: "847a7af9f0e2497cbb9025cc2c62557e"
format_stamp: "Formatted at 2026-02-03 09:16:40 on dist-test-slave-x12j"
I20260203 09:16:40.390436 27553 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260203 09:16:40.393579 28699 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 09:16:40.394263 27553 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260203 09:16:40.394562 27553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-0-root
uuid: "847a7af9f0e2497cbb9025cc2c62557e"
format_stamp: "Formatted at 2026-02-03 09:16:40 on dist-test-slave-x12j"
I20260203 09:16:40.394824 27553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 09:16:40.437317 27553 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 09:16:40.439137 27553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 09:16:40.440852 27553 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260203 09:16:40.443477 27553 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260203 09:16:40.443682 27553 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260203 09:16:40.443933 27553 ts_tablet_manager.cc:616] Registered 0 tablets
I20260203 09:16:40.444087 27553 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260203 09:16:40.486213 27553 rpc_server.cc:307] RPC server started. Bound to: 127.26.232.65:37967
I20260203 09:16:40.486372 28762 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.232.65:37967 every 8 connection(s)
I20260203 09:16:40.493135 27553 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 09:16:40.501166 28767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:16:40.502969 28768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:16:40.504318 28770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:16:40.506631 28763 heartbeater.cc:344] Connected to a master server at 127.26.232.126:35239
I20260203 09:16:40.506987 28763 heartbeater.cc:461] Registering TS with master...
I20260203 09:16:40.507786 28763 heartbeater.cc:507] Master 127.26.232.126:35239 requested a full tablet report, sending...
I20260203 09:16:40.507949 27553 server_base.cc:1060] running on GCE node
I20260203 09:16:40.508926 27553 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260203 09:16:40.509127 27553 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260203 09:16:40.509297 27553 hybrid_clock.cc:648] HybridClock initialized: now 1770110200509281 us; error 0 us; skew 500 ppm
I20260203 09:16:40.509840 27553 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260203 09:16:40.510150 28635 ts_manager.cc:194] Registered new tserver with Master: 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967)
I20260203 09:16:40.512219 28635 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56844
I20260203 09:16:40.512509 27553 webserver.cc:492] Webserver started at http://127.26.232.66:38839/ using document root <none> and password file <none>
I20260203 09:16:40.513090 27553 fs_manager.cc:362] Metadata directory not provided
I20260203 09:16:40.513307 27553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 09:16:40.513609 27553 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 09:16:40.514933 27553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-1-root/instance:
uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
format_stamp: "Formatted at 2026-02-03 09:16:40 on dist-test-slave-x12j"
I20260203 09:16:40.519923 27553 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260203 09:16:40.523304 28775 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 09:16:40.524020 27553 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260203 09:16:40.524266 27553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-1-root
uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
format_stamp: "Formatted at 2026-02-03 09:16:40 on dist-test-slave-x12j"
I20260203 09:16:40.524547 27553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 09:16:40.543051 27553 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 09:16:40.544257 27553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 09:16:40.545864 27553 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260203 09:16:40.548134 27553 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260203 09:16:40.548341 27553 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260203 09:16:40.548570 27553 ts_tablet_manager.cc:616] Registered 0 tablets
I20260203 09:16:40.548743 27553 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260203 09:16:40.589205 27553 rpc_server.cc:307] RPC server started. Bound to: 127.26.232.66:41611
I20260203 09:16:40.589306 28838 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.232.66:41611 every 8 connection(s)
I20260203 09:16:40.593849 27553 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 09:16:40.601179 28842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:16:40.603282 28843 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:16:40.604256 28845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:16:40.606057 27553 server_base.cc:1060] running on GCE node
I20260203 09:16:40.606009 28839 heartbeater.cc:344] Connected to a master server at 127.26.232.126:35239
I20260203 09:16:40.606657 28839 heartbeater.cc:461] Registering TS with master...
I20260203 09:16:40.607196 27553 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260203 09:16:40.607471 27553 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260203 09:16:40.607576 28839 heartbeater.cc:507] Master 127.26.232.126:35239 requested a full tablet report, sending...
I20260203 09:16:40.607702 27553 hybrid_clock.cc:648] HybridClock initialized: now 1770110200607681 us; error 0 us; skew 500 ppm
I20260203 09:16:40.608471 27553 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260203 09:16:40.609882 28635 ts_manager.cc:194] Registered new tserver with Master: be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:40.611055 27553 webserver.cc:492] Webserver started at http://127.26.232.67:39773/ using document root <none> and password file <none>
I20260203 09:16:40.611531 27553 fs_manager.cc:362] Metadata directory not provided
I20260203 09:16:40.611721 27553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 09:16:40.611760 28635 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56858
I20260203 09:16:40.611956 27553 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 09:16:40.613554 27553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-2-root/instance:
uuid: "77541303e1934638ba82f0f43f707adc"
format_stamp: "Formatted at 2026-02-03 09:16:40 on dist-test-slave-x12j"
I20260203 09:16:40.619140 27553 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.000s sys 0.005s
I20260203 09:16:40.622565 28850 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 09:16:40.623281 27553 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260203 09:16:40.623569 27553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-2-root
uuid: "77541303e1934638ba82f0f43f707adc"
format_stamp: "Formatted at 2026-02-03 09:16:40 on dist-test-slave-x12j"
I20260203 09:16:40.623833 27553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 09:16:40.647825 27553 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 09:16:40.649375 27553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 09:16:40.650969 27553 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260203 09:16:40.653539 27553 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260203 09:16:40.653803 27553 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260203 09:16:40.654062 27553 ts_tablet_manager.cc:616] Registered 0 tablets
I20260203 09:16:40.654258 27553 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260203 09:16:40.699272 27553 rpc_server.cc:307] RPC server started. Bound to: 127.26.232.67:42899
I20260203 09:16:40.699458 28913 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.232.67:42899 every 8 connection(s)
I20260203 09:16:40.713316 28914 heartbeater.cc:344] Connected to a master server at 127.26.232.126:35239
I20260203 09:16:40.713794 28914 heartbeater.cc:461] Registering TS with master...
I20260203 09:16:40.714522 28914 heartbeater.cc:507] Master 127.26.232.126:35239 requested a full tablet report, sending...
I20260203 09:16:40.716764 28635 ts_manager.cc:194] Registered new tserver with Master: 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:40.717073 27553 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014886782s
I20260203 09:16:40.718272 28635 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56866
I20260203 09:16:40.746416 28635 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56874:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260203 09:16:40.752619 28635 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260203 09:16:41.551590 28683 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:16:41.553539 28763 heartbeater.cc:499] Master 127.26.232.126:35239 was elected leader, sending a full tablet report...
I20260203 09:16:41.591841 28802 tablet_service.cc:1505] Processing CreateTablet for tablet c13ab397c8524e6ca30e36e5fca2ff35 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260203 09:16:41.593657 28802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c13ab397c8524e6ca30e36e5fca2ff35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.602236 28801 tablet_service.cc:1505] Processing CreateTablet for tablet 2f652d76b6054b738b66531829291e55 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260203 09:16:41.604070 28801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f652d76b6054b738b66531829291e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.610721 28725 tablet_service.cc:1505] Processing CreateTablet for tablet c4b4d20256154aa1a7644698755531fd (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260203 09:16:41.612100 28725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b4d20256154aa1a7644698755531fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.612895 28724 tablet_service.cc:1505] Processing CreateTablet for tablet 021e904a783c4cbc96e5aa625a34a2d8 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260203 09:16:41.614288 28724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 021e904a783c4cbc96e5aa625a34a2d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.614760 28839 heartbeater.cc:499] Master 127.26.232.126:35239 was elected leader, sending a full tablet report...
I20260203 09:16:41.621160 28803 tablet_service.cc:1505] Processing CreateTablet for tablet a0b96e8815b1443c99aaa50410b2c6d1 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260203 09:16:41.621727 28723 tablet_service.cc:1505] Processing CreateTablet for tablet 0ce53cd3bb1847daa8cecd00aacff824 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260203 09:16:41.623090 28723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ce53cd3bb1847daa8cecd00aacff824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.622901 28722 tablet_service.cc:1505] Processing CreateTablet for tablet 113a394f120048c58168ad22915e0187 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260203 09:16:41.624459 28722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113a394f120048c58168ad22915e0187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.624678 28727 tablet_service.cc:1505] Processing CreateTablet for tablet c13ab397c8524e6ca30e36e5fca2ff35 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260203 09:16:41.626024 28727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c13ab397c8524e6ca30e36e5fca2ff35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.626370 28721 tablet_service.cc:1505] Processing CreateTablet for tablet 574d0205e57547c6938037563109a6d2 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260203 09:16:41.627597 28721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574d0205e57547c6938037563109a6d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.632473 28720 tablet_service.cc:1505] Processing CreateTablet for tablet 0d2d0debbeba46b086bb9d7344d2181b (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260203 09:16:41.633987 28720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d2d0debbeba46b086bb9d7344d2181b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.637153 28719 tablet_service.cc:1505] Processing CreateTablet for tablet eac7b86aa8d340e3a4d61a5c982b1f2e (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260203 09:16:41.638700 28719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac7b86aa8d340e3a4d61a5c982b1f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.608312 28728 tablet_service.cc:1505] Processing CreateTablet for tablet a0b96e8815b1443c99aaa50410b2c6d1 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260203 09:16:41.640930 28726 tablet_service.cc:1505] Processing CreateTablet for tablet 2f652d76b6054b738b66531829291e55 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260203 09:16:41.643358 28726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f652d76b6054b738b66531829291e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.645525 28878 tablet_service.cc:1505] Processing CreateTablet for tablet c13ab397c8524e6ca30e36e5fca2ff35 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260203 09:16:41.646256 28876 tablet_service.cc:1505] Processing CreateTablet for tablet c4b4d20256154aa1a7644698755531fd (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260203 09:16:41.646966 28799 tablet_service.cc:1505] Processing CreateTablet for tablet 021e904a783c4cbc96e5aa625a34a2d8 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260203 09:16:41.649720 28877 tablet_service.cc:1505] Processing CreateTablet for tablet 2f652d76b6054b738b66531829291e55 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260203 09:16:41.649854 28798 tablet_service.cc:1505] Processing CreateTablet for tablet 0ce53cd3bb1847daa8cecd00aacff824 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260203 09:16:41.651851 28879 tablet_service.cc:1505] Processing CreateTablet for tablet a0b96e8815b1443c99aaa50410b2c6d1 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260203 09:16:41.644222 28803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0b96e8815b1443c99aaa50410b2c6d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.648093 28800 tablet_service.cc:1505] Processing CreateTablet for tablet c4b4d20256154aa1a7644698755531fd (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260203 09:16:41.652941 28797 tablet_service.cc:1505] Processing CreateTablet for tablet 113a394f120048c58168ad22915e0187 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260203 09:16:41.654111 28800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b4d20256154aa1a7644698755531fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.655225 28798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ce53cd3bb1847daa8cecd00aacff824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.656766 28799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 021e904a783c4cbc96e5aa625a34a2d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.657402 28797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113a394f120048c58168ad22915e0187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.646917 28878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c13ab397c8524e6ca30e36e5fca2ff35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.660954 28877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f652d76b6054b738b66531829291e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.662271 28879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0b96e8815b1443c99aaa50410b2c6d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.663237 28876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b4d20256154aa1a7644698755531fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.669968 28796 tablet_service.cc:1505] Processing CreateTablet for tablet 574d0205e57547c6938037563109a6d2 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260203 09:16:41.671474 28796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574d0205e57547c6938037563109a6d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.674324 28795 tablet_service.cc:1505] Processing CreateTablet for tablet 0d2d0debbeba46b086bb9d7344d2181b (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260203 09:16:41.674587 28794 tablet_service.cc:1505] Processing CreateTablet for tablet eac7b86aa8d340e3a4d61a5c982b1f2e (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260203 09:16:41.680583 28795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d2d0debbeba46b086bb9d7344d2181b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.682883 28794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac7b86aa8d340e3a4d61a5c982b1f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.652989 28728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0b96e8815b1443c99aaa50410b2c6d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.707288 28931 tablet_bootstrap.cc:492] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:41.708987 28795 tablet_service.cc:1505] Processing CreateTablet for tablet b149dd40ec15465299cdb910e5385206 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260203 09:16:41.710258 28795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b149dd40ec15465299cdb910e5385206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.712070 28722 tablet_service.cc:1505] Processing CreateTablet for tablet 3a09fae92b37497d8efa250f727c0fd9 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260203 09:16:41.713442 28722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a09fae92b37497d8efa250f727c0fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.721892 28914 heartbeater.cc:499] Master 127.26.232.126:35239 was elected leader, sending a full tablet report...
I20260203 09:16:41.724258 28800 tablet_service.cc:1505] Processing CreateTablet for tablet 3a09fae92b37497d8efa250f727c0fd9 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260203 09:16:41.725764 28800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a09fae92b37497d8efa250f727c0fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.738956 28794 tablet_service.cc:1505] Processing CreateTablet for tablet 9fcb41fb74694d87acc7c8963bdf4bcf (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260203 09:16:41.740404 28794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fcb41fb74694d87acc7c8963bdf4bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.758221 28797 tablet_service.cc:1505] Processing CreateTablet for tablet 3f2a68daf4384c47ba2a6a46ac297f00 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260203 09:16:41.758549 28794 tablet_service.cc:1505] Processing CreateTablet for tablet 6645a0476f6e40bda131d06fa0f15f7b (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260203 09:16:41.759639 28797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f2a68daf4384c47ba2a6a46ac297f00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.768993 28794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6645a0476f6e40bda131d06fa0f15f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.770514 28719 tablet_service.cc:1505] Processing CreateTablet for tablet 9fcb41fb74694d87acc7c8963bdf4bcf (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260203 09:16:41.771996 28719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fcb41fb74694d87acc7c8963bdf4bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.775197 28875 tablet_service.cc:1505] Processing CreateTablet for tablet 0ce53cd3bb1847daa8cecd00aacff824 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260203 09:16:41.775514 28874 tablet_service.cc:1505] Processing CreateTablet for tablet 113a394f120048c58168ad22915e0187 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260203 09:16:41.776906 28870 tablet_service.cc:1505] Processing CreateTablet for tablet 3a09fae92b37497d8efa250f727c0fd9 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260203 09:16:41.777766 28873 tablet_service.cc:1505] Processing CreateTablet for tablet 574d0205e57547c6938037563109a6d2 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260203 09:16:41.779146 28875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ce53cd3bb1847daa8cecd00aacff824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.778868 28871 tablet_service.cc:1505] Processing CreateTablet for tablet eac7b86aa8d340e3a4d61a5c982b1f2e (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260203 09:16:41.780229 28874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113a394f120048c58168ad22915e0187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.780849 28873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574d0205e57547c6938037563109a6d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.781440 28870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a09fae92b37497d8efa250f727c0fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.777669 28872 tablet_service.cc:1505] Processing CreateTablet for tablet 0d2d0debbeba46b086bb9d7344d2181b (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260203 09:16:41.782384 28872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d2d0debbeba46b086bb9d7344d2181b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.783360 28871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac7b86aa8d340e3a4d61a5c982b1f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.789007 28876 tablet_service.cc:1505] Processing CreateTablet for tablet 021e904a783c4cbc96e5aa625a34a2d8 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260203 09:16:41.793489 28876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 021e904a783c4cbc96e5aa625a34a2d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.790124 28798 tablet_service.cc:1505] Processing CreateTablet for tablet 47301e2bbfc94767a9905b0e12141d6d (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260203 09:16:41.809424 28798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47301e2bbfc94767a9905b0e12141d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.844077 28932 tablet_bootstrap.cc:492] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:41.845662 28802 tablet_service.cc:1505] Processing CreateTablet for tablet 298c016813da45bdbc537b5851b5e728 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260203 09:16:41.846976 28802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298c016813da45bdbc537b5851b5e728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.849761 28724 tablet_service.cc:1505] Processing CreateTablet for tablet b149dd40ec15465299cdb910e5385206 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260203 09:16:41.851008 28724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b149dd40ec15465299cdb910e5385206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.854097 28879 tablet_service.cc:1505] Processing CreateTablet for tablet 3f2a68daf4384c47ba2a6a46ac297f00 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260203 09:16:41.855489 28879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f2a68daf4384c47ba2a6a46ac297f00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.865424 28933 tablet_bootstrap.cc:492] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:41.865871 28878 tablet_service.cc:1505] Processing CreateTablet for tablet b149dd40ec15465299cdb910e5385206 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260203 09:16:41.867220 28878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b149dd40ec15465299cdb910e5385206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.870105 28931 tablet_bootstrap.cc:654] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:41.874900 28877 tablet_service.cc:1505] Processing CreateTablet for tablet 6645a0476f6e40bda131d06fa0f15f7b (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260203 09:16:41.876430 28877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6645a0476f6e40bda131d06fa0f15f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.878717 28796 tablet_service.cc:1505] Processing CreateTablet for tablet c49cb7ba1af14dfcbe637cf12fbe669c (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260203 09:16:41.880070 28796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c49cb7ba1af14dfcbe637cf12fbe669c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.879774 28722 tablet_service.cc:1505] Processing CreateTablet for tablet 3f2a68daf4384c47ba2a6a46ac297f00 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260203 09:16:41.881047 28722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f2a68daf4384c47ba2a6a46ac297f00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.852385 28872 tablet_service.cc:1505] Processing CreateTablet for tablet 9fcb41fb74694d87acc7c8963bdf4bcf (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260203 09:16:41.883261 28872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fcb41fb74694d87acc7c8963bdf4bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.884001 28870 tablet_service.cc:1505] Processing CreateTablet for tablet 47301e2bbfc94767a9905b0e12141d6d (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260203 09:16:41.888289 28794 tablet_service.cc:1505] Processing CreateTablet for tablet 4630d6f6a17e4819a2daf0560e4013ad (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260203 09:16:41.890944 28794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4630d6f6a17e4819a2daf0560e4013ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.915234 28933 tablet_bootstrap.cc:654] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:41.895421 28799 tablet_service.cc:1505] Processing CreateTablet for tablet a924eec8e84d4192bc0e30ae0829e54b (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260203 09:16:41.917701 28799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a924eec8e84d4192bc0e30ae0829e54b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.898558 28725 tablet_service.cc:1505] Processing CreateTablet for tablet 6645a0476f6e40bda131d06fa0f15f7b (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260203 09:16:41.921661 28725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6645a0476f6e40bda131d06fa0f15f7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.923205 28800 tablet_service.cc:1505] Processing CreateTablet for tablet 4915f49d9ce24ab29a5c09e91dafd667 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260203 09:16:41.898972 28723 tablet_service.cc:1505] Processing CreateTablet for tablet 47301e2bbfc94767a9905b0e12141d6d (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260203 09:16:41.923910 28801 tablet_service.cc:1505] Processing CreateTablet for tablet 2339220aa4ac4160839f61543c6c60d2 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260203 09:16:41.924809 28723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47301e2bbfc94767a9905b0e12141d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.924927 28803 tablet_service.cc:1505] Processing CreateTablet for tablet 7e1bac12c6ee43d6901400e02b35d82f (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260203 09:16:41.896355 28798 tablet_service.cc:1505] Processing CreateTablet for tablet 6bf3d38eba3b4894b7f18f2d5733f63e (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260203 09:16:41.927218 28932 tablet_bootstrap.cc:654] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:41.904048 28874 tablet_service.cc:1505] Processing CreateTablet for tablet 298c016813da45bdbc537b5851b5e728 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260203 09:16:41.931337 28720 tablet_service.cc:1505] Processing CreateTablet for tablet c49cb7ba1af14dfcbe637cf12fbe669c (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260203 09:16:41.932636 28720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c49cb7ba1af14dfcbe637cf12fbe669c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.935811 28722 tablet_service.cc:1505] Processing CreateTablet for tablet 4630d6f6a17e4819a2daf0560e4013ad (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260203 09:16:41.937585 28870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47301e2bbfc94767a9905b0e12141d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.958711 28871 tablet_service.cc:1505] Processing CreateTablet for tablet 4630d6f6a17e4819a2daf0560e4013ad (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260203 09:16:41.959957 28871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4630d6f6a17e4819a2daf0560e4013ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.957657 28726 tablet_service.cc:1505] Processing CreateTablet for tablet a924eec8e84d4192bc0e30ae0829e54b (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260203 09:16:41.961565 28874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298c016813da45bdbc537b5851b5e728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.947750 28728 tablet_service.cc:1505] Processing CreateTablet for tablet 6bf3d38eba3b4894b7f18f2d5733f63e (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260203 09:16:41.948719 28876 tablet_service.cc:1505] Processing CreateTablet for tablet c49cb7ba1af14dfcbe637cf12fbe669c (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260203 09:16:41.924510 28800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4915f49d9ce24ab29a5c09e91dafd667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.968951 28803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e1bac12c6ee43d6901400e02b35d82f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.970604 28875 tablet_service.cc:1505] Processing CreateTablet for tablet 6bf3d38eba3b4894b7f18f2d5733f63e (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260203 09:16:41.971886 28875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bf3d38eba3b4894b7f18f2d5733f63e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.950989 28721 tablet_service.cc:1505] Processing CreateTablet for tablet 7e1bac12c6ee43d6901400e02b35d82f (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260203 09:16:41.952461 28724 tablet_service.cc:1505] Processing CreateTablet for tablet 298c016813da45bdbc537b5851b5e728 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260203 09:16:41.973661 28876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c49cb7ba1af14dfcbe637cf12fbe669c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.972431 28872 tablet_service.cc:1505] Processing CreateTablet for tablet 7e1bac12c6ee43d6901400e02b35d82f (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260203 09:16:41.975905 28872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e1bac12c6ee43d6901400e02b35d82f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.964176 28873 tablet_service.cc:1505] Processing CreateTablet for tablet a924eec8e84d4192bc0e30ae0829e54b (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260203 09:16:41.976946 28798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bf3d38eba3b4894b7f18f2d5733f63e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.980979 28873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a924eec8e84d4192bc0e30ae0829e54b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.984961 28801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2339220aa4ac4160839f61543c6c60d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.991854 28802 tablet_service.cc:1505] Processing CreateTablet for tablet 797be23efb5c447da7f2d0ba9af2e84d (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260203 09:16:41.993227 28802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797be23efb5c447da7f2d0ba9af2e84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:41.999975 28931 tablet_bootstrap.cc:492] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:42.004910 28724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 298c016813da45bdbc537b5851b5e728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.005034 28879 tablet_service.cc:1505] Processing CreateTablet for tablet 4915f49d9ce24ab29a5c09e91dafd667 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260203 09:16:42.005800 28721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e1bac12c6ee43d6901400e02b35d82f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.007426 28722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4630d6f6a17e4819a2daf0560e4013ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.008739 28795 tablet_service.cc:1505] Processing CreateTablet for tablet fabfb779b8894cf0b22204fe12768dc3 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260203 09:16:42.010103 28795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fabfb779b8894cf0b22204fe12768dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.000519 28931 ts_tablet_manager.cc:1403] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.294s user 0.015s sys 0.000s
I20260203 09:16:42.017774 28727 tablet_service.cc:1505] Processing CreateTablet for tablet 4915f49d9ce24ab29a5c09e91dafd667 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260203 09:16:42.026428 28796 tablet_service.cc:1505] Processing CreateTablet for tablet 06f7408dc6eb4aea9a8acfbe1c0b482c (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260203 09:16:42.028885 28728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bf3d38eba3b4894b7f18f2d5733f63e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.030160 28719 tablet_service.cc:1505] Processing CreateTablet for tablet 2339220aa4ac4160839f61543c6c60d2 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260203 09:16:42.033143 28931 raft_consensus.cc:359] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:42.034569 28879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4915f49d9ce24ab29a5c09e91dafd667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.038645 28877 tablet_service.cc:1505] Processing CreateTablet for tablet 2339220aa4ac4160839f61543c6c60d2 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260203 09:16:42.051843 28727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4915f49d9ce24ab29a5c09e91dafd667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.056231 28796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06f7408dc6eb4aea9a8acfbe1c0b482c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.045872 28931 raft_consensus.cc:385] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:42.058348 28931 raft_consensus.cc:740] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:42.057149 28877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2339220aa4ac4160839f61543c6c60d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.062242 28878 tablet_service.cc:1505] Processing CreateTablet for tablet 797be23efb5c447da7f2d0ba9af2e84d (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260203 09:16:42.065198 28726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a924eec8e84d4192bc0e30ae0829e54b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.068946 28878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797be23efb5c447da7f2d0ba9af2e84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.069408 28797 tablet_service.cc:1505] Processing CreateTablet for tablet 3b6f1d6e275f4a8ba99a70dbb3ea3235 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260203 09:16:42.079893 28797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b6f1d6e275f4a8ba99a70dbb3ea3235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.059371 28931 consensus_queue.cc:260] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:42.083992 28799 tablet_service.cc:1505] Processing CreateTablet for tablet 74236b7aaa67439b807775f90674420c (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260203 09:16:42.093941 28879 tablet_service.cc:1505] Processing CreateTablet for tablet fabfb779b8894cf0b22204fe12768dc3 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260203 09:16:42.096748 28799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74236b7aaa67439b807775f90674420c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.098110 28723 tablet_service.cc:1505] Processing CreateTablet for tablet 797be23efb5c447da7f2d0ba9af2e84d (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260203 09:16:42.099457 28723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797be23efb5c447da7f2d0ba9af2e84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.100693 28879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fabfb779b8894cf0b22204fe12768dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.103356 28720 tablet_service.cc:1505] Processing CreateTablet for tablet fabfb779b8894cf0b22204fe12768dc3 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260203 09:16:42.106105 28728 tablet_service.cc:1505] Processing CreateTablet for tablet 06f7408dc6eb4aea9a8acfbe1c0b482c (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260203 09:16:42.108084 28720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fabfb779b8894cf0b22204fe12768dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.109023 28719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2339220aa4ac4160839f61543c6c60d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.114128 28728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06f7408dc6eb4aea9a8acfbe1c0b482c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.122864 28932 tablet_bootstrap.cc:492] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:42.123414 28933 tablet_bootstrap.cc:492] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:42.123376 28932 ts_tablet_manager.cc:1403] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.280s user 0.018s sys 0.000s
I20260203 09:16:42.123919 28933 ts_tablet_manager.cc:1403] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.259s user 0.010s sys 0.007s
I20260203 09:16:42.122996 28801 tablet_service.cc:1505] Processing CreateTablet for tablet 438ed0267e3148da951c6dc25761c745 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260203 09:16:42.126293 28932 raft_consensus.cc:359] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:42.126485 28933 raft_consensus.cc:359] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:42.127704 28800 tablet_service.cc:1505] Processing CreateTablet for tablet a720779d5e3444dc8825e118d9880b72 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260203 09:16:42.129624 28932 raft_consensus.cc:385] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:42.132494 28800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a720779d5e3444dc8825e118d9880b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.131309 28933 raft_consensus.cc:385] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:42.133126 28933 raft_consensus.cc:740] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:42.131450 28932 raft_consensus.cc:740] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:42.133592 28794 tablet_service.cc:1505] Processing CreateTablet for tablet bf838e5b1f6141bfb1cd1bc26a8b0006 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260203 09:16:42.135457 28932 consensus_queue.cc:260] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:42.134344 28933 consensus_queue.cc:260] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:42.139223 28794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf838e5b1f6141bfb1cd1bc26a8b0006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.139812 28870 tablet_service.cc:1505] Processing CreateTablet for tablet 06f7408dc6eb4aea9a8acfbe1c0b482c (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260203 09:16:42.141120 28870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06f7408dc6eb4aea9a8acfbe1c0b482c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.158870 28801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 438ed0267e3148da951c6dc25761c745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.164409 28721 tablet_service.cc:1505] Processing CreateTablet for tablet 3b6f1d6e275f4a8ba99a70dbb3ea3235 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260203 09:16:42.165799 28721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b6f1d6e275f4a8ba99a70dbb3ea3235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.177752 28801 tablet_service.cc:1505] Processing CreateTablet for tablet b5ccabd714ab40bab140c7a90667ddd6 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260203 09:16:42.179148 28801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ccabd714ab40bab140c7a90667ddd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.188766 28933 ts_tablet_manager.cc:1434] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.065s user 0.014s sys 0.025s
I20260203 09:16:42.190618 28875 tablet_service.cc:1505] Processing CreateTablet for tablet 3b6f1d6e275f4a8ba99a70dbb3ea3235 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260203 09:16:42.191987 28875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b6f1d6e275f4a8ba99a70dbb3ea3235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.193245 28727 tablet_service.cc:1505] Processing CreateTablet for tablet a720779d5e3444dc8825e118d9880b72 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260203 09:16:42.198547 28933 tablet_bootstrap.cc:492] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:42.208520 28795 tablet_service.cc:1505] Processing CreateTablet for tablet 1862780e910a42d5a3414a9329cd9259 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260203 09:16:42.209990 28795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1862780e910a42d5a3414a9329cd9259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.210295 28933 tablet_bootstrap.cc:654] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:42.198675 28874 tablet_service.cc:1505] Processing CreateTablet for tablet a720779d5e3444dc8825e118d9880b72 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260203 09:16:42.213866 28874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a720779d5e3444dc8825e118d9880b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.218541 28871 tablet_service.cc:1505] Processing CreateTablet for tablet 74236b7aaa67439b807775f90674420c (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260203 09:16:42.228142 28725 tablet_service.cc:1505] Processing CreateTablet for tablet 74236b7aaa67439b807775f90674420c (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260203 09:16:42.232775 28719 tablet_service.cc:1505] Processing CreateTablet for tablet 438ed0267e3148da951c6dc25761c745 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260203 09:16:42.236935 28727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a720779d5e3444dc8825e118d9880b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.213869 28798 tablet_service.cc:1505] Processing CreateTablet for tablet a10f51ea1a844376bb4dce51f655be6b (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260203 09:16:42.250381 28798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10f51ea1a844376bb4dce51f655be6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.244697 28932 ts_tablet_manager.cc:1434] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.121s user 0.007s sys 0.011s
I20260203 09:16:42.252837 28932 tablet_bootstrap.cc:492] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:42.245743 28871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74236b7aaa67439b807775f90674420c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.247026 28931 ts_tablet_manager.cc:1434] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.233s user 0.017s sys 0.000s
I20260203 09:16:42.255434 28725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74236b7aaa67439b807775f90674420c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.256439 28931 tablet_bootstrap.cc:492] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:42.264170 28872 tablet_service.cc:1505] Processing CreateTablet for tablet 438ed0267e3148da951c6dc25761c745 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260203 09:16:42.265439 28719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 438ed0267e3148da951c6dc25761c745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.265841 28872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 438ed0267e3148da951c6dc25761c745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.270061 28876 tablet_service.cc:1505] Processing CreateTablet for tablet bf838e5b1f6141bfb1cd1bc26a8b0006 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260203 09:16:42.271665 28876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf838e5b1f6141bfb1cd1bc26a8b0006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.282601 28873 tablet_service.cc:1505] Processing CreateTablet for tablet b5ccabd714ab40bab140c7a90667ddd6 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260203 09:16:42.284253 28873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ccabd714ab40bab140c7a90667ddd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.295305 28933 tablet_bootstrap.cc:492] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:42.295993 28933 ts_tablet_manager.cc:1403] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.098s user 0.037s sys 0.051s
I20260203 09:16:42.299136 28933 raft_consensus.cc:359] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:42.300031 28933 raft_consensus.cc:385] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:42.300386 28933 raft_consensus.cc:740] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
W20260203 09:16:42.301092 28619 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 51555.8us
I20260203 09:16:42.301332 28933 consensus_queue.cc:260] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:42.304963 28720 tablet_service.cc:1505] Processing CreateTablet for tablet bf838e5b1f6141bfb1cd1bc26a8b0006 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260203 09:16:42.305670 28933 ts_tablet_manager.cc:1434] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.009s user 0.004s sys 0.003s
I20260203 09:16:42.306253 28720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf838e5b1f6141bfb1cd1bc26a8b0006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.306923 28933 tablet_bootstrap.cc:492] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:42.311702 28802 tablet_service.cc:1505] Processing CreateTablet for tablet 649a6d7dbffd49cf9969715dea1c841d (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260203 09:16:42.313753 28933 tablet_bootstrap.cc:654] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:42.315295 28802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 649a6d7dbffd49cf9969715dea1c841d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.320277 28938 raft_consensus.cc:493] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:42.321054 28938 raft_consensus.cc:515] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:42.330793 28723 tablet_service.cc:1505] Processing CreateTablet for tablet b5ccabd714ab40bab140c7a90667ddd6 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260203 09:16:42.355293 28938 leader_election.cc:290] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
W20260203 09:16:42.361969 28618 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 51323.2us
I20260203 09:16:42.352077 28877 tablet_service.cc:1505] Processing CreateTablet for tablet a10f51ea1a844376bb4dce51f655be6b (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260203 09:16:42.367789 28932 tablet_bootstrap.cc:654] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:42.365790 28931 tablet_bootstrap.cc:654] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:42.408861 28723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ccabd714ab40bab140c7a90667ddd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.416162 28724 tablet_service.cc:1505] Processing CreateTablet for tablet 1862780e910a42d5a3414a9329cd9259 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260203 09:16:42.417598 28724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1862780e910a42d5a3414a9329cd9259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.421020 28877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10f51ea1a844376bb4dce51f655be6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.420665 28722 tablet_service.cc:1505] Processing CreateTablet for tablet 649a6d7dbffd49cf9969715dea1c841d (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260203 09:16:42.422240 28722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 649a6d7dbffd49cf9969715dea1c841d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.363798 28728 tablet_service.cc:1505] Processing CreateTablet for tablet a10f51ea1a844376bb4dce51f655be6b (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260203 09:16:42.446537 28875 tablet_service.cc:1505] Processing CreateTablet for tablet 1862780e910a42d5a3414a9329cd9259 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260203 09:16:42.447921 28875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1862780e910a42d5a3414a9329cd9259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.446792 28801 tablet_service.cc:1505] Processing CreateTablet for tablet 428e0a1fef8d467da4a30ece11cc6e5c (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260203 09:16:42.454828 28933 tablet_bootstrap.cc:492] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:42.455400 28933 ts_tablet_manager.cc:1403] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.149s user 0.041s sys 0.066s
W20260203 09:16:42.456817 28915 tablet.cc:2378] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260203 09:16:42.458308 28933 raft_consensus.cc:359] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:42.459007 28933 raft_consensus.cc:385] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:42.459282 28933 raft_consensus.cc:740] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:42.459987 28933 consensus_queue.cc:260] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:42.462797 28797 tablet_service.cc:1505] Processing CreateTablet for tablet d146929ef3874ea3a955fd4c49d19d4c (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260203 09:16:42.463063 28800 tablet_service.cc:1505] Processing CreateTablet for tablet bcfe4116093a4fe49ba4dfa67b48cedf (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260203 09:16:42.466791 28933 ts_tablet_manager.cc:1434] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.011s user 0.005s sys 0.003s
I20260203 09:16:42.467787 28939 raft_consensus.cc:493] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:42.468299 28939 raft_consensus.cc:515] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:42.471030 28797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d146929ef3874ea3a955fd4c49d19d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.471830 28939 leader_election.cc:290] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:42.474629 28800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcfe4116093a4fe49ba4dfa67b48cedf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.482407 28728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10f51ea1a844376bb4dce51f655be6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.491453 28796 tablet_service.cc:1505] Processing CreateTablet for tablet f40d17692ce0424589f3962011b49824 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260203 09:16:42.494390 28932 tablet_bootstrap.cc:492] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:42.494920 28932 ts_tablet_manager.cc:1403] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.242s user 0.012s sys 0.004s
I20260203 09:16:42.495594 28799 tablet_service.cc:1505] Processing CreateTablet for tablet 8b2c469d7255413d9f61a7cbaa4481a7 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260203 09:16:42.506031 28932 raft_consensus.cc:359] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:42.500454 28874 tablet_service.cc:1505] Processing CreateTablet for tablet 649a6d7dbffd49cf9969715dea1c841d (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260203 09:16:42.506966 28932 raft_consensus.cc:385] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:42.507412 28932 raft_consensus.cc:740] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:42.507891 28874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 649a6d7dbffd49cf9969715dea1c841d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.536787 28801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 428e0a1fef8d467da4a30ece11cc6e5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.544076 28799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b2c469d7255413d9f61a7cbaa4481a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.546381 28796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f40d17692ce0424589f3962011b49824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.560019 28932 consensus_queue.cc:260] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:42.562844 28932 ts_tablet_manager.cc:1434] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.068s user 0.003s sys 0.004s
I20260203 09:16:42.562569 28728 tablet_service.cc:1505] Processing CreateTablet for tablet 428e0a1fef8d467da4a30ece11cc6e5c (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260203 09:16:42.563925 28728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 428e0a1fef8d467da4a30ece11cc6e5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.566082 28937 raft_consensus.cc:493] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:42.566573 28937 raft_consensus.cc:515] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:16:42.569461 28910 debug-util.cc:398] Leaking SignalData structure 0x7b08001306c0 after lost signal to thread 27556
I20260203 09:16:42.570154 28937 leader_election.cc:290] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:16:42.570384 28910 debug-util.cc:398] Leaking SignalData structure 0x7b08000e8280 after lost signal to thread 28669
W20260203 09:16:42.572093 28683 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:16:42.574402 28878 tablet_service.cc:1505] Processing CreateTablet for tablet bcfe4116093a4fe49ba4dfa67b48cedf (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260203 09:16:42.575697 28878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcfe4116093a4fe49ba4dfa67b48cedf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.563930 28932 tablet_bootstrap.cc:492] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:42.565068 28720 tablet_service.cc:1505] Processing CreateTablet for tablet d146929ef3874ea3a955fd4c49d19d4c (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260203 09:16:42.582267 28933 tablet_bootstrap.cc:492] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:42.590976 28795 tablet_service.cc:1505] Processing CreateTablet for tablet 09f2301096ce4f4689e1e7f24f013e52 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260203 09:16:42.601174 28720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d146929ef3874ea3a955fd4c49d19d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.605546 28795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f2301096ce4f4689e1e7f24f013e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.610808 28931 tablet_bootstrap.cc:492] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:42.611428 28931 ts_tablet_manager.cc:1403] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.355s user 0.000s sys 0.023s
I20260203 09:16:42.613343 28871 tablet_service.cc:1505] Processing CreateTablet for tablet 428e0a1fef8d467da4a30ece11cc6e5c (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260203 09:16:42.614856 28871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 428e0a1fef8d467da4a30ece11cc6e5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.615268 28931 raft_consensus.cc:359] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:42.616097 28931 raft_consensus.cc:385] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:42.617436 28872 tablet_service.cc:1505] Processing CreateTablet for tablet f40d17692ce0424589f3962011b49824 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260203 09:16:42.619026 28872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f40d17692ce0424589f3962011b49824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.623451 28722 tablet_service.cc:1505] Processing CreateTablet for tablet 7e336e3590fc428e88c5353c9e96a36f (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260203 09:16:42.631744 28875 tablet_service.cc:1505] Processing CreateTablet for tablet 8b2c469d7255413d9f61a7cbaa4481a7 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260203 09:16:42.633478 28725 tablet_service.cc:1505] Processing CreateTablet for tablet f40d17692ce0424589f3962011b49824 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260203 09:16:42.639060 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:42.639436 28722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e336e3590fc428e88c5353c9e96a36f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.616429 28931 raft_consensus.cc:740] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:42.658130 28725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f40d17692ce0424589f3962011b49824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.658895 28798 tablet_service.cc:1505] Processing CreateTablet for tablet 0322ad4122a64f6abccdfb1906919b8e (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260203 09:16:42.660176 28798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0322ad4122a64f6abccdfb1906919b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.586371 28879 tablet_service.cc:1505] Processing CreateTablet for tablet d146929ef3874ea3a955fd4c49d19d4c (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260203 09:16:42.662544 28719 tablet_service.cc:1505] Processing CreateTablet for tablet 09f2301096ce4f4689e1e7f24f013e52 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260203 09:16:42.664054 28719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f2301096ce4f4689e1e7f24f013e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.675287 28721 tablet_service.cc:1505] Processing CreateTablet for tablet bcfe4116093a4fe49ba4dfa67b48cedf (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260203 09:16:42.670432 28931 consensus_queue.cc:260] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:42.676676 28797 tablet_service.cc:1505] Processing CreateTablet for tablet 7c8f123f58ac4b3da0beed1215102a98 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260203 09:16:42.674464 28726 tablet_service.cc:1505] Processing CreateTablet for tablet 8b2c469d7255413d9f61a7cbaa4481a7 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260203 09:16:42.676892 28794 tablet_service.cc:1505] Processing CreateTablet for tablet 7e336e3590fc428e88c5353c9e96a36f (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260203 09:16:42.681489 28797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c8f123f58ac4b3da0beed1215102a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.682070 28794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e336e3590fc428e88c5353c9e96a36f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.681905 28727 tablet_service.cc:1505] Processing CreateTablet for tablet 0322ad4122a64f6abccdfb1906919b8e (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260203 09:16:42.690713 28932 tablet_bootstrap.cc:654] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:42.692493 28931 ts_tablet_manager.cc:1434] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.081s user 0.008s sys 0.000s
W20260203 09:16:42.693166 28852 leader_election.cc:343] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:42.697564 28873 tablet_service.cc:1505] Processing CreateTablet for tablet 7e336e3590fc428e88c5353c9e96a36f (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260203 09:16:42.676586 28721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcfe4116093a4fe49ba4dfa67b48cedf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.711470 28726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b2c469d7255413d9f61a7cbaa4481a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.708081 28931 tablet_bootstrap.cc:492] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:42.673338 28875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b2c469d7255413d9f61a7cbaa4481a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.719758 28727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0322ad4122a64f6abccdfb1906919b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.709901 28874 tablet_service.cc:1505] Processing CreateTablet for tablet 0322ad4122a64f6abccdfb1906919b8e (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260203 09:16:42.722112 28870 tablet_service.cc:1505] Processing CreateTablet for tablet 09f2301096ce4f4689e1e7f24f013e52 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260203 09:16:42.729017 28879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d146929ef3874ea3a955fd4c49d19d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.729697 28939 raft_consensus.cc:493] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:42.730285 28939 raft_consensus.cc:515] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:42.732544 28939 leader_election.cc:290] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:42.735025 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:42.735383 28870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f2301096ce4f4689e1e7f24f013e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.736424 28874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0322ad4122a64f6abccdfb1906919b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.737583 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:42.739614 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:16:42.741324 28851 leader_election.cc:343] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:42.741786 28851 leader_election.cc:304] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:42.742615 28938 raft_consensus.cc:2749] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260203 09:16:42.743633 28777 leader_election.cc:343] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:42.744998 28797 tablet_service.cc:1505] Processing CreateTablet for tablet 0fbefdb5cdae4df9ab3c78a3b6b42ae2 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260203 09:16:42.750216 28876 tablet_service.cc:1505] Processing CreateTablet for tablet 7c8f123f58ac4b3da0beed1215102a98 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260203 09:16:42.754801 28797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fbefdb5cdae4df9ab3c78a3b6b42ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.756331 28931 tablet_bootstrap.cc:654] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:42.759794 28796 tablet_service.cc:1505] Processing CreateTablet for tablet 6b21247fc3af467fa74a89f61d43143f (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260203 09:16:42.761206 28796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b21247fc3af467fa74a89f61d43143f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.770936 28933 tablet_bootstrap.cc:654] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:42.777756 28877 tablet_service.cc:1505] Processing CreateTablet for tablet 0fbefdb5cdae4df9ab3c78a3b6b42ae2 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260203 09:16:42.778079 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:16:42.782296 28701 leader_election.cc:343] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:42.783691 28799 tablet_service.cc:1505] Processing CreateTablet for tablet fd89e8aac3604bd48c5553ce7e5aa905 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260203 09:16:42.780567 28873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e336e3590fc428e88c5353c9e96a36f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.785048 28799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd89e8aac3604bd48c5553ce7e5aa905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.785410 28876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c8f123f58ac4b3da0beed1215102a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.798293 28878 tablet_service.cc:1505] Processing CreateTablet for tablet 6b21247fc3af467fa74a89f61d43143f (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260203 09:16:42.799744 28878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b21247fc3af467fa74a89f61d43143f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260203 09:16:42.798293 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 54816us
W20260203 09:16:42.801664 28777 leader_election.cc:343] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:42.801967 28725 tablet_service.cc:1505] Processing CreateTablet for tablet 7c8f123f58ac4b3da0beed1215102a98 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260203 09:16:42.803331 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:42.805562 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:42.807124 28726 tablet_service.cc:1505] Processing CreateTablet for tablet 0fbefdb5cdae4df9ab3c78a3b6b42ae2 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260203 09:16:42.808691 28802 tablet_service.cc:1505] Processing CreateTablet for tablet 6b71c6a3f2db4b738de03d5e4190cf27 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260203 09:16:42.812419 28802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b71c6a3f2db4b738de03d5e4190cf27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.820914 28728 tablet_service.cc:1505] Processing CreateTablet for tablet 6b21247fc3af467fa74a89f61d43143f (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260203 09:16:42.803359 28725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c8f123f58ac4b3da0beed1215102a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.830206 28724 tablet_service.cc:1505] Processing CreateTablet for tablet fd89e8aac3604bd48c5553ce7e5aa905 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260203 09:16:42.831590 28724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd89e8aac3604bd48c5553ce7e5aa905. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.836146 28800 tablet_service.cc:1505] Processing CreateTablet for tablet bd8e39da0721419098d343e576a8c0a2 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260203 09:16:42.837684 28800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd8e39da0721419098d343e576a8c0a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.841135 28726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fbefdb5cdae4df9ab3c78a3b6b42ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.842317 28877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fbefdb5cdae4df9ab3c78a3b6b42ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.856899 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:42.857455 28872 tablet_service.cc:1505] Processing CreateTablet for tablet fd89e8aac3604bd48c5553ce7e5aa905 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260203 09:16:42.858871 28872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd89e8aac3604bd48c5553ce7e5aa905. 1 dirs total, 0 dirs full, 0 dirs failed
W20260203 09:16:42.859364 28700 leader_election.cc:343] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:42.859845 28700 leader_election.cc:304] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:42.859865 28723 tablet_service.cc:1505] Processing CreateTablet for tablet 6b71c6a3f2db4b738de03d5e4190cf27 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260203 09:16:42.861284 28937 raft_consensus.cc:2749] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260203 09:16:42.807032 28777 leader_election.cc:343] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:42.868252 28937 raft_consensus.cc:493] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:42.868847 28937 raft_consensus.cc:515] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:42.869714 28796 tablet_service.cc:1505] Processing CreateTablet for tablet 2fe435e0235d42ec88a9773010ea1fec (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260203 09:16:42.870934 28937 leader_election.cc:290] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:42.871639 28796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fe435e0235d42ec88a9773010ea1fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.874123 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:42.875272 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:16:42.876945 28700 leader_election.cc:343] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:16:42.877779 28701 leader_election.cc:343] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:42.878242 28701 leader_election.cc:304] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:42.859066 28728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b21247fc3af467fa74a89f61d43143f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.879561 28937 raft_consensus.cc:2749] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:42.881320 28777 leader_election.cc:304] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:42.889541 28939 raft_consensus.cc:2749] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260203 09:16:42.889647 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 82654.3us
I20260203 09:16:42.890305 28932 tablet_bootstrap.cc:492] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:42.890796 28932 ts_tablet_manager.cc:1403] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.327s user 0.016s sys 0.005s
I20260203 09:16:42.893242 28871 tablet_service.cc:1505] Processing CreateTablet for tablet 6b71c6a3f2db4b738de03d5e4190cf27 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260203 09:16:42.893759 28932 raft_consensus.cc:359] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:42.894594 28871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b71c6a3f2db4b738de03d5e4190cf27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.894634 28932 raft_consensus.cc:385] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:42.895128 28932 raft_consensus.cc:740] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:42.895941 28932 consensus_queue.cc:260] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:42.897564 28722 tablet_service.cc:1505] Processing CreateTablet for tablet 2fe435e0235d42ec88a9773010ea1fec (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260203 09:16:42.899116 28875 tablet_service.cc:1505] Processing CreateTablet for tablet bd8e39da0721419098d343e576a8c0a2 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260203 09:16:42.904949 28777 leader_election.cc:343] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:42.905668 28723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b71c6a3f2db4b738de03d5e4190cf27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.905478 28777 leader_election.cc:304] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:42.912904 28938 raft_consensus.cc:493] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:42.913254 28939 raft_consensus.cc:2749] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:42.913486 28938 raft_consensus.cc:515] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:42.915634 28875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd8e39da0721419098d343e576a8c0a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.916188 28938 leader_election.cc:290] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:42.916703 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:42.918488 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:42.919162 28813 raft_consensus.cc:2468] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:42.907081 28932 ts_tablet_manager.cc:1434] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.016s user 0.007s sys 0.001s
I20260203 09:16:42.920581 28932 tablet_bootstrap.cc:492] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:42.921547 28722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fe435e0235d42ec88a9773010ea1fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.923269 28939 raft_consensus.cc:493] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:42.928038 28939 raft_consensus.cc:515] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:16:42.923593 28852 leader_election.cc:343] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:42.933542 28938 raft_consensus.cc:493] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:42.934046 28938 raft_consensus.cc:515] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:42.936211 28800 tablet_service.cc:1505] Processing CreateTablet for tablet 1dd859ca9f8b4cda8cca01872e191b47 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260203 09:16:42.941874 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:42.947424 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:42.948117 28813 raft_consensus.cc:2468] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:42.942399 28938 leader_election.cc:290] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
W20260203 09:16:42.948832 28852 leader_election.cc:343] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:42.943647 28851 leader_election.cc:304] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:42.945557 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:42.949295 28720 tablet_service.cc:1505] Processing CreateTablet for tablet 1dd859ca9f8b4cda8cca01872e191b47 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260203 09:16:42.920106 28870 tablet_service.cc:1505] Processing CreateTablet for tablet 2fe435e0235d42ec88a9773010ea1fec (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260203 09:16:42.946065 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:42.942909 28939 leader_election.cc:290] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:42.952554 28870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fe435e0235d42ec88a9773010ea1fec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.951193 28851 leader_election.cc:304] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:42.956782 28721 tablet_service.cc:1505] Processing CreateTablet for tablet fba8b1b8685b431e8328cdb7df4ad1d0 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260203 09:16:42.957973 28802 tablet_service.cc:1505] Processing CreateTablet for tablet fba8b1b8685b431e8328cdb7df4ad1d0 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260203 09:16:42.958853 28876 tablet_service.cc:1505] Processing CreateTablet for tablet 1dd859ca9f8b4cda8cca01872e191b47 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260203 09:16:42.960170 28876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dd859ca9f8b4cda8cca01872e191b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.963537 28932 tablet_bootstrap.cc:654] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:42.966984 28795 tablet_service.cc:1505] Processing CreateTablet for tablet b6c0f69b8ce94c9b9b4e64882eb25a2c (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260203 09:16:42.969067 28874 tablet_service.cc:1505] Processing CreateTablet for tablet b6c0f69b8ce94c9b9b4e64882eb25a2c (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260203 09:16:42.954190 28938 raft_consensus.cc:2804] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:42.974314 28720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dd859ca9f8b4cda8cca01872e191b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.949879 28727 tablet_service.cc:1505] Processing CreateTablet for tablet bd8e39da0721419098d343e576a8c0a2 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260203 09:16:42.973661 28777 leader_election.cc:343] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:42.976256 28889 raft_consensus.cc:2468] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
I20260203 09:16:42.973937 28879 tablet_service.cc:1505] Processing CreateTablet for tablet fba8b1b8685b431e8328cdb7df4ad1d0 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260203 09:16:42.977207 28800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dd859ca9f8b4cda8cca01872e191b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.977909 28797 tablet_service.cc:1505] Processing CreateTablet for tablet 15917cb595b149fd847e4ab4424f8262 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260203 09:16:42.988838 28797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15917cb595b149fd847e4ab4424f8262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.989454 28795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c0f69b8ce94c9b9b4e64882eb25a2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.988548 28777 leader_election.cc:304] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:42.990746 28939 raft_consensus.cc:2804] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:42.991140 28939 raft_consensus.cc:493] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:42.991463 28939 raft_consensus.cc:3060] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:42.983531 28938 raft_consensus.cc:493] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:42.993605 28802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fba8b1b8685b431e8328cdb7df4ad1d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.980626 28726 tablet_service.cc:1505] Processing CreateTablet for tablet 15917cb595b149fd847e4ab4424f8262 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260203 09:16:43.003486 28879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fba8b1b8685b431e8328cdb7df4ad1d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.997663 28938 raft_consensus.cc:3060] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:42.996400 28721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fba8b1b8685b431e8328cdb7df4ad1d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:42.973982 28719 tablet_service.cc:1505] Processing CreateTablet for tablet b6c0f69b8ce94c9b9b4e64882eb25a2c (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260203 09:16:43.022164 28726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15917cb595b149fd847e4ab4424f8262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:43.024070 28959 raft_consensus.cc:2804] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:43.024502 28959 raft_consensus.cc:493] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:43.024859 28959 raft_consensus.cc:3060] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:43.028403 28874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c0f69b8ce94c9b9b4e64882eb25a2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:43.027981 28727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd8e39da0721419098d343e576a8c0a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:43.032013 28719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c0f69b8ce94c9b9b4e64882eb25a2c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260203 09:16:43.026158 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 75083.1us
I20260203 09:16:43.037849 28933 tablet_bootstrap.cc:492] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:43.038491 28933 ts_tablet_manager.cc:1403] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.485s user 0.017s sys 0.005s
I20260203 09:16:43.041497 28933 raft_consensus.cc:359] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.064849 28933 raft_consensus.cc:385] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:43.065279 28933 raft_consensus.cc:740] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:43.066262 28933 consensus_queue.cc:260] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.047343 28875 tablet_service.cc:1505] Processing CreateTablet for tablet 15917cb595b149fd847e4ab4424f8262 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260203 09:16:43.052322 28798 tablet_service.cc:1505] Processing CreateTablet for tablet f4da79410aa74f5abca9517bbae98420 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260203 09:16:43.058167 28939 raft_consensus.cc:515] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.067968 28798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4da79410aa74f5abca9517bbae98420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:43.069525 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
W20260203 09:16:43.070966 28777 leader_election.cc:343] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:43.071872 28939 leader_election.cc:290] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:43.073509 28875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15917cb595b149fd847e4ab4424f8262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:43.073582 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:43.044139 28931 tablet_bootstrap.cc:492] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:43.074581 28931 ts_tablet_manager.cc:1403] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.367s user 0.026s sys 0.010s
I20260203 09:16:43.077662 28931 raft_consensus.cc:359] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.078438 28931 raft_consensus.cc:385] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:43.078743 28931 raft_consensus.cc:740] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:43.079564 28931 consensus_queue.cc:260] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.080330 28723 tablet_service.cc:1505] Processing CreateTablet for tablet f4da79410aa74f5abca9517bbae98420 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260203 09:16:43.081691 28723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4da79410aa74f5abca9517bbae98420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:43.090029 28799 tablet_service.cc:1505] Processing CreateTablet for tablet 6063a063fced4ff38761f892acbdfa76 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260203 09:16:43.090899 28933 ts_tablet_manager.cc:1434] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.052s user 0.005s sys 0.001s
I20260203 09:16:43.091952 28799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6063a063fced4ff38761f892acbdfa76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:43.094189 28725 tablet_service.cc:1505] Processing CreateTablet for tablet 6063a063fced4ff38761f892acbdfa76 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260203 09:16:43.095579 28725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6063a063fced4ff38761f892acbdfa76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:43.099043 28938 raft_consensus.cc:515] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.101689 28873 tablet_service.cc:1505] Processing CreateTablet for tablet f4da79410aa74f5abca9517bbae98420 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260203 09:16:43.113723 28801 tablet_service.cc:1505] Processing CreateTablet for tablet e18f9202613d46f68396231b64ee4ada (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260203 09:16:43.115103 28801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18f9202613d46f68396231b64ee4ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:43.117185 28877 tablet_service.cc:1505] Processing CreateTablet for tablet 6063a063fced4ff38761f892acbdfa76 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260203 09:16:43.118647 28877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6063a063fced4ff38761f892acbdfa76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:43.121301 28873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4da79410aa74f5abca9517bbae98420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:43.130291 28724 tablet_service.cc:1505] Processing CreateTablet for tablet e18f9202613d46f68396231b64ee4ada (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260203 09:16:43.131778 28724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18f9202613d46f68396231b64ee4ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:43.130755 28933 tablet_bootstrap.cc:492] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:43.133165 28889 raft_consensus.cc:2393] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 1: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:16:43.135502 28777 leader_election.cc:304] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:43.132483 28931 ts_tablet_manager.cc:1434] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.058s user 0.006s sys 0.001s
I20260203 09:16:43.145934 28939 raft_consensus.cc:2749] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260203 09:16:43.147082 28937 raft_consensus.cc:493] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:43.150379 28937 raft_consensus.cc:515] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.158272 28931 tablet_bootstrap.cc:492] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:43.159677 28937 leader_election.cc:290] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:43.160665 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:16:43.162361 28701 leader_election.cc:343] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:43.160706 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:16:43.165648 28700 leader_election.cc:343] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:43.166077 28700 leader_election.cc:304] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:43.167228 28937 raft_consensus.cc:2749] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:43.170064 28938 leader_election.cc:290] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:43.171398 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:43.172209 28813 raft_consensus.cc:2393] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 1: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:16:43.173746 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
W20260203 09:16:43.176015 28852 leader_election.cc:343] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:43.176546 28852 leader_election.cc:304] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:43.178503 28802 tablet_service.cc:1505] Processing CreateTablet for tablet 31afe6e1e9d24b89b4ac6d2e837fca22 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260203 09:16:43.180127 28802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31afe6e1e9d24b89b4ac6d2e837fca22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:43.181425 28721 tablet_service.cc:1505] Processing CreateTablet for tablet 31afe6e1e9d24b89b4ac6d2e837fca22 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260203 09:16:43.182742 28721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31afe6e1e9d24b89b4ac6d2e837fca22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:43.184099 28938 raft_consensus.cc:2749] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260203 09:16:43.185801 28959 raft_consensus.cc:515] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.181862 28871 tablet_service.cc:1505] Processing CreateTablet for tablet e18f9202613d46f68396231b64ee4ada (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260203 09:16:43.189024 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:43.189249 28959 leader_election.cc:290] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:43.189473 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:43.190021 28813 raft_consensus.cc:3060] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:16:43.190610 28852 leader_election.cc:343] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:43.191450 28871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18f9202613d46f68396231b64ee4ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:43.191147 28872 tablet_service.cc:1505] Processing CreateTablet for tablet 31afe6e1e9d24b89b4ac6d2e837fca22 (DEFAULT_TABLE table=test-workload [id=bf904e980c40401592cd3f9df9c34549]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260203 09:16:43.197913 28813 raft_consensus.cc:2468] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:43.199311 28851 leader_election.cc:304] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:43.200587 28959 raft_consensus.cc:2804] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:43.201113 28959 raft_consensus.cc:697] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:43.202013 28959 consensus_queue.cc:237] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.203905 28872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31afe6e1e9d24b89b4ac6d2e837fca22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:43.220309 28932 tablet_bootstrap.cc:492] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:43.220952 28932 ts_tablet_manager.cc:1403] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.301s user 0.022s sys 0.037s
I20260203 09:16:43.221983 28933 tablet_bootstrap.cc:654] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:43.225304 28932 raft_consensus.cc:359] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.226099 28932 raft_consensus.cc:385] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:43.226395 28932 raft_consensus.cc:740] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:43.227247 28932 consensus_queue.cc:260] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.231252 28932 ts_tablet_manager.cc:1434] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260203 09:16:43.232312 28932 tablet_bootstrap.cc:492] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:43.236322 28931 tablet_bootstrap.cc:654] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:43.252475 28932 tablet_bootstrap.cc:654] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:43.255224 28939 raft_consensus.cc:493] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:43.255965 28939 raft_consensus.cc:515] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.258162 28939 leader_election.cc:290] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:43.253755 28634 catalog_manager.cc:5654] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:43.259300 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:43.259316 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:43.260138 28737 raft_consensus.cc:2468] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
W20260203 09:16:43.260812 28777 leader_election.cc:343] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:43.261806 28777 leader_election.cc:304] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:16:43.263027 28939 raft_consensus.cc:2804] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:43.263407 28939 raft_consensus.cc:493] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:43.264432 28939 raft_consensus.cc:3060] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:43.265179 28933 tablet_bootstrap.cc:492] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:43.266004 28933 ts_tablet_manager.cc:1403] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.135s user 0.006s sys 0.009s
I20260203 09:16:43.269752 28933 raft_consensus.cc:359] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.270772 28933 raft_consensus.cc:385] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:43.271183 28933 raft_consensus.cc:740] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:43.272274 28933 consensus_queue.cc:260] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.293746 28939 raft_consensus.cc:515] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.296751 28931 tablet_bootstrap.cc:492] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:43.296537 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:43.296998 28932 tablet_bootstrap.cc:492] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:43.297251 28931 ts_tablet_manager.cc:1403] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.139s user 0.018s sys 0.016s
I20260203 09:16:43.297201 28737 raft_consensus.cc:3060] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:43.297529 28932 ts_tablet_manager.cc:1403] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.065s user 0.007s sys 0.011s
I20260203 09:16:43.300505 28932 raft_consensus.cc:359] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.301313 28932 raft_consensus.cc:385] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:43.301620 28932 raft_consensus.cc:740] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:43.304296 28932 consensus_queue.cc:260] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.300081 28931 raft_consensus.cc:359] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.309072 28737 raft_consensus.cc:2468] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:43.309206 28931 raft_consensus.cc:385] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:43.310249 28931 raft_consensus.cc:740] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:43.311170 28777 leader_election.cc:304] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:43.311277 28931 consensus_queue.cc:260] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.314131 28931 ts_tablet_manager.cc:1434] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.016s user 0.004s sys 0.004s
I20260203 09:16:43.315568 28931 tablet_bootstrap.cc:492] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:43.317672 28966 raft_consensus.cc:2804] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:43.321031 28966 raft_consensus.cc:697] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:16:43.321935 28933 ts_tablet_manager.cc:1434] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.056s user 0.011s sys 0.001s
I20260203 09:16:43.319929 28932 ts_tablet_manager.cc:1434] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.022s user 0.008s sys 0.000s
I20260203 09:16:43.322177 28966 consensus_queue.cc:237] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.322976 28931 tablet_bootstrap.cc:654] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:43.323446 28932 tablet_bootstrap.cc:492] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:43.324781 28939 leader_election.cc:290] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:43.326076 28933 tablet_bootstrap.cc:492] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:43.333429 28959 raft_consensus.cc:493] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:43.334041 28959 raft_consensus.cc:515] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.338281 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:16:43.340469 28852 leader_election.cc:343] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:43.342058 28959 leader_election.cc:290] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:43.343248 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:43.346534 28933 tablet_bootstrap.cc:654] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:43.347175 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:16:43.346448 28777 leader_election.cc:343] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:16:43.351203 28851 leader_election.cc:343] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:43.351706 28851 leader_election.cc:304] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:43.353267 28959 raft_consensus.cc:2749] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:43.356529 28931 tablet_bootstrap.cc:492] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:43.357339 28931 ts_tablet_manager.cc:1403] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.042s user 0.026s sys 0.006s
I20260203 09:16:43.360450 28933 tablet_bootstrap.cc:492] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:43.360714 28931 raft_consensus.cc:359] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.361331 28933 ts_tablet_manager.cc:1403] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.035s user 0.008s sys 0.006s
I20260203 09:16:43.361572 28931 raft_consensus.cc:385] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:43.361886 28931 raft_consensus.cc:740] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:43.353199 28932 tablet_bootstrap.cc:654] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:43.364581 28933 raft_consensus.cc:359] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.365674 28933 raft_consensus.cc:385] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:43.366055 28933 raft_consensus.cc:740] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:43.366951 28933 consensus_queue.cc:260] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.368062 28633 catalog_manager.cc:5654] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 0 to 1, leader changed from <none> to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:43.369580 28933 ts_tablet_manager.cc:1434] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.008s user 0.002s sys 0.005s
I20260203 09:16:43.370635 28933 tablet_bootstrap.cc:492] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:43.374527 28968 raft_consensus.cc:493] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:43.375236 28968 raft_consensus.cc:515] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.377475 28933 tablet_bootstrap.cc:654] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:43.376961 28931 consensus_queue.cc:260] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.379508 28931 ts_tablet_manager.cc:1434] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.022s user 0.005s sys 0.002s
I20260203 09:16:43.384918 28931 tablet_bootstrap.cc:492] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:43.393401 28968 leader_election.cc:290] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:43.395593 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:43.397432 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:43.397375 28931 tablet_bootstrap.cc:654] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
W20260203 09:16:43.401435 28777 leader_election.cc:343] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:16:43.402149 28777 leader_election.cc:343] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:43.402545 28777 leader_election.cc:304] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:43.403703 28968 raft_consensus.cc:2749] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:43.409543 28932 tablet_bootstrap.cc:492] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:43.410079 28932 ts_tablet_manager.cc:1403] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.087s user 0.012s sys 0.022s
I20260203 09:16:43.413733 28932 raft_consensus.cc:359] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.414525 28932 raft_consensus.cc:385] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:43.414808 28932 raft_consensus.cc:740] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:43.415560 28932 consensus_queue.cc:260] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.417093 28933 tablet_bootstrap.cc:492] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:43.417655 28933 ts_tablet_manager.cc:1403] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.047s user 0.006s sys 0.018s
I20260203 09:16:43.421221 28933 raft_consensus.cc:359] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.421995 28933 raft_consensus.cc:385] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:43.422364 28933 raft_consensus.cc:740] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:43.423218 28933 consensus_queue.cc:260] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.426126 28933 ts_tablet_manager.cc:1434] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.008s user 0.005s sys 0.003s
I20260203 09:16:43.426753 28932 ts_tablet_manager.cc:1434] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.016s user 0.005s sys 0.003s
I20260203 09:16:43.427620 28933 tablet_bootstrap.cc:492] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:43.431985 28931 tablet_bootstrap.cc:492] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:43.432695 28931 ts_tablet_manager.cc:1403] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.048s user 0.016s sys 0.000s
I20260203 09:16:43.435783 28933 tablet_bootstrap.cc:654] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:43.435995 28931 raft_consensus.cc:359] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.437005 28931 raft_consensus.cc:385] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:43.437381 28931 raft_consensus.cc:740] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:43.438334 28931 consensus_queue.cc:260] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.440426 28932 tablet_bootstrap.cc:492] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:43.448498 28932 tablet_bootstrap.cc:654] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:43.459775 28931 ts_tablet_manager.cc:1434] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.027s user 0.007s sys 0.000s
I20260203 09:16:43.466449 28932 tablet_bootstrap.cc:492] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:43.467001 28932 ts_tablet_manager.cc:1403] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.027s user 0.008s sys 0.012s
I20260203 09:16:43.470623 28932 raft_consensus.cc:359] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.471480 28932 raft_consensus.cc:385] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:43.471622 28931 tablet_bootstrap.cc:492] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:43.471807 28932 raft_consensus.cc:740] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:43.472918 28932 consensus_queue.cc:260] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.481547 28937 raft_consensus.cc:493] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:43.482200 28937 raft_consensus.cc:515] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.484475 28932 ts_tablet_manager.cc:1434] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.017s user 0.002s sys 0.006s
I20260203 09:16:43.484756 28937 leader_election.cc:290] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:43.486050 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:43.486625 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:43.486894 28889 raft_consensus.cc:2393] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 1: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:16:43.487380 28813 raft_consensus.cc:2393] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 1: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:16:43.488947 28700 leader_election.cc:304] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:43.490590 28937 raft_consensus.cc:3060] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:43.494629 28932 tablet_bootstrap.cc:492] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:43.501173 28937 raft_consensus.cc:2749] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:43.502054 28933 tablet_bootstrap.cc:492] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:43.502105 28932 tablet_bootstrap.cc:654] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:43.501906 28931 tablet_bootstrap.cc:654] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:43.502588 28933 ts_tablet_manager.cc:1403] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.075s user 0.034s sys 0.034s
I20260203 09:16:43.506153 28933 raft_consensus.cc:359] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.506945 28933 raft_consensus.cc:385] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:43.507231 28933 raft_consensus.cc:740] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:43.507951 28933 consensus_queue.cc:260] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.511063 28933 ts_tablet_manager.cc:1434] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260203 09:16:43.512475 28933 tablet_bootstrap.cc:492] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:43.518404 28933 tablet_bootstrap.cc:654] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:43.522028 28937 raft_consensus.cc:493] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:43.522918 28937 raft_consensus.cc:515] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.525302 28937 leader_election.cc:290] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:43.526432 28932 tablet_bootstrap.cc:492] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:43.526933 28932 ts_tablet_manager.cc:1403] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.033s user 0.022s sys 0.004s
I20260203 09:16:43.528167 28931 tablet_bootstrap.cc:492] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:43.528775 28931 ts_tablet_manager.cc:1403] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.058s user 0.005s sys 0.017s
I20260203 09:16:43.529559 28932 raft_consensus.cc:359] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.529989 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:43.530709 28889 raft_consensus.cc:2468] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 0.
I20260203 09:16:43.532632 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:43.533420 28701 leader_election.cc:304] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:43.533890 28813 raft_consensus.cc:2468] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 0.
I20260203 09:16:43.534927 28937 raft_consensus.cc:2804] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:43.530260 28932 raft_consensus.cc:385] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:43.535346 28937 raft_consensus.cc:493] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:43.535730 28937 raft_consensus.cc:3060] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:43.536736 28932 raft_consensus.cc:740] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:43.537662 28932 consensus_queue.cc:260] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.538089 28933 tablet_bootstrap.cc:492] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:43.538671 28933 ts_tablet_manager.cc:1403] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.026s user 0.006s sys 0.011s
I20260203 09:16:43.541424 28933 raft_consensus.cc:359] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.542124 28933 raft_consensus.cc:385] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:43.542378 28933 raft_consensus.cc:740] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:43.542975 28933 consensus_queue.cc:260] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.545300 28933 ts_tablet_manager.cc:1434] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260203 09:16:43.546247 28933 tablet_bootstrap.cc:492] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:43.549288 28932 ts_tablet_manager.cc:1434] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.022s user 0.007s sys 0.000s
I20260203 09:16:43.552592 28933 tablet_bootstrap.cc:654] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:43.562705 28932 tablet_bootstrap.cc:492] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:43.564193 28937 raft_consensus.cc:515] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.531939 28931 raft_consensus.cc:359] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.567688 28931 raft_consensus.cc:385] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:43.568194 28931 raft_consensus.cc:740] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:43.569162 28931 consensus_queue.cc:260] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.571228 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:43.571929 28813 raft_consensus.cc:3060] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:43.574086 28933 tablet_bootstrap.cc:492] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:43.574581 28933 ts_tablet_manager.cc:1403] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.029s user 0.017s sys 0.003s
W20260203 09:16:43.574631 28683 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:16:43.575887 28932 tablet_bootstrap.cc:654] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:43.577421 28933 raft_consensus.cc:359] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.578141 28933 raft_consensus.cc:385] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:43.578411 28933 raft_consensus.cc:740] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:43.579213 28933 consensus_queue.cc:260] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.581334 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:43.582121 28933 ts_tablet_manager.cc:1434] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260203 09:16:43.582166 28889 raft_consensus.cc:3060] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:43.583257 28933 tablet_bootstrap.cc:492] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:43.590507 28931 ts_tablet_manager.cc:1434] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.061s user 0.008s sys 0.002s
I20260203 09:16:43.591770 28931 tablet_bootstrap.cc:492] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:43.598348 28959 raft_consensus.cc:493] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:43.599052 28959 raft_consensus.cc:515] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.600574 28933 tablet_bootstrap.cc:654] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:43.598980 28931 tablet_bootstrap.cc:654] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:43.604709 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:43.605611 28737 raft_consensus.cc:2468] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:43.606609 28959 leader_election.cc:290] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:43.608096 28852 leader_election.cc:304] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:43.609330 28968 raft_consensus.cc:493] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:43.610615 28968 raft_consensus.cc:515] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.613770 28968 leader_election.cc:290] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:43.616545 28938 raft_consensus.cc:2804] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:43.616998 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:43.617036 28938 raft_consensus.cc:493] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:43.618615 28938 raft_consensus.cc:3060] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:43.627383 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:16:43.630451 28777 leader_election.cc:343] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:43.628360 28737 raft_consensus.cc:2468] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
I20260203 09:16:43.632925 28777 leader_election.cc:304] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:16:43.634120 28966 raft_consensus.cc:493] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:43.634713 28966 raft_consensus.cc:515] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.638677 28966 leader_election.cc:290] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:43.640151 28966 raft_consensus.cc:2804] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:43.646482 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:43.649233 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:43.652974 28966 raft_consensus.cc:493] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:43.656929 28966 raft_consensus.cc:3060] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:16:43.655895 28777 leader_election.cc:343] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:16:43.661482 28777 leader_election.cc:343] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:43.665959 28777 leader_election.cc:304] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:16:43.655035 28852 consensus_peers.cc:597] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:16:43.673134 28968 raft_consensus.cc:2749] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:43.676313 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:43.693673 28937 leader_election.cc:290] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:43.695299 28959 raft_consensus.cc:493] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:43.700105 28959 raft_consensus.cc:515] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.702806 28959 leader_election.cc:290] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:43.704838 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:43.706336 28737 raft_consensus.cc:2468] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:43.708272 28852 leader_election.cc:304] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:43.709607 28959 raft_consensus.cc:2804] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:43.710168 28959 raft_consensus.cc:493] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:43.712070 28959 raft_consensus.cc:3060] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:43.711340 28813 raft_consensus.cc:2468] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:16:43.718474 28700 leader_election.cc:304] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:43.720513 28968 raft_consensus.cc:493] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:43.721310 28968 raft_consensus.cc:515] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.726220 28968 leader_election.cc:290] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:43.728057 28984 raft_consensus.cc:493] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:43.728701 28984 raft_consensus.cc:515] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.731073 28984 leader_election.cc:290] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:43.731712 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:43.733624 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "021e904a783c4cbc96e5aa625a34a2d8" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:43.734648 28887 raft_consensus.cc:2468] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 0.
I20260203 09:16:43.737095 28701 leader_election.cc:304] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:43.738155 28984 raft_consensus.cc:2804] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:43.738722 28984 raft_consensus.cc:493] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:43.739104 28984 raft_consensus.cc:3060] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:43.746016 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "021e904a783c4cbc96e5aa625a34a2d8" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:43.746994 28812 raft_consensus.cc:2468] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 0.
I20260203 09:16:43.753268 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:16:43.759014 28777 consensus_peers.cc:597] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Couldn't send request to peer 77541303e1934638ba82f0f43f707adc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:16:43.763121 28777 leader_election.cc:343] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:16:43.764101 28777 leader_election.cc:343] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:43.764716 28777 leader_election.cc:304] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:43.719893 28937 raft_consensus.cc:2804] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election won for term 1
W20260203 09:16:43.762099 28851 leader_election.cc:343] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:43.672434 28938 raft_consensus.cc:515] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.771858 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:43.772804 28737 raft_consensus.cc:3060] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:43.777873 28984 raft_consensus.cc:515] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.800688 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "021e904a783c4cbc96e5aa625a34a2d8" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:43.801594 28813 raft_consensus.cc:3060] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:43.698355 28889 raft_consensus.cc:2468] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:16:43.785480 28938 leader_election.cc:290] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:43.793051 28968 raft_consensus.cc:2749] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:43.797480 28937 raft_consensus.cc:697] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:16:43.808416 28937 consensus_queue.cc:237] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.816044 28931 tablet_bootstrap.cc:492] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:43.816706 28931 ts_tablet_manager.cc:1403] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.225s user 0.048s sys 0.058s
I20260203 09:16:43.818548 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:43.819384 28812 raft_consensus.cc:2468] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:43.819617 28931 raft_consensus.cc:359] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.820343 28931 raft_consensus.cc:385] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:43.820621 28931 raft_consensus.cc:740] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:43.823192 28933 tablet_bootstrap.cc:492] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:43.823734 28933 ts_tablet_manager.cc:1403] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.241s user 0.049s sys 0.055s
I20260203 09:16:43.826844 28933 raft_consensus.cc:359] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.827613 28933 raft_consensus.cc:385] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:43.827914 28933 raft_consensus.cc:740] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:43.828606 28933 consensus_queue.cc:260] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.829979 28931 consensus_queue.cc:260] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.832283 28931 ts_tablet_manager.cc:1434] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.015s user 0.002s sys 0.004s
I20260203 09:16:43.833355 28931 tablet_bootstrap.cc:492] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:43.834676 28984 leader_election.cc:290] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:43.835875 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "021e904a783c4cbc96e5aa625a34a2d8" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:43.837363 28889 raft_consensus.cc:3060] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:43.841358 28933 ts_tablet_manager.cc:1434] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.017s user 0.008s sys 0.000s
I20260203 09:16:43.841650 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:43.842499 28933 tablet_bootstrap.cc:492] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:43.845650 28938 consensus_queue.cc:1048] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:43.849427 28966 raft_consensus.cc:515] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.853027 28966 leader_election.cc:290] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:43.853165 28931 tablet_bootstrap.cc:654] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:43.854391 28933 tablet_bootstrap.cc:654] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
W20260203 09:16:43.854437 28851 leader_election.cc:343] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:43.856000 28968 consensus_queue.cc:1048] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:43.858247 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:43.881563 28738 raft_consensus.cc:3060] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:43.882136 28633 catalog_manager.cc:5654] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 0 to 1, leader changed from <none> to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:43.861239 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:43.865190 28932 tablet_bootstrap.cc:492] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:43.885645 28932 ts_tablet_manager.cc:1403] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.323s user 0.109s sys 0.154s
W20260203 09:16:43.886726 28777 leader_election.cc:343] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:43.888329 28932 raft_consensus.cc:359] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.892256 28932 raft_consensus.cc:385] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:43.892629 28932 raft_consensus.cc:740] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:43.827236 28737 raft_consensus.cc:2468] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:43.893438 28932 consensus_queue.cc:260] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.894601 28852 leader_election.cc:304] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:43.873574 28813 raft_consensus.cc:2468] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:16:43.870896 28889 raft_consensus.cc:2468] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:16:43.895346 28933 tablet_bootstrap.cc:492] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:43.895951 28933 ts_tablet_manager.cc:1403] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.054s user 0.016s sys 0.002s
I20260203 09:16:43.896627 28701 leader_election.cc:304] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:43.898034 28937 raft_consensus.cc:2804] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:43.899025 28933 raft_consensus.cc:359] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.899852 28933 raft_consensus.cc:385] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:43.900149 28933 raft_consensus.cc:740] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:43.900481 28937 raft_consensus.cc:697] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:16:43.901479 28933 consensus_queue.cc:260] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.901917 28988 raft_consensus.cc:2804] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:43.902470 28988 raft_consensus.cc:697] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:43.903322 28988 consensus_queue.cc:237] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.906823 28932 ts_tablet_manager.cc:1434] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20260203 09:16:43.914407 28933 ts_tablet_manager.cc:1434] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.018s user 0.000s sys 0.007s
I20260203 09:16:43.915657 28933 tablet_bootstrap.cc:492] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:43.919037 28937 consensus_queue.cc:237] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.920128 28932 tablet_bootstrap.cc:492] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:43.922662 28933 tablet_bootstrap.cc:654] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:43.925002 28738 raft_consensus.cc:2468] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:43.929903 28777 leader_election.cc:304] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:16:43.930830 28966 raft_consensus.cc:2804] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:43.865558 28959 raft_consensus.cc:515] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.934243 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:43.934984 28737 raft_consensus.cc:3060] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:43.935019 28968 raft_consensus.cc:493] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:43.935690 28968 raft_consensus.cc:515] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.928400 28932 tablet_bootstrap.cc:654] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:43.931376 28966 raft_consensus.cc:697] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:16:43.943475 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:43.945080 28813 raft_consensus.cc:3060] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:43.947402 28966 consensus_queue.cc:237] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.950165 28633 catalog_manager.cc:5654] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:43.951169 28968 leader_election.cc:290] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:43.953008 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47301e2bbfc94767a9905b0e12141d6d" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:16:43.954928 28777 leader_election.cc:343] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:43.937716 28959 leader_election.cc:290] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:43.960115 28737 raft_consensus.cc:2468] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:43.965531 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47301e2bbfc94767a9905b0e12141d6d" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:43.968753 28852 leader_election.cc:304] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:43.971336 28813 raft_consensus.cc:2468] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:43.975699 28931 tablet_bootstrap.cc:492] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:43.976358 28931 ts_tablet_manager.cc:1403] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.143s user 0.015s sys 0.035s
I20260203 09:16:43.980577 28933 tablet_bootstrap.cc:492] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:43.981356 28933 ts_tablet_manager.cc:1403] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.066s user 0.021s sys 0.006s
W20260203 09:16:43.983587 28777 leader_election.cc:343] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:43.984462 28777 leader_election.cc:304] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:43.986053 28966 raft_consensus.cc:2749] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:43.979614 28959 raft_consensus.cc:2804] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:43.989243 28959 raft_consensus.cc:697] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:43.990300 28959 consensus_queue.cc:237] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:43.998389 28933 raft_consensus.cc:359] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.006121 28933 raft_consensus.cc:385] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:44.006596 28933 raft_consensus.cc:740] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:44.007499 28933 consensus_queue.cc:260] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.010347 28933 ts_tablet_manager.cc:1434] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.029s user 0.006s sys 0.001s
I20260203 09:16:44.011529 28933 tablet_bootstrap.cc:492] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:44.011058 28634 catalog_manager.cc:5654] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 0 to 1, leader changed from <none> to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:44.019656 28933 tablet_bootstrap.cc:654] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:44.023756 28932 tablet_bootstrap.cc:492] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:44.024298 28932 ts_tablet_manager.cc:1403] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.104s user 0.020s sys 0.026s
I20260203 09:16:44.027261 28932 raft_consensus.cc:359] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.027992 28932 raft_consensus.cc:385] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:44.028275 28932 raft_consensus.cc:740] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:44.024147 28931 raft_consensus.cc:359] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.031276 28931 raft_consensus.cc:385] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:44.031584 28931 raft_consensus.cc:740] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:44.032282 28931 consensus_queue.cc:260] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.033129 28932 consensus_queue.cc:260] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.034744 28931 ts_tablet_manager.cc:1434] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.058s user 0.006s sys 0.000s
I20260203 09:16:44.035751 28931 tablet_bootstrap.cc:492] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:44.037945 28932 ts_tablet_manager.cc:1434] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20260203 09:16:44.038949 28932 tablet_bootstrap.cc:492] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:44.039496 28937 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:44.040023 28937 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.044019 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:44.045356 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:16:44.045791 28700 leader_election.cc:343] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:16:44.047194 28701 leader_election.cc:343] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:44.047686 28701 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:44.047873 28635 catalog_manager.cc:5654] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 0 to 1, leader changed from <none> to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:44.048683 28989 raft_consensus.cc:2749] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:44.051430 28937 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:44.057870 28932 tablet_bootstrap.cc:654] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:44.070451 28633 catalog_manager.cc:5654] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:44.086223 28939 raft_consensus.cc:493] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:44.086897 28931 tablet_bootstrap.cc:654] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:44.086920 28939 raft_consensus.cc:515] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.092375 28939 leader_election.cc:290] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:44.094581 28932 tablet_bootstrap.cc:492] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:44.095194 28932 ts_tablet_manager.cc:1403] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.056s user 0.016s sys 0.018s
I20260203 09:16:44.098081 28933 tablet_bootstrap.cc:492] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:44.098541 28933 ts_tablet_manager.cc:1403] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.087s user 0.013s sys 0.016s
I20260203 09:16:44.097628 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:44.099357 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:44.099609 28889 raft_consensus.cc:2468] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
I20260203 09:16:44.100893 28932 raft_consensus.cc:359] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.101626 28932 raft_consensus.cc:385] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:44.101894 28932 raft_consensus.cc:740] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:44.101856 28777 leader_election.cc:304] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:44.102818 28932 consensus_queue.cc:260] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.103538 28939 raft_consensus.cc:2804] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:44.104024 28939 raft_consensus.cc:493] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:44.104418 28939 raft_consensus.cc:3060] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:44.105410 28932 ts_tablet_manager.cc:1434] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.010s user 0.007s sys 0.002s
W20260203 09:16:44.106490 28777 leader_election.cc:343] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:44.109539 28932 tablet_bootstrap.cc:492] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:44.119778 28959 raft_consensus.cc:493] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:44.120371 28959 raft_consensus.cc:515] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.123384 28937 raft_consensus.cc:493] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:44.123982 28959 leader_election.cc:290] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:44.124303 28937 raft_consensus.cc:515] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.124524 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:44.125152 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:44.126854 28851 leader_election.cc:304] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:44.127365 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:44.127094 28933 raft_consensus.cc:359] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.128968 28931 tablet_bootstrap.cc:492] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:44.129149 28933 raft_consensus.cc:385] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:44.129344 28931 ts_tablet_manager.cc:1403] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.094s user 0.015s sys 0.015s
I20260203 09:16:44.129372 28933 raft_consensus.cc:740] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
W20260203 09:16:44.130180 28700 leader_election.cc:343] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:44.130385 28959 raft_consensus.cc:2749] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:44.132248 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:16:44.133855 28701 leader_election.cc:343] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:44.133911 28931 raft_consensus.cc:359] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.134378 28701 leader_election.cc:304] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:44.134681 28931 raft_consensus.cc:385] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:44.134963 28931 raft_consensus.cc:740] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:44.135241 28989 raft_consensus.cc:2749] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:44.135605 28931 consensus_queue.cc:260] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.137843 28931 ts_tablet_manager.cc:1434] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260203 09:16:44.136148 28937 leader_election.cc:290] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:44.139356 28989 raft_consensus.cc:493] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:44.139901 28989 raft_consensus.cc:515] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.141583 28932 tablet_bootstrap.cc:654] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:44.142113 28989 leader_election.cc:290] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:44.142063 28939 raft_consensus.cc:515] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.144032 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:44.144366 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:44.146500 28701 leader_election.cc:304] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:44.148012 28937 raft_consensus.cc:2749] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:44.150033 28939 leader_election.cc:290] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:44.154033 28932 tablet_bootstrap.cc:492] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:44.154533 28932 ts_tablet_manager.cc:1403] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.045s user 0.017s sys 0.011s
I20260203 09:16:44.155241 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:44.155737 28889 raft_consensus.cc:3060] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:44.157316 28932 raft_consensus.cc:359] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.158021 28932 raft_consensus.cc:385] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:44.158278 28932 raft_consensus.cc:740] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:44.158934 28932 consensus_queue.cc:260] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.161154 28932 ts_tablet_manager.cc:1434] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260203 09:16:44.154482 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:44.163655 28932 tablet_bootstrap.cc:492] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
W20260203 09:16:44.164336 28777 leader_election.cc:343] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:44.164947 28931 tablet_bootstrap.cc:492] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:44.169842 28932 tablet_bootstrap.cc:654] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:44.172864 28889 raft_consensus.cc:2468] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:44.175423 28777 leader_election.cc:304] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:44.176889 28939 raft_consensus.cc:2804] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:44.177412 28939 raft_consensus.cc:697] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:16:44.178226 28939 consensus_queue.cc:237] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.173461 28933 consensus_queue.cc:260] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.183743 28933 ts_tablet_manager.cc:1434] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.085s user 0.007s sys 0.000s
I20260203 09:16:44.184993 28933 tablet_bootstrap.cc:492] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:44.185041 28959 raft_consensus.cc:493] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:44.185580 28959 raft_consensus.cc:515] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.189018 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:44.188436 28959 leader_election.cc:290] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:44.190435 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:44.191165 28812 raft_consensus.cc:2468] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:44.192543 28851 leader_election.cc:304] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
W20260203 09:16:44.193177 28852 leader_election.cc:343] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:44.193604 28959 raft_consensus.cc:2804] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:44.194049 28959 raft_consensus.cc:493] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:44.194417 28959 raft_consensus.cc:3060] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:44.196803 28932 tablet_bootstrap.cc:492] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:44.197391 28931 tablet_bootstrap.cc:654] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:44.203008 28933 tablet_bootstrap.cc:654] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:44.197387 28932 ts_tablet_manager.cc:1403] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.034s user 0.012s sys 0.010s
I20260203 09:16:44.217064 28959 raft_consensus.cc:515] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.221921 28932 raft_consensus.cc:359] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.222788 28932 raft_consensus.cc:385] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:44.223078 28932 raft_consensus.cc:740] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:44.223557 28937 consensus_queue.cc:1048] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:44.223789 28932 consensus_queue.cc:260] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.225138 28938 raft_consensus.cc:493] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:44.225757 28938 raft_consensus.cc:515] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.233412 28932 ts_tablet_manager.cc:1434] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.028s user 0.007s sys 0.000s
I20260203 09:16:44.234709 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:44.240507 28812 raft_consensus.cc:2468] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:44.236182 28932 tablet_bootstrap.cc:492] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:44.235150 28736 raft_consensus.cc:3060] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:44.243307 28851 leader_election.cc:304] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:44.253410 29006 raft_consensus.cc:2804] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:44.234941 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:44.255000 29006 raft_consensus.cc:493] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:44.255533 29006 raft_consensus.cc:3060] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:16:44.256516 28852 leader_election.cc:343] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:44.235956 28938 leader_election.cc:290] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:44.260313 28633 catalog_manager.cc:5654] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 0 to 1, leader changed from <none> to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:44.268550 28959 leader_election.cc:290] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:44.271294 28932 tablet_bootstrap.cc:654] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:44.278683 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:44.279346 28812 raft_consensus.cc:3060] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:44.280297 29006 raft_consensus.cc:515] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.282198 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:44.283561 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
W20260203 09:16:44.285936 28852 leader_election.cc:343] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:44.287094 28889 raft_consensus.cc:3060] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:44.289799 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:44.290632 29006 leader_election.cc:290] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:44.291054 28811 raft_consensus.cc:3060] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:16:44.293032 28852 leader_election.cc:343] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:44.296108 28933 tablet_bootstrap.cc:492] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:44.298839 28938 raft_consensus.cc:493] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:44.300688 28933 ts_tablet_manager.cc:1403] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.116s user 0.034s sys 0.016s
I20260203 09:16:44.300861 28938 raft_consensus.cc:515] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.304335 28938 leader_election.cc:290] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:44.307451 28931 tablet_bootstrap.cc:492] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:44.308267 28931 ts_tablet_manager.cc:1403] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.144s user 0.016s sys 0.019s
I20260203 09:16:44.307454 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:44.309240 28933 raft_consensus.cc:359] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.309907 28933 raft_consensus.cc:385] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:44.310180 28933 raft_consensus.cc:740] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:44.310832 28933 consensus_queue.cc:260] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.312760 28933 ts_tablet_manager.cc:1434] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260203 09:16:44.313695 28933 tablet_bootstrap.cc:492] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:44.313589 28984 consensus_queue.cc:1048] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:44.314821 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:44.315599 28737 raft_consensus.cc:2393] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 1: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:16:44.317457 28852 leader_election.cc:304] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:44.317792 28812 raft_consensus.cc:2468] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:44.318368 28938 raft_consensus.cc:3060] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:44.319027 28851 leader_election.cc:304] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:44.320712 29006 raft_consensus.cc:2804] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:44.326992 29006 raft_consensus.cc:697] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:44.329463 29006 consensus_queue.cc:237] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.334664 28938 raft_consensus.cc:2749] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:44.330791 28989 consensus_queue.cc:1048] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260203 09:16:44.337697 28811 raft_consensus.cc:2468] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:44.350479 28931 raft_consensus.cc:359] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.351320 28931 raft_consensus.cc:385] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:44.351635 28931 raft_consensus.cc:740] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:44.351567 28851 leader_election.cc:304] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:44.352455 28931 consensus_queue.cc:260] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.353549 28959 raft_consensus.cc:2804] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:44.357331 28931 ts_tablet_manager.cc:1434] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.049s user 0.004s sys 0.003s
I20260203 09:16:44.358403 28931 tablet_bootstrap.cc:492] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:44.360913 28959 raft_consensus.cc:697] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:44.373652 28959 consensus_queue.cc:237] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.378585 28937 consensus_queue.cc:1048] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:44.429533 28966 raft_consensus.cc:493] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:44.430112 28966 raft_consensus.cc:515] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.434826 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:44.432471 28966 leader_election.cc:290] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:44.435796 28737 raft_consensus.cc:2468] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
I20260203 09:16:44.443250 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:44.447961 28966 raft_consensus.cc:493] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:44.448736 28966 raft_consensus.cc:515] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:16:44.449309 28777 leader_election.cc:343] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:44.450256 28777 leader_election.cc:304] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:16:44.451272 28939 raft_consensus.cc:2804] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:44.453008 28939 raft_consensus.cc:493] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:44.453402 28939 raft_consensus.cc:3060] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:44.454442 28966 leader_election.cc:290] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:44.456749 28966 consensus_queue.cc:1048] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:44.458591 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:44.458438 28988 consensus_queue.cc:1048] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:44.459394 28737 raft_consensus.cc:2393] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 1: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:16:44.464210 28988 consensus_queue.cc:1048] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:44.460621 28938 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:44.471859 28809 raft_consensus.cc:3060] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:44.469303 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:44.480626 28777 leader_election.cc:304] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:44.480638 28932 tablet_bootstrap.cc:492] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:44.483026 28932 ts_tablet_manager.cc:1403] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.247s user 0.039s sys 0.024s
I20260203 09:16:44.470419 28938 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.491664 28932 raft_consensus.cc:359] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.493683 28932 raft_consensus.cc:385] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:44.494129 28932 raft_consensus.cc:740] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:44.494910 28932 consensus_queue.cc:260] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.492952 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:44.495862 28938 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:44.567819 28932 ts_tablet_manager.cc:1434] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.084s user 0.004s sys 0.005s
I20260203 09:16:44.516463 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:44.572880 28938 raft_consensus.cc:493] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:44.573566 28938 raft_consensus.cc:515] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.575819 28938 leader_election.cc:290] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:44.594364 28932 tablet_bootstrap.cc:492] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
W20260203 09:16:44.516964 28851 leader_election.cc:343] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:44.605181 28931 tablet_bootstrap.cc:654] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:44.610160 28933 tablet_bootstrap.cc:654] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:44.604779 28959 raft_consensus.cc:493] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:44.613639 28959 raft_consensus.cc:515] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.605885 28989 raft_consensus.cc:493] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:44.618479 28989 raft_consensus.cc:515] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.621794 29028 raft_consensus.cc:493] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:44.622357 29028 raft_consensus.cc:515] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:16:44.607695 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 89256.7us
W20260203 09:16:44.625942 28683 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:16:44.603950 28735 raft_consensus.cc:2468] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:44.608629 28939 raft_consensus.cc:515] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.634258 28989 leader_election.cc:290] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:44.634538 28939 leader_election.cc:290] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:44.637171 28932 tablet_bootstrap.cc:654] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:44.635715 29026 consensus_queue.cc:1048] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260203 09:16:44.637586 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:44.638188 28887 raft_consensus.cc:2468] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 0.
I20260203 09:16:44.628322 28959 leader_election.cc:290] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:44.624600 29028 leader_election.cc:290] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:44.640702 28938 consensus_queue.cc:1048] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:44.640928 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:44.649768 28810 raft_consensus.cc:2468] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 0.
I20260203 09:16:44.647578 28635 catalog_manager.cc:5654] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:44.651808 28852 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:44.651361 28635 catalog_manager.cc:5654] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:44.644523 28701 leader_election.cc:304] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:44.654336 28988 raft_consensus.cc:2804] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:44.644881 28966 raft_consensus.cc:2749] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:44.656947 28989 raft_consensus.cc:2804] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:44.661842 28989 raft_consensus.cc:493] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:44.662221 28989 raft_consensus.cc:3060] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:44.717440 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:44.710269 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:44.657699 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:44.715370 28989 raft_consensus.cc:515] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.655705 28988 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:44.667836 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:44.735217 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:44.736088 28809 raft_consensus.cc:2468] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:44.665336 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:44.738955 28932 tablet_bootstrap.cc:492] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:44.741909 28932 ts_tablet_manager.cc:1403] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.148s user 0.017s sys 0.000s
I20260203 09:16:44.742153 29034 raft_consensus.cc:493] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:44.742707 29034 raft_consensus.cc:515] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.724562 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:44.748332 28989 leader_election.cc:290] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:44.749001 28736 raft_consensus.cc:2393] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 1: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:16:44.749140 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:44.725838 28959 consensus_queue.cc:1048] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260203 09:16:44.719470 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
W20260203 09:16:44.750610 28852 leader_election.cc:343] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:44.748257 28733 raft_consensus.cc:3060] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:44.751452 28931 tablet_bootstrap.cc:492] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:44.739962 28811 raft_consensus.cc:2468] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:44.725921 28887 raft_consensus.cc:2468] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
I20260203 09:16:44.752077 28932 raft_consensus.cc:359] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.772718 28931 ts_tablet_manager.cc:1403] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.414s user 0.040s sys 0.053s
W20260203 09:16:44.756274 28777 consensus_peers.cc:597] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:16:44.733274 28988 raft_consensus.cc:3060] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:44.770887 29034 leader_election.cc:290] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:44.772881 28932 raft_consensus.cc:385] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:44.774047 28932 raft_consensus.cc:740] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:44.774784 28932 consensus_queue.cc:260] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.771611 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:44.775908 28886 raft_consensus.cc:3060] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:44.777700 28851 leader_election.cc:304] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:44.778062 28931 raft_consensus.cc:359] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.778849 28931 raft_consensus.cc:385] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:44.779062 28931 raft_consensus.cc:740] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:44.779626 28931 consensus_queue.cc:260] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.781261 28932 ts_tablet_manager.cc:1434] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.039s user 0.006s sys 0.001s
I20260203 09:16:44.782358 28932 tablet_bootstrap.cc:492] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:44.779006 28889 raft_consensus.cc:3060] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:44.782918 29034 raft_consensus.cc:2804] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:44.789531 28931 ts_tablet_manager.cc:1434] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.016s user 0.003s sys 0.003s
I20260203 09:16:44.790509 28931 tablet_bootstrap.cc:492] T 574d0205e57547c6938037563109a6d2 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:44.790417 29034 raft_consensus.cc:493] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:44.794697 29034 raft_consensus.cc:3060] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:44.795840 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:44.808729 28933 tablet_bootstrap.cc:492] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:44.809122 28933 ts_tablet_manager.cc:1403] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.496s user 0.029s sys 0.030s
I20260203 09:16:44.809719 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:44.801371 28851 leader_election.cc:304] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:44.813493 28933 raft_consensus.cc:359] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.814136 28933 raft_consensus.cc:385] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:44.814386 28933 raft_consensus.cc:740] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:44.814904 28933 consensus_queue.cc:260] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.805341 28735 raft_consensus.cc:2468] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:44.816421 28809 raft_consensus.cc:2468] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
W20260203 09:16:44.817433 28852 consensus_peers.cc:597] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:16:44.829457 28777 leader_election.cc:304] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:44.831563 29030 raft_consensus.cc:2804] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:44.832098 29030 raft_consensus.cc:493] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:44.832481 29030 raft_consensus.cc:3060] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:44.836613 28933 ts_tablet_manager.cc:1434] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.027s user 0.006s sys 0.000s
I20260203 09:16:44.837448 28933 tablet_bootstrap.cc:492] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:44.819286 28852 leader_election.cc:304] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:44.838965 28966 consensus_queue.cc:1048] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260203 09:16:44.850610 28938 raft_consensus.cc:2804] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:16:44.851205 28938 raft_consensus.cc:493] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:44.851584 28938 raft_consensus.cc:3060] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:44.854055 28733 raft_consensus.cc:2468] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:44.864344 28886 raft_consensus.cc:2468] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:16:44.866648 29035 raft_consensus.cc:2764] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260203 09:16:44.863566 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 44382.2us
I20260203 09:16:44.874794 28701 leader_election.cc:304] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:44.875810 28989 raft_consensus.cc:2804] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:44.876327 28989 raft_consensus.cc:697] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
W20260203 09:16:44.878397 29038 log.cc:927] Time spent T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.054s user 0.001s sys 0.000s
I20260203 09:16:44.878433 28989 consensus_queue.cc:237] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.894150 28933 tablet_bootstrap.cc:654] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:44.904528 28938 raft_consensus.cc:515] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.904994 29030 raft_consensus.cc:515] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.901517 28889 raft_consensus.cc:2468] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
W20260203 09:16:44.897168 28852 consensus_peers.cc:597] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:16:44.922700 28932 tablet_bootstrap.cc:654] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:44.923606 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:44.924222 28738 raft_consensus.cc:3060] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
W20260203 09:16:44.909183 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 58817.7us
I20260203 09:16:44.927613 28777 leader_election.cc:304] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:44.929255 29026 raft_consensus.cc:2804] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:44.929828 29026 raft_consensus.cc:697] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:16:44.931572 29026 consensus_queue.cc:237] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.933117 28738 raft_consensus.cc:2468] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:16:44.934181 28988 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.936826 29030 leader_election.cc:290] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:44.942615 28852 leader_election.cc:304] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:44.941358 28938 leader_election.cc:290] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:44.943137 28988 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:44.947876 28988 consensus_queue.cc:1048] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:44.938033 29034 raft_consensus.cc:515] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:16:44.944491 28918 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.IsCreateTableDone -> {remote=127.26.232.126:35239, user_credentials={real_user=slave}} blocked reactor thread for 48331.3us
I20260203 09:16:44.950599 29034 leader_election.cc:290] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:44.950589 29035 raft_consensus.cc:2804] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:16:44.951136 29034 consensus_queue.cc:1048] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:44.951500 29035 raft_consensus.cc:697] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:44.948997 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:44.953015 29035 consensus_queue.cc:237] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.954550 29028 raft_consensus.cc:493] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:44.960906 29028 raft_consensus.cc:515] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:44.963157 29028 leader_election.cc:290] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:44.970446 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:44.979141 28738 raft_consensus.cc:3060] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:44.979815 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:44.982888 28886 raft_consensus.cc:2393] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 1: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:16:44.982008 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:44.989715 28635 catalog_manager.cc:5654] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 0 to 1, leader changed from <none> to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:44.994675 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
W20260203 09:16:44.994935 28852 leader_election.cc:343] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:44.995391 28812 raft_consensus.cc:3060] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:45.002081 28634 catalog_manager.cc:5654] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 0 to 1, leader changed from <none> to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:45.011051 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:45.015086 28933 tablet_bootstrap.cc:492] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:45.015575 28933 ts_tablet_manager.cc:1403] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.178s user 0.012s sys 0.004s
I20260203 09:16:45.021100 28933 raft_consensus.cc:359] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.022116 28933 raft_consensus.cc:385] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:45.022401 28933 raft_consensus.cc:740] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:45.024935 28931 tablet_bootstrap.cc:654] T 574d0205e57547c6938037563109a6d2 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:45.025141 28932 tablet_bootstrap.cc:492] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:45.026074 28932 ts_tablet_manager.cc:1403] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.244s user 0.015s sys 0.018s
I20260203 09:16:45.025406 28812 raft_consensus.cc:2468] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:16:45.026870 28933 consensus_queue.cc:260] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.029290 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:45.029979 28809 raft_consensus.cc:3060] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:45.033308 28635 catalog_manager.cc:5654] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 2, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 2 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:45.034063 28738 raft_consensus.cc:2468] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:45.036422 28932 raft_consensus.cc:359] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.039610 28932 raft_consensus.cc:385] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:45.039964 28932 raft_consensus.cc:740] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:45.040637 28932 consensus_queue.cc:260] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.041060 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:45.042284 28777 leader_election.cc:304] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:45.042616 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:45.043037 29030 raft_consensus.cc:2749] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260203 09:16:45.037533 28851 leader_election.cc:343] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:45.044502 28852 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:45.047410 29035 raft_consensus.cc:2804] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:45.047924 29035 raft_consensus.cc:697] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:45.044533 28933 ts_tablet_manager.cc:1434] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.029s user 0.004s sys 0.004s
I20260203 09:16:45.049232 29035 consensus_queue.cc:237] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.056897 28933 tablet_bootstrap.cc:492] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:45.064306 28932 ts_tablet_manager.cc:1434] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.038s user 0.007s sys 0.000s
I20260203 09:16:45.068427 28932 tablet_bootstrap.cc:492] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:45.070536 28809 raft_consensus.cc:2468] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
W20260203 09:16:45.065596 28777 leader_election.cc:343] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:16:45.082279 28777 leader_election.cc:343] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:45.082749 28777 leader_election.cc:304] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:45.083683 29026 raft_consensus.cc:2749] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:45.084990 28851 leader_election.cc:304] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:45.085578 28931 tablet_bootstrap.cc:492] T 574d0205e57547c6938037563109a6d2 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:45.086143 28931 ts_tablet_manager.cc:1403] T 574d0205e57547c6938037563109a6d2 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.296s user 0.011s sys 0.012s
I20260203 09:16:45.089191 29035 raft_consensus.cc:2804] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:45.089051 28931 raft_consensus.cc:359] T 574d0205e57547c6938037563109a6d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.089712 28931 raft_consensus.cc:385] T 574d0205e57547c6938037563109a6d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:45.089968 28931 raft_consensus.cc:740] T 574d0205e57547c6938037563109a6d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:45.090039 29035 raft_consensus.cc:697] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:45.090610 28931 consensus_queue.cc:260] T 574d0205e57547c6938037563109a6d2 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.091045 29035 consensus_queue.cc:237] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.092765 28933 tablet_bootstrap.cc:654] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:45.093258 28931 ts_tablet_manager.cc:1434] T 574d0205e57547c6938037563109a6d2 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260203 09:16:45.094168 28931 tablet_bootstrap.cc:492] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:45.094084 28635 catalog_manager.cc:5654] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:45.104995 28932 tablet_bootstrap.cc:654] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:45.127506 28933 tablet_bootstrap.cc:492] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:45.127990 28933 ts_tablet_manager.cc:1403] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.074s user 0.014s sys 0.001s
I20260203 09:16:45.130501 28933 raft_consensus.cc:359] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.131181 28933 raft_consensus.cc:385] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:45.131440 28933 raft_consensus.cc:740] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:45.134608 28633 catalog_manager.cc:5654] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:45.131994 28933 consensus_queue.cc:260] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.139248 28931 tablet_bootstrap.cc:654] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:45.142817 28933 ts_tablet_manager.cc:1434] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.015s user 0.007s sys 0.001s
I20260203 09:16:45.143952 28933 tablet_bootstrap.cc:492] T 4915f49d9ce24ab29a5c09e91dafd667 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:45.147513 28932 tablet_bootstrap.cc:492] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:45.147604 28989 raft_consensus.cc:493] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:45.148074 28932 ts_tablet_manager.cc:1403] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.080s user 0.013s sys 0.008s
I20260203 09:16:45.148113 28989 raft_consensus.cc:515] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.150871 28932 raft_consensus.cc:359] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.151513 28932 raft_consensus.cc:385] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:45.151770 28932 raft_consensus.cc:740] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:45.152694 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:45.154484 28933 tablet_bootstrap.cc:654] T 4915f49d9ce24ab29a5c09e91dafd667 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:45.154546 28932 consensus_queue.cc:260] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.158051 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:45.159695 28989 leader_election.cc:290] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:45.159675 28700 leader_election.cc:304] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:45.160825 28932 ts_tablet_manager.cc:1434] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.012s user 0.007s sys 0.001s
I20260203 09:16:45.161214 28989 raft_consensus.cc:2749] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:45.163003 28932 tablet_bootstrap.cc:492] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:45.164709 28733 raft_consensus.cc:3060] T 574d0205e57547c6938037563109a6d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:45.168184 28933 tablet_bootstrap.cc:492] T 4915f49d9ce24ab29a5c09e91dafd667 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:45.168691 28933 ts_tablet_manager.cc:1403] T 4915f49d9ce24ab29a5c09e91dafd667 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.025s user 0.012s sys 0.006s
I20260203 09:16:45.171824 28933 raft_consensus.cc:359] T 4915f49d9ce24ab29a5c09e91dafd667 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.172457 28933 raft_consensus.cc:385] T 4915f49d9ce24ab29a5c09e91dafd667 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:45.172845 28933 raft_consensus.cc:740] T 4915f49d9ce24ab29a5c09e91dafd667 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:45.173434 28933 consensus_queue.cc:260] T 4915f49d9ce24ab29a5c09e91dafd667 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.177135 28931 tablet_bootstrap.cc:492] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:45.177516 28931 ts_tablet_manager.cc:1403] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.084s user 0.019s sys 0.009s
I20260203 09:16:45.178256 29026 raft_consensus.cc:493] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:45.178756 29026 raft_consensus.cc:515] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.179117 28933 ts_tablet_manager.cc:1434] T 4915f49d9ce24ab29a5c09e91dafd667 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260203 09:16:45.181502 28933 tablet_bootstrap.cc:492] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:45.181767 29035 raft_consensus.cc:493] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:45.183228 29035 raft_consensus.cc:515] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.189317 29026 leader_election.cc:290] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:45.189703 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:16:45.197760 28777 leader_election.cc:343] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:45.197855 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:16:45.199260 28777 leader_election.cc:343] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:45.199714 28777 leader_election.cc:304] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:45.201915 29026 raft_consensus.cc:2749] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:45.202610 29035 leader_election.cc:290] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:45.203328 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:45.204162 28812 raft_consensus.cc:2468] T 4915f49d9ce24ab29a5c09e91dafd667 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:45.203337 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:45.205724 28851 leader_election.cc:304] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:45.206254 28933 tablet_bootstrap.cc:654] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:45.208165 28932 tablet_bootstrap.cc:654] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
W20260203 09:16:45.211081 28852 leader_election.cc:343] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:45.207021 28931 raft_consensus.cc:359] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.209578 29035 raft_consensus.cc:2804] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:45.211954 28931 raft_consensus.cc:385] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:45.212049 29035 raft_consensus.cc:493] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:45.212297 28931 raft_consensus.cc:740] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:45.212517 29035 raft_consensus.cc:3060] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:45.213096 28931 consensus_queue.cc:260] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.218138 28931 ts_tablet_manager.cc:1434] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.040s user 0.009s sys 0.000s
I20260203 09:16:45.219166 28931 tablet_bootstrap.cc:492] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:45.221871 29035 raft_consensus.cc:515] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.237638 28931 tablet_bootstrap.cc:654] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:45.238425 28932 tablet_bootstrap.cc:492] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:45.238976 28932 ts_tablet_manager.cc:1403] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.076s user 0.010s sys 0.009s
I20260203 09:16:45.240092 29035 leader_election.cc:290] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:45.240062 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:45.241568 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:45.242635 28932 raft_consensus.cc:359] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.242412 28812 raft_consensus.cc:3060] T 4915f49d9ce24ab29a5c09e91dafd667 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:45.243381 28932 raft_consensus.cc:385] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:45.243876 28932 raft_consensus.cc:740] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
W20260203 09:16:45.243485 28852 leader_election.cc:343] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:45.244493 28932 consensus_queue.cc:260] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.245784 28933 tablet_bootstrap.cc:492] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:45.246387 28933 ts_tablet_manager.cc:1403] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.065s user 0.010s sys 0.014s
I20260203 09:16:45.246574 28932 ts_tablet_manager.cc:1434] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260203 09:16:45.247612 28932 tablet_bootstrap.cc:492] T 6bf3d38eba3b4894b7f18f2d5733f63e P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:45.251701 28812 raft_consensus.cc:2468] T 4915f49d9ce24ab29a5c09e91dafd667 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:45.254400 28933 raft_consensus.cc:359] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.255084 28933 raft_consensus.cc:385] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:45.255374 28933 raft_consensus.cc:740] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:45.255973 28851 leader_election.cc:304] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:45.256063 28933 consensus_queue.cc:260] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.260874 28933 ts_tablet_manager.cc:1434] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.014s user 0.009s sys 0.000s
I20260203 09:16:45.261852 28933 tablet_bootstrap.cc:492] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:45.256827 29035 raft_consensus.cc:2804] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:45.265530 28733 raft_consensus.cc:3060] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:45.266956 29035 raft_consensus.cc:697] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:45.271131 28931 tablet_bootstrap.cc:492] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:45.271608 28931 ts_tablet_manager.cc:1403] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.053s user 0.012s sys 0.000s
I20260203 09:16:45.274328 28931 raft_consensus.cc:359] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.275048 28931 raft_consensus.cc:385] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:45.275357 28931 raft_consensus.cc:740] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:45.267839 29035 consensus_queue.cc:237] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.276432 28931 consensus_queue.cc:260] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.279203 28932 tablet_bootstrap.cc:654] T 6bf3d38eba3b4894b7f18f2d5733f63e P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:45.283114 28933 tablet_bootstrap.cc:654] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:45.284734 28931 ts_tablet_manager.cc:1434] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.013s user 0.007s sys 0.000s
I20260203 09:16:45.285705 28931 tablet_bootstrap.cc:492] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:45.302652 28931 tablet_bootstrap.cc:654] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:45.306113 28634 catalog_manager.cc:5654] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:45.321421 28933 tablet_bootstrap.cc:492] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:45.322232 28933 ts_tablet_manager.cc:1403] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.061s user 0.012s sys 0.010s
I20260203 09:16:45.324846 28932 tablet_bootstrap.cc:492] T 6bf3d38eba3b4894b7f18f2d5733f63e P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:45.325433 28932 ts_tablet_manager.cc:1403] T 6bf3d38eba3b4894b7f18f2d5733f63e P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.078s user 0.018s sys 0.004s
I20260203 09:16:45.326871 28989 consensus_queue.cc:1048] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:45.330873 28933 raft_consensus.cc:359] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.331605 28933 raft_consensus.cc:385] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:45.332026 28932 raft_consensus.cc:359] T 6bf3d38eba3b4894b7f18f2d5733f63e P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.332828 28932 raft_consensus.cc:385] T 6bf3d38eba3b4894b7f18f2d5733f63e P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:45.333113 28932 raft_consensus.cc:740] T 6bf3d38eba3b4894b7f18f2d5733f63e P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:45.333484 28933 raft_consensus.cc:740] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:45.334128 28933 consensus_queue.cc:260] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.340778 28933 ts_tablet_manager.cc:1434] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.012s user 0.002s sys 0.008s
I20260203 09:16:45.338722 28932 consensus_queue.cc:260] T 6bf3d38eba3b4894b7f18f2d5733f63e P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.341701 28933 tablet_bootstrap.cc:492] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:45.347198 28932 ts_tablet_manager.cc:1434] T 6bf3d38eba3b4894b7f18f2d5733f63e P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.021s user 0.007s sys 0.001s
I20260203 09:16:45.348170 28932 tablet_bootstrap.cc:492] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:45.348740 28733 raft_consensus.cc:3060] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:45.332849 28989 consensus_queue.cc:1048] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260203 09:16:45.359637 28931 tablet_bootstrap.cc:492] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:45.360096 28931 ts_tablet_manager.cc:1403] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.075s user 0.012s sys 0.021s
I20260203 09:16:45.363984 28931 raft_consensus.cc:359] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.364702 28931 raft_consensus.cc:385] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:45.364960 28931 raft_consensus.cc:740] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:45.365561 28931 consensus_queue.cc:260] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.368752 28931 ts_tablet_manager.cc:1434] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.008s user 0.007s sys 0.001s
I20260203 09:16:45.370879 28931 tablet_bootstrap.cc:492] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:45.374743 28933 tablet_bootstrap.cc:654] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:45.374789 29026 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:45.375285 28932 tablet_bootstrap.cc:654] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:45.375782 29026 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.379051 28931 tablet_bootstrap.cc:654] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:45.379159 29026 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:45.381160 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:45.381160 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:45.383703 28738 raft_consensus.cc:2393] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 1: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:16:45.389345 28777 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:45.390188 29026 raft_consensus.cc:3060] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:45.395635 29030 raft_consensus.cc:493] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:45.396225 29030 raft_consensus.cc:515] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.401777 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:45.402997 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:16:45.403329 28777 leader_election.cc:343] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:45.399617 29030 leader_election.cc:290] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:16:45.404948 28777 leader_election.cc:343] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:45.405381 28777 leader_election.cc:304] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:45.406704 29030 raft_consensus.cc:2749] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:45.410516 29026 raft_consensus.cc:2749] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:45.423873 28733 raft_consensus.cc:1275] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260203 09:16:45.424170 29026 consensus_queue.cc:1048] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:45.425761 28938 consensus_queue.cc:1048] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:45.431345 29026 raft_consensus.cc:493] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:45.450486 28937 raft_consensus.cc:493] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:45.443055 29026 raft_consensus.cc:515] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.457527 28933 tablet_bootstrap.cc:492] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:45.457924 28933 ts_tablet_manager.cc:1403] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.116s user 0.012s sys 0.015s
I20260203 09:16:45.454691 28937 raft_consensus.cc:515] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.468923 28931 tablet_bootstrap.cc:492] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:45.469476 28931 ts_tablet_manager.cc:1403] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.099s user 0.011s sys 0.028s
I20260203 09:16:45.474753 28937 leader_election.cc:290] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:45.474896 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47301e2bbfc94767a9905b0e12141d6d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:45.475610 28812 raft_consensus.cc:2468] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 0.
I20260203 09:16:45.477514 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47301e2bbfc94767a9905b0e12141d6d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:45.477751 29026 leader_election.cc:290] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:45.478152 28889 raft_consensus.cc:2468] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 0.
I20260203 09:16:45.478441 28931 raft_consensus.cc:359] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.479053 28931 raft_consensus.cc:385] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:45.479298 28931 raft_consensus.cc:740] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:45.479688 28700 leader_election.cc:304] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:45.481209 28937 raft_consensus.cc:2804] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:45.481137 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:45.481755 28937 raft_consensus.cc:493] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:45.481143 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:45.482113 28937 raft_consensus.cc:3060] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:45.482677 28931 consensus_queue.cc:260] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.485373 28931 ts_tablet_manager.cc:1434] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20260203 09:16:45.486259 28931 tablet_bootstrap.cc:492] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:45.489789 28933 raft_consensus.cc:359] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.491112 28933 raft_consensus.cc:385] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:45.491381 28933 raft_consensus.cc:740] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:45.491976 28933 consensus_queue.cc:260] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:16:45.488903 28777 leader_election.cc:343] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:16:45.494112 28777 leader_election.cc:343] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:45.494987 28777 leader_election.cc:304] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:45.498003 28937 raft_consensus.cc:515] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.501108 29030 raft_consensus.cc:2749] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:45.501516 28933 ts_tablet_manager.cc:1434] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.043s user 0.006s sys 0.001s
I20260203 09:16:45.502861 28933 tablet_bootstrap.cc:492] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:45.505993 28931 tablet_bootstrap.cc:654] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:45.509891 28812 raft_consensus.cc:1275] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260203 09:16:45.510288 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47301e2bbfc94767a9905b0e12141d6d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:45.511140 28811 raft_consensus.cc:3060] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:45.511734 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47301e2bbfc94767a9905b0e12141d6d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:45.512878 29006 consensus_queue.cc:1048] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260203 09:16:45.516238 28889 raft_consensus.cc:3060] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:45.519273 28933 tablet_bootstrap.cc:654] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:45.515398 28932 tablet_bootstrap.cc:492] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:45.520573 28932 ts_tablet_manager.cc:1403] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.173s user 0.040s sys 0.034s
I20260203 09:16:45.511461 28937 leader_election.cc:290] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:45.526453 28931 tablet_bootstrap.cc:492] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:45.526903 28931 ts_tablet_manager.cc:1403] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.041s user 0.008s sys 0.010s
I20260203 09:16:45.529073 28931 raft_consensus.cc:359] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.529837 28931 raft_consensus.cc:385] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:45.530124 28931 raft_consensus.cc:740] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:45.530889 28933 tablet_bootstrap.cc:492] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:45.530772 28931 consensus_queue.cc:260] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.531409 28933 ts_tablet_manager.cc:1403] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.029s user 0.010s sys 0.001s
I20260203 09:16:45.531932 28932 raft_consensus.cc:359] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.532459 28932 raft_consensus.cc:385] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:45.532750 28932 raft_consensus.cc:740] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:45.532958 28931 ts_tablet_manager.cc:1434] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260203 09:16:45.533780 28931 tablet_bootstrap.cc:492] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:45.529121 28889 raft_consensus.cc:2468] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:16:45.536628 28701 leader_election.cc:304] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:45.538800 28811 raft_consensus.cc:2468] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:16:45.540488 29030 consensus_queue.cc:1048] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:45.541493 28932 consensus_queue.cc:260] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.543164 28989 raft_consensus.cc:2804] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:45.550120 28989 raft_consensus.cc:697] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:16:45.551133 28989 consensus_queue.cc:237] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.558506 28932 ts_tablet_manager.cc:1434] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.033s user 0.007s sys 0.000s
I20260203 09:16:45.559482 28932 tablet_bootstrap.cc:492] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:45.559111 28933 raft_consensus.cc:359] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.560058 28933 raft_consensus.cc:385] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:45.560416 28933 raft_consensus.cc:740] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:45.563263 28933 consensus_queue.cc:260] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.571667 28933 ts_tablet_manager.cc:1434] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.040s user 0.006s sys 0.001s
I20260203 09:16:45.572949 28933 tablet_bootstrap.cc:492] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:45.588951 28931 tablet_bootstrap.cc:654] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:45.592880 28933 tablet_bootstrap.cc:654] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:45.593209 28989 raft_consensus.cc:493] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:45.592478 28634 catalog_manager.cc:5654] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 0 to 1, leader changed from <none> to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:45.594159 28989 raft_consensus.cc:515] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.595398 29030 raft_consensus.cc:493] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:45.595883 29030 raft_consensus.cc:515] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.597893 29030 leader_election.cc:290] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:45.599805 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:45.600219 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:45.600849 28889 raft_consensus.cc:2468] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
W20260203 09:16:45.601190 28777 leader_election.cc:343] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:45.601943 28777 leader_election.cc:304] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:45.602741 29030 raft_consensus.cc:2804] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:45.603120 29030 raft_consensus.cc:493] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:45.603505 29030 raft_consensus.cc:3060] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:45.605171 28931 tablet_bootstrap.cc:492] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:45.605646 28931 ts_tablet_manager.cc:1403] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.072s user 0.011s sys 0.001s
I20260203 09:16:45.608069 28931 raft_consensus.cc:359] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.610458 28989 leader_election.cc:290] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:45.619648 28931 raft_consensus.cc:385] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:45.614070 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:45.620247 28889 raft_consensus.cc:2468] T 6bf3d38eba3b4894b7f18f2d5733f63e P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 0.
I20260203 09:16:45.621459 28701 leader_election.cc:304] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:45.621815 28931 raft_consensus.cc:740] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:45.622483 28989 raft_consensus.cc:2804] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:45.622684 28931 consensus_queue.cc:260] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.622942 28989 raft_consensus.cc:493] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:45.624737 28989 raft_consensus.cc:3060] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:45.626844 28937 raft_consensus.cc:493] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:45.627429 28937 raft_consensus.cc:515] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.629817 28937 leader_election.cc:290] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:16:45.632369 28852 consensus_peers.cc:597] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:16:45.633423 28937 raft_consensus.cc:493] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:45.634438 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:45.614848 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:45.635871 28812 raft_consensus.cc:2468] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 0.
I20260203 09:16:45.618257 29006 raft_consensus.cc:493] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:45.636760 29006 raft_consensus.cc:515] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.638746 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:45.618752 28988 consensus_queue.cc:1048] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:45.639596 28811 raft_consensus.cc:2393] T 4915f49d9ce24ab29a5c09e91dafd667 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 1: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:16:45.642354 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:45.643038 28809 raft_consensus.cc:2468] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:45.645450 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:45.611553 28932 tablet_bootstrap.cc:654] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:45.638883 29006 leader_election.cc:290] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:45.649212 28700 leader_election.cc:304] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:16:45.649801 28852 leader_election.cc:343] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:45.650460 29041 raft_consensus.cc:3060] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:45.652055 28989 raft_consensus.cc:515] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.634059 28937 raft_consensus.cc:515] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.654628 28937 leader_election.cc:290] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:45.614310 29030 raft_consensus.cc:515] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.655683 28851 leader_election.cc:304] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:45.656512 28931 ts_tablet_manager.cc:1434] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.051s user 0.006s sys 0.000s
I20260203 09:16:45.657245 28989 leader_election.cc:290] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:45.657559 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:45.658223 28888 raft_consensus.cc:3060] T 6bf3d38eba3b4894b7f18f2d5733f63e P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:45.662410 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
W20260203 09:16:45.663933 28777 leader_election.cc:343] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:45.666460 28932 tablet_bootstrap.cc:492] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:45.666949 28932 ts_tablet_manager.cc:1403] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.108s user 0.009s sys 0.001s
I20260203 09:16:45.669469 28932 raft_consensus.cc:359] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.670130 28932 raft_consensus.cc:385] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:45.670369 28932 raft_consensus.cc:740] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:45.671284 29030 leader_election.cc:290] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:45.672089 28931 tablet_bootstrap.cc:492] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:45.671190 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:45.672969 28932 consensus_queue.cc:260] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.655704 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:45.677559 28809 raft_consensus.cc:2468] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 0.
I20260203 09:16:45.680325 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:45.680917 28811 raft_consensus.cc:3060] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:16:45.681478 28701 leader_election.cc:343] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:45.673848 29034 raft_consensus.cc:2804] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:45.685330 29034 raft_consensus.cc:493] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:45.685731 29034 raft_consensus.cc:3060] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:45.685227 28988 raft_consensus.cc:493] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:45.687479 28988 raft_consensus.cc:515] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.689073 28700 leader_election.cc:304] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:16:45.689939 28989 raft_consensus.cc:2804] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:45.690292 28989 raft_consensus.cc:493] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:45.690596 28989 raft_consensus.cc:3060] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:45.694902 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:45.695637 28889 raft_consensus.cc:3060] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:45.700623 29034 raft_consensus.cc:515] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.710531 29034 leader_election.cc:290] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:45.701517 28988 leader_election.cc:290] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:45.702380 29035 consensus_queue.cc:1048] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260203 09:16:45.703588 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:45.705364 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:45.715322 28812 raft_consensus.cc:2468] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:45.719621 28851 leader_election.cc:304] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:45.720728 29035 raft_consensus.cc:2804] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:45.721123 29035 raft_consensus.cc:493] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:45.721465 29035 raft_consensus.cc:3060] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:45.708520 28888 raft_consensus.cc:2468] T 6bf3d38eba3b4894b7f18f2d5733f63e P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:16:45.701682 29006 consensus_queue.cc:1048] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260203 09:16:45.728868 28701 leader_election.cc:304] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:45.707844 29041 raft_consensus.cc:2749] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:45.730060 28937 raft_consensus.cc:2804] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:45.730512 28937 raft_consensus.cc:697] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:16:45.731853 28937 consensus_queue.cc:237] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.701790 28811 raft_consensus.cc:2468] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:16:45.747677 28931 tablet_bootstrap.cc:654] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:45.748430 28933 tablet_bootstrap.cc:492] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:45.749027 28933 ts_tablet_manager.cc:1403] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.176s user 0.023s sys 0.061s
I20260203 09:16:45.749608 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
W20260203 09:16:45.748471 28852 leader_election.cc:343] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:16:45.756208 28683 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:16:45.757010 28932 ts_tablet_manager.cc:1434] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.090s user 0.006s sys 0.002s
I20260203 09:16:45.758925 28933 raft_consensus.cc:359] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.759578 28933 raft_consensus.cc:385] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:45.759814 28933 raft_consensus.cc:740] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:45.760152 28932 tablet_bootstrap.cc:492] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:45.760316 28933 consensus_queue.cc:260] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.762954 28933 ts_tablet_manager.cc:1434] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20260203 09:16:45.769153 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:45.801640 28989 raft_consensus.cc:515] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:16:45.803400 28852 leader_election.cc:343] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:45.795804 29035 raft_consensus.cc:515] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.804629 28811 raft_consensus.cc:3060] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:45.765239 29006 consensus_queue.cc:1048] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260203 09:16:45.806309 29035 leader_election.cc:290] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:45.810320 28989 leader_election.cc:290] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:45.853463 28811 raft_consensus.cc:2468] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:45.860100 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:45.860594 28634 catalog_manager.cc:5654] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 0 to 1, leader changed from <none> to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
W20260203 09:16:45.866983 28701 leader_election.cc:343] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:45.811477 28889 raft_consensus.cc:2468] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:45.873210 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:45.877987 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:45.878618 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:45.878643 28809 raft_consensus.cc:3060] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:45.829603 28933 tablet_bootstrap.cc:492] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:45.879315 29034 consensus_queue.cc:1048] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:45.879354 28811 raft_consensus.cc:3060] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:45.887975 28851 leader_election.cc:304] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:45.894387 28933 tablet_bootstrap.cc:654] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:45.895358 28932 tablet_bootstrap.cc:654] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:45.895104 29006 raft_consensus.cc:2804] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:45.898377 29006 raft_consensus.cc:697] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:45.899192 29006 consensus_queue.cc:237] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.900794 28811 raft_consensus.cc:2468] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:16:45.903805 28700 leader_election.cc:304] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:16:45.905428 28989 raft_consensus.cc:2804] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:45.908776 28989 raft_consensus.cc:697] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
W20260203 09:16:45.902688 28852 leader_election.cc:343] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:45.919689 28989 consensus_queue.cc:237] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.913064 28809 raft_consensus.cc:2468] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:45.925437 28931 tablet_bootstrap.cc:492] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:45.926051 28931 ts_tablet_manager.cc:1403] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.269s user 0.014s sys 0.009s
I20260203 09:16:45.929600 28851 leader_election.cc:304] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:45.930572 28988 raft_consensus.cc:2804] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:45.931151 28988 raft_consensus.cc:697] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:45.935439 28988 consensus_queue.cc:237] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.936407 28933 tablet_bootstrap.cc:492] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:45.936900 28933 ts_tablet_manager.cc:1403] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.108s user 0.014s sys 0.001s
I20260203 09:16:45.939611 28933 raft_consensus.cc:359] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.940245 28933 raft_consensus.cc:385] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:45.940521 28933 raft_consensus.cc:740] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:45.941241 28933 consensus_queue.cc:260] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.941550 28931 raft_consensus.cc:359] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.942521 28931 raft_consensus.cc:385] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:45.942799 28931 raft_consensus.cc:740] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:45.943378 28931 consensus_queue.cc:260] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.944767 28932 tablet_bootstrap.cc:492] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:45.945647 28932 ts_tablet_manager.cc:1403] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.186s user 0.015s sys 0.006s
I20260203 09:16:45.950167 28933 ts_tablet_manager.cc:1434] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20260203 09:16:45.951210 28933 tablet_bootstrap.cc:492] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:45.951418 28634 catalog_manager.cc:5654] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 0 to 1, leader changed from <none> to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:45.960902 29030 raft_consensus.cc:493] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:45.960568 28932 raft_consensus.cc:359] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.961454 28932 raft_consensus.cc:385] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:45.961418 29030 raft_consensus.cc:515] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.961917 28932 raft_consensus.cc:740] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:45.962620 28932 consensus_queue.cc:260] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.963470 29030 leader_election.cc:290] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:45.964929 28932 ts_tablet_manager.cc:1434] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.019s user 0.003s sys 0.004s
I20260203 09:16:45.965901 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:45.966409 28932 tablet_bootstrap.cc:492] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
W20260203 09:16:45.968432 28777 leader_election.cc:343] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:45.965456 28931 ts_tablet_manager.cc:1434] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.039s user 0.007s sys 0.000s
I20260203 09:16:45.970144 28931 tablet_bootstrap.cc:492] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:45.977826 29041 raft_consensus.cc:493] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:45.983052 29041 raft_consensus.cc:515] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:45.986529 29041 leader_election.cc:290] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:45.990674 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:45.991412 28889 raft_consensus.cc:2468] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 0.
I20260203 09:16:45.996953 28701 leader_election.cc:304] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:45.998572 28937 raft_consensus.cc:2804] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:45.999025 28937 raft_consensus.cc:493] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:45.999399 28937 raft_consensus.cc:3060] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:45.999766 28777 leader_election.cc:304] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:46.001479 29031 raft_consensus.cc:2804] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:46.001986 29031 raft_consensus.cc:697] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:16:46.002840 29031 consensus_queue.cc:237] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.011617 28937 raft_consensus.cc:515] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.026971 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:46.031306 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:46.038688 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:46.039811 28889 raft_consensus.cc:3060] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:46.041317 28937 leader_election.cc:290] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:46.042256 28635 catalog_manager.cc:5654] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:46.043726 28933 tablet_bootstrap.cc:654] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:46.044037 28635 catalog_manager.cc:5654] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
W20260203 09:16:46.043046 28700 leader_election.cc:343] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:16:46.045910 28700 leader_election.cc:343] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:46.046126 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:46.053743 28937 consensus_queue.cc:1048] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260203 09:16:46.060595 28737 raft_consensus.cc:3060] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:46.064112 28931 tablet_bootstrap.cc:654] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:46.065505 28932 tablet_bootstrap.cc:654] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:46.065250 28889 raft_consensus.cc:2468] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:16:46.064976 28634 catalog_manager.cc:5654] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 0 to 1, leader changed from <none> to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:46.086563 28701 leader_election.cc:304] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:46.088057 29041 raft_consensus.cc:2804] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:46.089243 28931 tablet_bootstrap.cc:492] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:46.089823 28931 ts_tablet_manager.cc:1403] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.120s user 0.012s sys 0.001s
I20260203 09:16:46.090786 28984 consensus_queue.cc:1048] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260203 09:16:46.067996 28777 leader_election.cc:343] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:46.095791 28777 leader_election.cc:304] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:46.096493 29030 raft_consensus.cc:2749] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:46.110018 28933 tablet_bootstrap.cc:492] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:46.110687 28933 ts_tablet_manager.cc:1403] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.160s user 0.008s sys 0.006s
I20260203 09:16:46.117493 28931 raft_consensus.cc:359] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.120946 28931 raft_consensus.cc:385] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:46.153998 28931 raft_consensus.cc:740] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:46.154889 28931 consensus_queue.cc:260] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.157480 28931 ts_tablet_manager.cc:1434] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.067s user 0.006s sys 0.000s
I20260203 09:16:46.158828 28931 tablet_bootstrap.cc:492] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:46.162281 29041 raft_consensus.cc:697] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:16:46.174952 28933 raft_consensus.cc:359] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.175558 28933 raft_consensus.cc:385] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:46.175812 28933 raft_consensus.cc:740] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:46.178187 28932 tablet_bootstrap.cc:492] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:46.178700 28932 ts_tablet_manager.cc:1403] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.212s user 0.049s sys 0.013s
I20260203 09:16:46.180449 28933 consensus_queue.cc:260] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.180907 28931 tablet_bootstrap.cc:654] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:46.181288 29041 consensus_queue.cc:237] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.183692 28933 ts_tablet_manager.cc:1434] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.073s user 0.006s sys 0.002s
I20260203 09:16:46.184725 28933 tablet_bootstrap.cc:492] T 797be23efb5c447da7f2d0ba9af2e84d P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:46.192581 28932 raft_consensus.cc:359] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.193403 28932 raft_consensus.cc:385] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:46.199209 28932 raft_consensus.cc:740] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:46.199929 28932 consensus_queue.cc:260] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.206911 28932 ts_tablet_manager.cc:1434] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.028s user 0.004s sys 0.004s
I20260203 09:16:46.207669 28932 tablet_bootstrap.cc:492] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:46.210693 28933 tablet_bootstrap.cc:654] T 797be23efb5c447da7f2d0ba9af2e84d P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:46.213472 28931 tablet_bootstrap.cc:492] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:46.213883 28931 ts_tablet_manager.cc:1403] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.055s user 0.018s sys 0.009s
I20260203 09:16:46.222146 28931 raft_consensus.cc:359] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.222954 28931 raft_consensus.cc:385] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:46.223271 28931 raft_consensus.cc:740] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:46.223076 29100 consensus_queue.cc:1048] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:46.223868 29031 raft_consensus.cc:493] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:46.223930 28931 consensus_queue.cc:260] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.224556 29031 raft_consensus.cc:515] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.225163 28634 catalog_manager.cc:5654] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 0 to 1, leader changed from <none> to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:46.226271 28931 ts_tablet_manager.cc:1434] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.012s user 0.005s sys 0.001s
I20260203 09:16:46.226313 29031 leader_election.cc:290] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:46.227173 28931 tablet_bootstrap.cc:492] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:46.228760 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fabfb779b8894cf0b22204fe12768dc3" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:46.228899 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fabfb779b8894cf0b22204fe12768dc3" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:16:46.230424 28777 leader_election.cc:343] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:46.233398 28932 tablet_bootstrap.cc:654] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
W20260203 09:16:46.238148 28777 leader_election.cc:343] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:46.238687 28777 leader_election.cc:304] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:46.239405 29031 raft_consensus.cc:2749] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:46.243425 28931 tablet_bootstrap.cc:654] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:46.249055 28932 tablet_bootstrap.cc:492] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:46.249455 28932 ts_tablet_manager.cc:1403] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.042s user 0.011s sys 0.000s
I20260203 09:16:46.251893 28932 raft_consensus.cc:359] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.252516 28932 raft_consensus.cc:385] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:46.252801 28932 raft_consensus.cc:740] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:46.253432 28932 consensus_queue.cc:260] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.255767 28932 ts_tablet_manager.cc:1434] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260203 09:16:46.249047 28931 tablet_bootstrap.cc:492] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:46.256429 28931 ts_tablet_manager.cc:1403] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.029s user 0.013s sys 0.000s
I20260203 09:16:46.257332 28932 tablet_bootstrap.cc:492] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:46.266775 28931 raft_consensus.cc:359] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.267508 28931 raft_consensus.cc:385] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:46.267784 28931 raft_consensus.cc:740] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:46.267858 29100 consensus_queue.cc:1048] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:46.268496 28931 consensus_queue.cc:260] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.275621 28931 ts_tablet_manager.cc:1434] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20260203 09:16:46.278276 28932 tablet_bootstrap.cc:654] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:46.281633 28931 tablet_bootstrap.cc:492] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:46.288775 28933 tablet_bootstrap.cc:492] T 797be23efb5c447da7f2d0ba9af2e84d P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:46.289301 28933 ts_tablet_manager.cc:1403] T 797be23efb5c447da7f2d0ba9af2e84d P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.105s user 0.014s sys 0.014s
I20260203 09:16:46.289944 28931 tablet_bootstrap.cc:654] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:46.291685 28933 raft_consensus.cc:359] T 797be23efb5c447da7f2d0ba9af2e84d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.292354 28933 raft_consensus.cc:385] T 797be23efb5c447da7f2d0ba9af2e84d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:46.292618 28933 raft_consensus.cc:740] T 797be23efb5c447da7f2d0ba9af2e84d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:46.294533 28933 consensus_queue.cc:260] T 797be23efb5c447da7f2d0ba9af2e84d P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.300887 28938 raft_consensus.cc:493] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:46.301620 28938 raft_consensus.cc:515] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.303615 28938 leader_election.cc:290] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:46.304853 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:46.305490 28811 raft_consensus.cc:2468] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:46.305826 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:46.306372 28737 raft_consensus.cc:2468] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:46.306752 28851 leader_election.cc:304] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:46.307874 28988 raft_consensus.cc:2804] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:46.308142 28988 raft_consensus.cc:493] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:46.308439 28988 raft_consensus.cc:3060] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:46.314224 28932 tablet_bootstrap.cc:492] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:46.314692 28932 ts_tablet_manager.cc:1403] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.058s user 0.012s sys 0.000s
I20260203 09:16:46.316485 28932 raft_consensus.cc:359] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.317066 28932 raft_consensus.cc:385] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:46.317324 28932 raft_consensus.cc:740] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:46.320137 28988 raft_consensus.cc:515] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.324831 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:46.325378 28811 raft_consensus.cc:3060] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:46.322335 28988 leader_election.cc:290] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:46.329541 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:46.330945 28737 raft_consensus.cc:3060] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:46.331269 28933 ts_tablet_manager.cc:1434] T 797be23efb5c447da7f2d0ba9af2e84d P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.042s user 0.006s sys 0.001s
I20260203 09:16:46.332260 28933 tablet_bootstrap.cc:492] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:46.337266 28811 raft_consensus.cc:2468] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:46.338383 28851 leader_election.cc:304] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:46.341764 29035 raft_consensus.cc:2804] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:46.324693 28932 consensus_queue.cc:260] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.342269 29035 raft_consensus.cc:697] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:46.343269 28938 raft_consensus.cc:493] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:46.343688 28938 raft_consensus.cc:515] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.344000 29035 consensus_queue.cc:237] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.348356 28938 leader_election.cc:290] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:46.353449 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:46.353443 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:46.354537 28738 raft_consensus.cc:2468] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
W20260203 09:16:46.354900 28852 consensus_peers.cc:597] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:16:46.355751 28852 leader_election.cc:304] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:46.357393 28811 raft_consensus.cc:2468] T 797be23efb5c447da7f2d0ba9af2e84d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:46.359509 28933 tablet_bootstrap.cc:654] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:46.359634 28932 ts_tablet_manager.cc:1434] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.045s user 0.008s sys 0.000s
I20260203 09:16:46.360467 28938 raft_consensus.cc:2804] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:46.360678 28932 tablet_bootstrap.cc:492] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:46.360898 28938 raft_consensus.cc:493] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:46.361502 28938 raft_consensus.cc:3060] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:46.362277 28931 tablet_bootstrap.cc:492] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:46.362778 28931 ts_tablet_manager.cc:1403] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.081s user 0.020s sys 0.007s
I20260203 09:16:46.364820 28737 raft_consensus.cc:2468] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:46.365728 28931 raft_consensus.cc:359] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.366298 28931 raft_consensus.cc:385] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:46.366503 28931 raft_consensus.cc:740] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:46.367055 28931 consensus_queue.cc:260] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.370086 28633 catalog_manager.cc:5654] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:46.377337 29031 raft_consensus.cc:493] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:46.377894 29031 raft_consensus.cc:515] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.378736 28931 ts_tablet_manager.cc:1434] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.016s user 0.001s sys 0.004s
I20260203 09:16:46.380102 29031 leader_election.cc:290] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:46.382304 28932 tablet_bootstrap.cc:654] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:46.382292 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:46.386505 28931 tablet_bootstrap.cc:492] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:46.387573 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:46.388433 28889 raft_consensus.cc:2393] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 1: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:16:46.394191 28777 leader_election.cc:304] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:46.394507 28931 tablet_bootstrap.cc:654] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:46.395006 28933 tablet_bootstrap.cc:492] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:46.395344 29031 raft_consensus.cc:3060] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:46.395501 28933 ts_tablet_manager.cc:1403] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.063s user 0.005s sys 0.008s
I20260203 09:16:46.398187 28933 raft_consensus.cc:359] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.398821 28933 raft_consensus.cc:385] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:46.399085 28933 raft_consensus.cc:740] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:46.399515 28932 tablet_bootstrap.cc:492] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:46.399972 28932 ts_tablet_manager.cc:1403] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.040s user 0.011s sys 0.001s
I20260203 09:16:46.403374 29031 raft_consensus.cc:2749] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:46.404335 28932 raft_consensus.cc:359] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.406036 28932 raft_consensus.cc:385] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:46.406365 28932 raft_consensus.cc:740] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:46.406371 28938 raft_consensus.cc:515] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.407099 28932 consensus_queue.cc:260] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.399701 28933 consensus_queue.cc:260] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.409929 28932 ts_tablet_manager.cc:1434] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.008s user 0.005s sys 0.001s
I20260203 09:16:46.411890 28932 tablet_bootstrap.cc:492] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:46.413347 28933 ts_tablet_manager.cc:1434] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.017s user 0.005s sys 0.002s
I20260203 09:16:46.414351 28933 tablet_bootstrap.cc:492] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:46.420694 28933 tablet_bootstrap.cc:654] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:46.427289 29035 consensus_queue.cc:1048] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:46.429555 28932 tablet_bootstrap.cc:654] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:46.444160 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:46.444924 28738 raft_consensus.cc:3060] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:46.445261 28938 leader_election.cc:290] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:46.445459 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:46.446101 28808 raft_consensus.cc:3060] T 797be23efb5c447da7f2d0ba9af2e84d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:46.451773 28931 tablet_bootstrap.cc:492] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:46.452255 28931 ts_tablet_manager.cc:1403] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.066s user 0.009s sys 0.016s
I20260203 09:16:46.459707 28738 raft_consensus.cc:2468] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:46.456454 28808 raft_consensus.cc:2468] T 797be23efb5c447da7f2d0ba9af2e84d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:46.461316 28933 tablet_bootstrap.cc:492] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:46.461817 28933 ts_tablet_manager.cc:1403] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.048s user 0.008s sys 0.009s
I20260203 09:16:46.461759 28852 leader_election.cc:304] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
W20260203 09:16:46.463912 28852 consensus_peers.cc:597] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:16:46.464826 28938 raft_consensus.cc:2804] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:46.465297 28938 raft_consensus.cc:697] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:46.466338 28932 tablet_bootstrap.cc:492] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:46.466066 28938 consensus_queue.cc:237] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.466873 28932 ts_tablet_manager.cc:1403] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.055s user 0.012s sys 0.001s
I20260203 09:16:46.469486 28932 raft_consensus.cc:359] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.470214 28932 raft_consensus.cc:385] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:46.470507 28932 raft_consensus.cc:740] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:46.470562 29035 raft_consensus.cc:493] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:46.471038 29035 raft_consensus.cc:515] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.471172 28932 consensus_queue.cc:260] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.471994 28931 raft_consensus.cc:359] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.472555 28931 raft_consensus.cc:385] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:46.472786 28931 raft_consensus.cc:740] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:46.473300 28932 ts_tablet_manager.cc:1434] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260203 09:16:46.473366 28931 consensus_queue.cc:260] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.474385 29035 leader_election.cc:290] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:46.474218 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b6f1d6e275f4a8ba99a70dbb3ea3235" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:16:46.475669 28852 leader_election.cc:343] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:46.482832 28931 ts_tablet_manager.cc:1434] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.030s user 0.004s sys 0.002s
I20260203 09:16:46.483726 28931 tablet_bootstrap.cc:492] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:46.476624 28933 raft_consensus.cc:359] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.474160 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b6f1d6e275f4a8ba99a70dbb3ea3235" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:46.474215 28932 tablet_bootstrap.cc:492] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:46.484894 28933 raft_consensus.cc:385] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:46.485204 28933 raft_consensus.cc:740] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:46.486312 28933 consensus_queue.cc:260] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.487186 28811 raft_consensus.cc:2468] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:46.490218 28851 leader_election.cc:304] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:46.491531 28932 tablet_bootstrap.cc:654] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:46.491694 29090 raft_consensus.cc:2804] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:46.492069 29090 raft_consensus.cc:493] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:46.492372 29090 raft_consensus.cc:3060] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:46.494165 28933 ts_tablet_manager.cc:1434] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.032s user 0.005s sys 0.000s
I20260203 09:16:46.495797 28933 tablet_bootstrap.cc:492] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:46.498589 28889 raft_consensus.cc:3060] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:46.505373 29090 raft_consensus.cc:515] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.506548 28989 consensus_queue.cc:1048] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:46.505023 28634 catalog_manager.cc:5654] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:46.509263 29090 leader_election.cc:290] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:46.490548 28931 tablet_bootstrap.cc:654] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:46.512614 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b6f1d6e275f4a8ba99a70dbb3ea3235" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:46.517041 28811 raft_consensus.cc:3060] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:46.521080 28932 tablet_bootstrap.cc:492] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:46.521628 28932 ts_tablet_manager.cc:1403] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.048s user 0.007s sys 0.008s
I20260203 09:16:46.514531 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b6f1d6e275f4a8ba99a70dbb3ea3235" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:46.522274 28933 tablet_bootstrap.cc:654] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
W20260203 09:16:46.523250 28852 leader_election.cc:343] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:46.524413 28932 raft_consensus.cc:359] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.525309 28932 raft_consensus.cc:385] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:46.526162 28932 raft_consensus.cc:740] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:46.526821 28932 consensus_queue.cc:260] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.529428 29100 consensus_queue.cc:1048] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:46.530496 28932 ts_tablet_manager.cc:1434] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.009s user 0.005s sys 0.002s
I20260203 09:16:46.531410 28932 tablet_bootstrap.cc:492] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:46.535316 28811 raft_consensus.cc:2468] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:46.541909 28851 leader_election.cc:304] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:46.542824 28938 raft_consensus.cc:2804] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:46.543853 28938 raft_consensus.cc:697] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:46.544808 28938 consensus_queue.cc:237] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.560516 28932 tablet_bootstrap.cc:654] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:46.571684 29041 raft_consensus.cc:493] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:46.573120 29041 raft_consensus.cc:515] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.574971 29041 leader_election.cc:290] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:46.577164 28988 consensus_queue.cc:1048] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:46.579048 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fabfb779b8894cf0b22204fe12768dc3" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:46.579358 28933 tablet_bootstrap.cc:492] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:46.579865 28933 ts_tablet_manager.cc:1403] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.084s user 0.016s sys 0.018s
I20260203 09:16:46.580946 28633 catalog_manager.cc:5654] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:46.576035 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fabfb779b8894cf0b22204fe12768dc3" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:46.583204 28933 raft_consensus.cc:359] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.584302 28933 raft_consensus.cc:385] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:46.584607 28933 raft_consensus.cc:740] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:46.585266 28933 consensus_queue.cc:260] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:16:46.583699 28701 leader_election.cc:343] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:46.583814 28807 raft_consensus.cc:2468] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 0.
I20260203 09:16:46.589691 28931 tablet_bootstrap.cc:492] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:46.590167 28931 ts_tablet_manager.cc:1403] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.107s user 0.011s sys 0.013s
I20260203 09:16:46.592489 28933 ts_tablet_manager.cc:1434] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.012s user 0.008s sys 0.000s
I20260203 09:16:46.593425 28933 tablet_bootstrap.cc:492] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:46.607137 28932 tablet_bootstrap.cc:492] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:46.607611 28932 ts_tablet_manager.cc:1403] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.076s user 0.020s sys 0.000s
I20260203 09:16:46.606848 28700 leader_election.cc:304] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:16:46.611992 29031 raft_consensus.cc:493] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:46.611748 28989 raft_consensus.cc:2804] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:46.612500 28989 raft_consensus.cc:493] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:46.612500 29031 raft_consensus.cc:515] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.613060 28989 raft_consensus.cc:3060] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:46.617928 29031 leader_election.cc:290] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:46.616088 28932 raft_consensus.cc:359] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.618764 28932 raft_consensus.cc:385] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:46.619043 28932 raft_consensus.cc:740] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:46.619726 28932 consensus_queue.cc:260] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.622975 28932 ts_tablet_manager.cc:1434] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20260203 09:16:46.623934 28989 raft_consensus.cc:515] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.625118 28933 tablet_bootstrap.cc:654] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:46.625758 29041 raft_consensus.cc:493] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:46.626027 28989 leader_election.cc:290] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:46.627492 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fabfb779b8894cf0b22204fe12768dc3" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:46.628791 28932 tablet_bootstrap.cc:492] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:46.628427 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fabfb779b8894cf0b22204fe12768dc3" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:46.626232 29041 raft_consensus.cc:515] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.631215 29041 leader_election.cc:290] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:46.628942 28807 raft_consensus.cc:3060] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:46.632409 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:46.633062 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:16:46.635316 28701 leader_election.cc:343] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:46.635035 28888 raft_consensus.cc:3060] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:16:46.637307 28700 leader_election.cc:343] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:46.637723 28700 leader_election.cc:304] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:46.639282 28931 raft_consensus.cc:359] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.639947 28931 raft_consensus.cc:385] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:46.640192 28931 raft_consensus.cc:740] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:46.640826 28931 consensus_queue.cc:260] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.649861 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:46.651679 29041 raft_consensus.cc:2749] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:46.651921 28888 raft_consensus.cc:2468] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:16:46.656351 29128 consensus_queue.cc:1048] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:46.652446 28931 ts_tablet_manager.cc:1434] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.062s user 0.007s sys 0.000s
I20260203 09:16:46.662374 28931 tablet_bootstrap.cc:492] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:46.662238 29041 consensus_queue.cc:1048] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:46.648433 28807 raft_consensus.cc:2468] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:16:46.654413 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:46.655187 28737 raft_consensus.cc:3060] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:46.656011 28932 tablet_bootstrap.cc:654] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:46.666457 28701 leader_election.cc:304] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:46.672817 28984 raft_consensus.cc:2804] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:46.674337 28984 raft_consensus.cc:697] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:16:46.675658 28984 consensus_queue.cc:237] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.675241 28989 consensus_queue.cc:1048] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260203 09:16:46.687186 29128 raft_consensus.cc:493] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:16:46.687381 28777 leader_election.cc:343] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:46.686689 28931 tablet_bootstrap.cc:654] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:46.687709 29128 raft_consensus.cc:515] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.692457 28933 tablet_bootstrap.cc:492] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:46.693027 28933 ts_tablet_manager.cc:1403] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.100s user 0.020s sys 0.023s
I20260203 09:16:46.693683 29030 consensus_queue.cc:1048] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:46.689965 29128 leader_election.cc:290] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:46.701264 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:46.702018 28886 raft_consensus.cc:2468] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
I20260203 09:16:46.703835 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:46.731424 28931 tablet_bootstrap.cc:492] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:46.732054 28931 ts_tablet_manager.cc:1403] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.070s user 0.014s sys 0.013s
W20260203 09:16:46.728960 28777 leader_election.cc:343] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:46.741999 28933 raft_consensus.cc:359] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.742693 28933 raft_consensus.cc:385] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:46.742966 28933 raft_consensus.cc:740] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:46.743566 28933 consensus_queue.cc:260] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.756536 28634 catalog_manager.cc:5654] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 0 to 1, leader changed from <none> to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:46.758447 28933 ts_tablet_manager.cc:1434] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.065s user 0.006s sys 0.000s
I20260203 09:16:46.759217 28933 tablet_bootstrap.cc:492] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:46.739836 28777 leader_election.cc:304] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:46.762271 28931 raft_consensus.cc:359] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.763070 28931 raft_consensus.cc:385] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:46.763360 28931 raft_consensus.cc:740] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:46.764353 29128 raft_consensus.cc:2749] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:46.768808 28931 consensus_queue.cc:260] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:16:46.774065 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 48352.4us
I20260203 09:16:46.776535 28931 ts_tablet_manager.cc:1434] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.044s user 0.005s sys 0.000s
I20260203 09:16:46.785297 28932 tablet_bootstrap.cc:492] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:46.787822 28932 ts_tablet_manager.cc:1403] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.159s user 0.012s sys 0.005s
I20260203 09:16:46.788443 28931 tablet_bootstrap.cc:492] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:46.785952 28938 consensus_queue.cc:1048] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:46.790933 28932 raft_consensus.cc:359] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.793197 28932 raft_consensus.cc:385] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:46.793449 28932 raft_consensus.cc:740] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:46.795585 28932 consensus_queue.cc:260] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.796358 28777 leader_election.cc:304] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:46.797129 29128 raft_consensus.cc:2804] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:46.797477 29128 raft_consensus.cc:493] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:46.797780 29128 raft_consensus.cc:3060] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:46.818244 28932 ts_tablet_manager.cc:1434] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.030s user 0.002s sys 0.004s
I20260203 09:16:46.819480 28932 tablet_bootstrap.cc:492] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:46.853092 28735 raft_consensus.cc:3060] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:46.855672 28931 tablet_bootstrap.cc:654] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
W20260203 09:16:46.870910 28777 leader_election.cc:343] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:46.875142 28933 tablet_bootstrap.cc:654] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:46.884829 29006 raft_consensus.cc:493] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:46.885344 29006 raft_consensus.cc:515] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.887243 29006 leader_election.cc:290] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:46.897374 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:46.897087 29006 consensus_queue.cc:1048] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260203 09:16:46.908701 28809 raft_consensus.cc:2468] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:46.908851 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:46.910395 28932 tablet_bootstrap.cc:654] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
W20260203 09:16:46.912497 28852 leader_election.cc:343] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:46.912700 29128 raft_consensus.cc:515] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.914204 29006 consensus_queue.cc:1048] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:46.914638 29128 leader_election.cc:290] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:46.922751 28931 tablet_bootstrap.cc:492] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:46.923300 28931 ts_tablet_manager.cc:1403] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.135s user 0.012s sys 0.013s
W20260203 09:16:46.926743 28683 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:16:46.933632 28851 leader_election.cc:304] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:46.935019 28931 raft_consensus.cc:359] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:46.935303 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:46.935779 28931 raft_consensus.cc:385] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:46.936303 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:46.937917 29035 raft_consensus.cc:2804] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:46.938329 29035 raft_consensus.cc:493] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:46.938674 29035 raft_consensus.cc:3060] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:46.939345 28938 consensus_queue.cc:1048] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:46.936082 28931 raft_consensus.cc:740] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:46.936017 28889 raft_consensus.cc:3060] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:46.942095 28931 consensus_queue.cc:260] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:16:46.943573 28777 leader_election.cc:343] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:46.949699 28931 ts_tablet_manager.cc:1434] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.026s user 0.007s sys 0.001s
I20260203 09:16:46.951045 28931 tablet_bootstrap.cc:492] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:47.040585 28931 tablet_bootstrap.cc:654] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:47.044976 29035 raft_consensus.cc:515] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.062693 28889 raft_consensus.cc:2468] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:47.075619 29035 leader_election.cc:290] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:47.160439 28933 tablet_bootstrap.cc:492] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:47.161101 28933 ts_tablet_manager.cc:1403] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.402s user 0.018s sys 0.025s
I20260203 09:16:47.163625 29030 raft_consensus.cc:493] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:47.164145 29030 raft_consensus.cc:515] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.166175 29030 leader_election.cc:290] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:47.168361 28777 leader_election.cc:304] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:47.168532 28931 tablet_bootstrap.cc:492] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:47.169047 28931 ts_tablet_manager.cc:1403] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.218s user 0.025s sys 0.000s
I20260203 09:16:47.168087 28937 raft_consensus.cc:493] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:47.171391 29030 raft_consensus.cc:2804] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:47.174362 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:47.177217 28933 raft_consensus.cc:359] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.177974 28933 raft_consensus.cc:385] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:47.178225 28933 raft_consensus.cc:740] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:47.172084 28989 raft_consensus.cc:493] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:47.180742 28989 raft_consensus.cc:515] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.182649 28989 leader_election.cc:290] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:47.183109 28932 tablet_bootstrap.cc:492] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:47.183282 28808 raft_consensus.cc:3060] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:47.184417 28931 raft_consensus.cc:359] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.185115 28931 raft_consensus.cc:385] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:47.185375 28931 raft_consensus.cc:740] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:47.185962 28931 consensus_queue.cc:260] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.186939 28932 ts_tablet_manager.cc:1403] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.368s user 0.029s sys 0.050s
I20260203 09:16:47.190549 28932 raft_consensus.cc:359] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.191231 28932 raft_consensus.cc:385] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:47.191519 28932 raft_consensus.cc:740] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:47.187691 28933 consensus_queue.cc:260] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.193652 28932 consensus_queue.cc:260] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.196106 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:47.196322 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:47.200541 28933 ts_tablet_manager.cc:1434] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.039s user 0.005s sys 0.001s
I20260203 09:16:47.201548 28933 tablet_bootstrap.cc:492] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
W20260203 09:16:47.203608 28777 leader_election.cc:343] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:47.193312 29030 raft_consensus.cc:697] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:16:47.176753 28937 raft_consensus.cc:515] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.208191 28931 ts_tablet_manager.cc:1434] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.039s user 0.006s sys 0.000s
I20260203 09:16:47.209434 28931 tablet_bootstrap.cc:492] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:47.211172 28932 ts_tablet_manager.cc:1434] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.024s user 0.004s sys 0.002s
I20260203 09:16:47.212291 28932 tablet_bootstrap.cc:492] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:47.216989 28937 leader_election.cc:290] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:47.205276 29030 consensus_queue.cc:237] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:16:47.223937 28852 leader_election.cc:343] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:47.231994 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:47.232868 28931 tablet_bootstrap.cc:654] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:47.232708 28738 raft_consensus.cc:2468] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
I20260203 09:16:47.237820 28933 tablet_bootstrap.cc:654] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:47.243902 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b6f1d6e275f4a8ba99a70dbb3ea3235" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:47.244722 28808 raft_consensus.cc:2468] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:47.245236 28811 raft_consensus.cc:2393] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 1: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:16:47.245078 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:47.248504 28937 consensus_queue.cc:1048] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:47.249464 29035 consensus_queue.cc:1048] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260203 09:16:47.252131 28700 leader_election.cc:343] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:47.248600 28851 leader_election.cc:304] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:47.257507 28988 raft_consensus.cc:493] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:47.258036 28988 raft_consensus.cc:515] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.258549 29006 raft_consensus.cc:2804] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:47.259377 29006 raft_consensus.cc:697] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:47.260107 28988 leader_election.cc:290] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:47.263645 28736 raft_consensus.cc:3060] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:47.277382 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:47.281020 29151 raft_consensus.cc:493] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:47.260428 29006 consensus_queue.cc:237] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.295471 28777 leader_election.cc:304] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:16:47.298285 28635 catalog_manager.cc:5654] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 0 to 1, leader changed from <none> to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:47.291262 29151 raft_consensus.cc:515] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.293713 28809 raft_consensus.cc:2468] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:47.308199 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b6f1d6e275f4a8ba99a70dbb3ea3235" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:47.300123 29030 raft_consensus.cc:2804] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:47.318252 29030 raft_consensus.cc:493] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:47.318653 29030 raft_consensus.cc:3060] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:47.314738 28851 leader_election.cc:304] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:47.324100 29151 leader_election.cc:290] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:47.324856 28988 raft_consensus.cc:2804] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:47.325245 28988 raft_consensus.cc:493] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:47.325579 28988 raft_consensus.cc:3060] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:47.317359 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:47.317343 28932 tablet_bootstrap.cc:654] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:47.332178 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:47.332881 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:47.342573 28701 leader_election.cc:304] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:16:47.344276 28700 leader_election.cc:343] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:47.345935 28933 tablet_bootstrap.cc:492] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:47.346416 28933 ts_tablet_manager.cc:1403] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.145s user 0.028s sys 0.004s
W20260203 09:16:47.348110 28701 leader_election.cc:343] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:47.351838 28933 raft_consensus.cc:359] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.362460 28933 raft_consensus.cc:385] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:47.362835 28933 raft_consensus.cc:740] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:47.360083 29030 raft_consensus.cc:515] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.369540 28933 consensus_queue.cc:260] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.371871 28933 ts_tablet_manager.cc:1434] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.025s user 0.003s sys 0.002s
I20260203 09:16:47.371955 29030 leader_election.cc:290] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:47.372310 28931 tablet_bootstrap.cc:492] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:47.372839 28931 ts_tablet_manager.cc:1403] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.164s user 0.011s sys 0.014s
I20260203 09:16:47.373808 28933 tablet_bootstrap.cc:492] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:47.374145 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
W20260203 09:16:47.374724 28852 leader_election.cc:343] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:47.356175 28988 raft_consensus.cc:515] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.375217 28937 raft_consensus.cc:2749] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:47.373206 28701 leader_election.cc:304] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:47.383411 28988 leader_election.cc:290] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:47.378629 28931 raft_consensus.cc:359] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.384806 28931 raft_consensus.cc:385] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:47.385089 28931 raft_consensus.cc:740] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:47.385084 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
W20260203 09:16:47.380934 28777 leader_election.cc:343] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:16:47.470847 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 89940.4us
I20260203 09:16:47.393524 28932 tablet_bootstrap.cc:492] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:47.472698 28932 ts_tablet_manager.cc:1403] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.261s user 0.025s sys 0.009s
I20260203 09:16:47.385821 29100 consensus_queue.cc:1048] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.088s
I20260203 09:16:47.473729 28736 raft_consensus.cc:3060] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:47.471102 28931 consensus_queue.cc:260] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.477641 29006 consensus_queue.cc:1048] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:47.478432 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:47.491287 28933 tablet_bootstrap.cc:654] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:47.385792 28989 raft_consensus.cc:2749] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:47.490732 28931 ts_tablet_manager.cc:1434] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.118s user 0.004s sys 0.018s
I20260203 09:16:47.491156 28810 raft_consensus.cc:3060] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:47.492753 28931 tablet_bootstrap.cc:492] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:47.493238 28733 raft_consensus.cc:3060] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:47.479308 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:47.473242 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:47.500622 28810 raft_consensus.cc:2468] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:47.506783 28932 raft_consensus.cc:359] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.507628 28932 raft_consensus.cc:385] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:47.507937 28932 raft_consensus.cc:740] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:47.508615 28932 consensus_queue.cc:260] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.510491 28932 ts_tablet_manager.cc:1434] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.037s user 0.001s sys 0.005s
I20260203 09:16:47.511432 28932 tablet_bootstrap.cc:492] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:47.504871 28851 leader_election.cc:304] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
W20260203 09:16:47.519927 28852 leader_election.cc:343] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:47.524199 29150 raft_consensus.cc:493] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:47.524814 29150 raft_consensus.cc:515] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.526948 29150 leader_election.cc:290] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:47.527482 29150 raft_consensus.cc:2804] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:47.527932 29150 raft_consensus.cc:697] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:47.531566 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:47.530318 29150 consensus_queue.cc:237] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.533885 28736 raft_consensus.cc:2468] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
W20260203 09:16:47.534348 28852 leader_election.cc:343] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:16:47.541188 28701 leader_election.cc:343] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:47.541775 28701 leader_election.cc:304] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:47.542627 28989 raft_consensus.cc:2749] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:47.544385 28777 leader_election.cc:304] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:16:47.545603 29030 raft_consensus.cc:2804] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:47.546236 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:47.545855 28634 catalog_manager.cc:5654] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:47.546891 28810 raft_consensus.cc:2468] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:47.547636 29030 raft_consensus.cc:697] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:16:47.549296 29030 consensus_queue.cc:237] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.567049 28931 tablet_bootstrap.cc:654] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:47.568809 28851 leader_election.cc:304] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:47.573323 29090 raft_consensus.cc:2804] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:47.573989 29090 raft_consensus.cc:493] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:47.578936 29090 raft_consensus.cc:3060] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:47.582695 28634 catalog_manager.cc:5654] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 0 to 1, leader changed from <none> to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:47.586071 28933 tablet_bootstrap.cc:492] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:47.586565 28933 ts_tablet_manager.cc:1403] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.214s user 0.009s sys 0.017s
I20260203 09:16:47.594595 28933 raft_consensus.cc:359] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.595091 28933 raft_consensus.cc:385] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:47.595309 28933 raft_consensus.cc:740] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:47.595813 28933 consensus_queue.cc:260] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.595396 28635 catalog_manager.cc:5654] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:47.598104 28932 tablet_bootstrap.cc:654] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:47.605376 29090 raft_consensus.cc:515] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.607151 28933 ts_tablet_manager.cc:1434] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.020s user 0.005s sys 0.002s
I20260203 09:16:47.609071 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:47.609812 28810 raft_consensus.cc:3060] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:47.610358 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
W20260203 09:16:47.611687 28852 leader_election.cc:343] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:47.612327 28933 tablet_bootstrap.cc:492] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:47.616603 29150 raft_consensus.cc:493] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:47.617395 29090 leader_election.cc:290] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:47.617141 29150 raft_consensus.cc:515] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.619228 29150 leader_election.cc:290] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:47.619737 29030 raft_consensus.cc:493] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:47.619916 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:47.620209 29030 raft_consensus.cc:515] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:16:47.621133 28852 leader_election.cc:343] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:47.622184 29030 leader_election.cc:290] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:47.623276 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:47.623628 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:47.628389 28733 raft_consensus.cc:2468] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
I20260203 09:16:47.629184 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:47.630050 28777 leader_election.cc:304] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
W20260203 09:16:47.630930 28777 leader_election.cc:343] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:47.631830 29030 raft_consensus.cc:2804] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:47.632211 29030 raft_consensus.cc:493] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:47.632824 29030 raft_consensus.cc:3060] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:47.634485 28811 raft_consensus.cc:2468] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:47.636675 28851 leader_election.cc:304] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:47.638438 28932 tablet_bootstrap.cc:492] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:47.638983 28932 ts_tablet_manager.cc:1403] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.128s user 0.015s sys 0.005s
I20260203 09:16:47.641498 28932 raft_consensus.cc:359] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.642244 28932 raft_consensus.cc:385] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:47.642539 28932 raft_consensus.cc:740] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:47.643191 28932 consensus_queue.cc:260] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.643225 29030 raft_consensus.cc:515] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.644814 29090 raft_consensus.cc:2804] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:47.645171 29090 raft_consensus.cc:493] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:47.645524 28932 ts_tablet_manager.cc:1434] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260203 09:16:47.645496 29090 raft_consensus.cc:3060] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:47.646211 28931 tablet_bootstrap.cc:492] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:47.646638 28931 ts_tablet_manager.cc:1403] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.154s user 0.012s sys 0.008s
I20260203 09:16:47.649091 28931 raft_consensus.cc:359] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.649806 28931 raft_consensus.cc:385] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:47.650068 28931 raft_consensus.cc:740] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:47.650367 28932 tablet_bootstrap.cc:492] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:47.650645 28931 consensus_queue.cc:260] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.629385 28810 raft_consensus.cc:2468] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:47.658010 28851 leader_election.cc:304] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:47.658855 29150 raft_consensus.cc:2804] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:47.659363 29150 raft_consensus.cc:697] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:47.661206 28932 tablet_bootstrap.cc:654] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:47.660158 29150 consensus_queue.cc:237] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.665014 28931 ts_tablet_manager.cc:1434] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.018s user 0.006s sys 0.001s
I20260203 09:16:47.666059 28931 tablet_bootstrap.cc:492] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:47.666142 29030 leader_election.cc:290] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:47.667310 29090 raft_consensus.cc:515] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.668318 28933 tablet_bootstrap.cc:654] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
W20260203 09:16:47.679106 28777 consensus_peers.cc:597] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:16:47.684260 28931 tablet_bootstrap.cc:654] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:47.687988 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:47.688921 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:47.688975 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:47.689580 28810 raft_consensus.cc:3060] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:47.683152 29090 leader_election.cc:290] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:47.717319 28932 tablet_bootstrap.cc:492] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:47.717808 28932 ts_tablet_manager.cc:1403] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.068s user 0.020s sys 0.005s
I20260203 09:16:47.684043 29030 consensus_queue.cc:1048] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260203 09:16:47.734977 28932 raft_consensus.cc:359] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.735939 28932 raft_consensus.cc:385] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:47.736230 28932 raft_consensus.cc:740] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:47.737066 28932 consensus_queue.cc:260] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.739333 28932 ts_tablet_manager.cc:1434] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.021s user 0.005s sys 0.001s
W20260203 09:16:47.751544 28777 leader_election.cc:343] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:47.681425 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:47.791280 28735 raft_consensus.cc:3060] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:47.799029 28735 raft_consensus.cc:2468] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:47.834960 28931 tablet_bootstrap.cc:492] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:47.835481 28931 ts_tablet_manager.cc:1403] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.170s user 0.022s sys 0.031s
I20260203 09:16:47.837900 28931 raft_consensus.cc:359] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.838564 28931 raft_consensus.cc:385] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:47.838816 28931 raft_consensus.cc:740] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:47.839399 28931 consensus_queue.cc:260] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.841298 28777 leader_election.cc:304] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:16:47.841506 28931 ts_tablet_manager.cc:1434] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260203 09:16:47.842027 29173 raft_consensus.cc:2804] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:47.842536 29173 raft_consensus.cc:697] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:16:47.843333 29173 consensus_queue.cc:237] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:47.846987 28931 tablet_bootstrap.cc:492] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:47.855686 28931 tablet_bootstrap.cc:654] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:48.037370 28810 raft_consensus.cc:2468] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:48.057458 28933 tablet_bootstrap.cc:492] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:48.058087 28933 ts_tablet_manager.cc:1403] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.450s user 0.017s sys 0.006s
I20260203 09:16:48.173977 29041 raft_consensus.cc:493] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:48.183681 29041 raft_consensus.cc:515] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.197317 29041 leader_election.cc:290] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:48.203359 28984 raft_consensus.cc:493] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:48.203960 28984 raft_consensus.cc:515] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.187180 29090 raft_consensus.cc:493] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:48.224753 29090 raft_consensus.cc:515] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.257169 29090 leader_election.cc:290] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:48.260479 28984 leader_election.cc:290] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:48.270152 28933 raft_consensus.cc:359] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.271005 28933 raft_consensus.cc:385] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:48.271287 28933 raft_consensus.cc:740] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:48.351217 28851 leader_election.cc:304] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:48.391209 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:48.392203 28810 raft_consensus.cc:2393] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 1: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:16:48.452744 28933 consensus_queue.cc:260] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.454571 28933 ts_tablet_manager.cc:1434] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.396s user 0.005s sys 0.002s
I20260203 09:16:48.455014 28931 tablet_bootstrap.cc:492] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:48.455714 28931 ts_tablet_manager.cc:1403] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.609s user 0.011s sys 0.008s
I20260203 09:16:48.456794 29150 raft_consensus.cc:2804] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:48.457401 29150 raft_consensus.cc:697] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:48.458226 29150 consensus_queue.cc:237] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.458683 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:48.458837 28931 raft_consensus.cc:359] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:16:48.459400 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 108267us
I20260203 09:16:48.459553 28931 raft_consensus.cc:385] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:48.459914 28931 raft_consensus.cc:740] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:48.460517 28931 consensus_queue.cc:260] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.462657 28931 ts_tablet_manager.cc:1434] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260203 09:16:48.463547 28931 tablet_bootstrap.cc:492] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
W20260203 09:16:48.463918 28700 leader_election.cc:343] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:48.468930 28885 raft_consensus.cc:3060] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:48.469985 28931 tablet_bootstrap.cc:654] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:48.483537 28931 tablet_bootstrap.cc:492] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:48.484010 28931 ts_tablet_manager.cc:1403] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.021s user 0.011s sys 0.007s
I20260203 09:16:48.486680 28931 raft_consensus.cc:359] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.487392 28931 raft_consensus.cc:385] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:48.487645 28931 raft_consensus.cc:740] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:48.488271 29090 raft_consensus.cc:493] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:48.488260 28931 consensus_queue.cc:260] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.488960 29090 raft_consensus.cc:515] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.490499 28931 ts_tablet_manager.cc:1434] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260203 09:16:48.491338 28931 tablet_bootstrap.cc:492] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:48.498404 28931 tablet_bootstrap.cc:654] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:48.510274 28931 tablet_bootstrap.cc:492] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:48.510792 28931 ts_tablet_manager.cc:1403] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.020s user 0.016s sys 0.000s
I20260203 09:16:48.513000 29031 consensus_queue.cc:1048] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:48.513185 28931 raft_consensus.cc:359] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.513845 28931 raft_consensus.cc:385] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:48.514057 28931 raft_consensus.cc:740] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:48.514554 28931 consensus_queue.cc:260] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.516515 28931 ts_tablet_manager.cc:1434] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260203 09:16:48.517400 28931 tablet_bootstrap.cc:492] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:48.525740 28931 tablet_bootstrap.cc:654] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:48.525704 29150 consensus_queue.cc:1048] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260203 09:16:48.517539 29176 log.cc:927] Time spent T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.393s user 0.003s sys 0.011s
I20260203 09:16:47.743551 28932 tablet_bootstrap.cc:492] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:48.531055 28933 tablet_bootstrap.cc:492] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:48.556710 28933 tablet_bootstrap.cc:654] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:48.568962 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:48.642076 28989 raft_consensus.cc:493] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:48.643157 28989 raft_consensus.cc:515] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.661800 28633 catalog_manager.cc:5654] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
W20260203 09:16:48.669533 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 93968us
I20260203 09:16:48.675518 29090 leader_election.cc:290] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
W20260203 09:16:48.678959 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 91370.3us
W20260203 09:16:48.679735 28852 leader_election.cc:343] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:48.686318 28931 tablet_bootstrap.cc:492] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:48.686954 28931 ts_tablet_manager.cc:1403] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.170s user 0.022s sys 0.021s
I20260203 09:16:48.677253 28989 leader_election.cc:290] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:48.699991 29179 raft_consensus.cc:493] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:16:48.700698 29179 raft_consensus.cc:515] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.702868 29179 leader_election.cc:290] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:48.704190 29041 raft_consensus.cc:493] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:16:48.705036 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b2c469d7255413d9f61a7cbaa4481a7" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:48.718717 28933 tablet_bootstrap.cc:492] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:48.719097 28933 ts_tablet_manager.cc:1403] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.188s user 0.009s sys 0.003s
W20260203 09:16:48.727828 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 57510.7us
I20260203 09:16:48.729727 28931 raft_consensus.cc:359] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.730386 28931 raft_consensus.cc:385] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:48.730599 28931 raft_consensus.cc:740] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:48.731061 28931 consensus_queue.cc:260] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.714429 28984 raft_consensus.cc:493] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:16:48.718158 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47301e2bbfc94767a9905b0e12141d6d" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:48.723148 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:48.709210 29041 raft_consensus.cc:515] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.740927 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:48.741613 29041 leader_election.cc:290] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:48.742134 28931 ts_tablet_manager.cc:1434] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.055s user 0.006s sys 0.001s
I20260203 09:16:48.742867 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:48.733851 28984 raft_consensus.cc:515] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.744342 28932 tablet_bootstrap.cc:654] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:48.747207 28984 leader_election.cc:290] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:16:48.735221 28700 leader_election.cc:343] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:48.738566 28738 raft_consensus.cc:2393] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 1: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
W20260203 09:16:48.757288 28666 debug-util.cc:398] Leaking SignalData structure 0x7b0800091700 after lost signal to thread 27556
I20260203 09:16:48.758344 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:48.761324 29141 raft_consensus.cc:493] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:16:48.761092 28933 raft_consensus.cc:359] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.761917 28933 raft_consensus.cc:385] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:48.761839 29141 raft_consensus.cc:515] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.762253 28933 raft_consensus.cc:740] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:48.741679 28731 raft_consensus.cc:2468] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:48.762089 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:48.765460 28852 leader_election.cc:304] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:48.765619 28933 consensus_queue.cc:260] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.766692 28729 raft_consensus.cc:3060] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:48.767076 28731 raft_consensus.cc:3060] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:48.774781 28933 ts_tablet_manager.cc:1434] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.055s user 0.007s sys 0.000s
I20260203 09:16:48.776496 28933 tablet_bootstrap.cc:492] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:48.781111 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:48.764705 29141 leader_election.cc:290] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:48.786513 28634 catalog_manager.cc:5654] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 0 to 1, leader changed from <none> to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:48.793085 28852 leader_election.cc:304] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:16:48.798674 28852 consensus_peers.cc:597] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:16:48.805799 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:48.796280 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:48.806752 29090 consensus_queue.cc:1048] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260203 09:16:48.812335 29196 raft_consensus.cc:2804] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:16:48.817535 29090 raft_consensus.cc:493] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:16:48.818197 29090 raft_consensus.cc:515] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.820720 29090 leader_election.cc:290] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:48.821435 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:16:48.822031 28666 debug-util.cc:398] Leaking SignalData structure 0x7b0800091de0 after lost signal to thread 28669
I20260203 09:16:48.834936 28984 raft_consensus.cc:493] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:48.839570 29198 raft_consensus.cc:3060] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:48.875052 29149 consensus_queue.cc:1048] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260203 09:16:48.880956 29197 raft_consensus.cc:493] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:16:48.869741 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:48.885583 28851 leader_election.cc:304] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:48.886092 28933 tablet_bootstrap.cc:654] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:48.840040 28984 raft_consensus.cc:515] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.860999 29090 consensus_queue.cc:1048] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260203 09:16:48.886986 29150 raft_consensus.cc:2749] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:16:48.888047 29151 raft_consensus.cc:493] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:16:48.889295 29151 raft_consensus.cc:515] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.891129 29151 leader_election.cc:290] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:48.892993 29197 raft_consensus.cc:515] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.899094 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:48.886540 29041 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:16:48.912631 29041 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.916424 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b2c469d7255413d9f61a7cbaa4481a7" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:16:48.901089 28666 debug-util.cc:398] Leaking SignalData structure 0x7b0800200cc0 after lost signal to thread 28762
I20260203 09:16:48.917795 28932 tablet_bootstrap.cc:492] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:48.918371 28932 ts_tablet_manager.cc:1403] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 1.178s user 0.041s sys 0.076s
I20260203 09:16:48.901288 29151 raft_consensus.cc:493] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:48.923262 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47301e2bbfc94767a9905b0e12141d6d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:48.926852 28937 raft_consensus.cc:493] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:16:48.929760 28937 raft_consensus.cc:515] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.930308 29198 raft_consensus.cc:2749] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:48.931928 28937 leader_election.cc:290] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:48.925544 29041 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:16:48.936064 28852 consensus_peers.cc:597] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:16:48.925705 29197 leader_election.cc:290] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:48.939939 29196 raft_consensus.cc:493] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:16:48.940382 28931 tablet_bootstrap.cc:492] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:48.940877 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:48.937566 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:16:48.935384 28666 debug-util.cc:398] Leaking SignalData structure 0x7b08001610e0 after lost signal to thread 28838
I20260203 09:16:48.926256 29151 raft_consensus.cc:515] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:16:48.940902 29200 log.cc:927] Time spent T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f: Append to log took a long time: real 0.151s user 0.004s sys 0.000s
I20260203 09:16:48.949353 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:48.940409 29196 raft_consensus.cc:3060] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:48.951202 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:48.951524 28701 leader_election.cc:304] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:48.947374 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:16:48.952675 28666 debug-util.cc:398] Leaking SignalData structure 0x7b080010c080 after lost signal to thread 28913
I20260203 09:16:48.954574 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:48.954275 28932 raft_consensus.cc:359] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.968050 28932 raft_consensus.cc:385] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:48.968565 28932 raft_consensus.cc:740] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:48.969244 28932 consensus_queue.cc:260] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.960091 29173 consensus_queue.cc:1048] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:48.948894 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47301e2bbfc94767a9905b0e12141d6d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:48.975745 28984 leader_election.cc:290] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:48.979890 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:48.976524 28937 raft_consensus.cc:493] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:48.987373 28932 ts_tablet_manager.cc:1434] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.069s user 0.005s sys 0.002s
I20260203 09:16:48.988481 28932 tablet_bootstrap.cc:492] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:48.985460 29151 leader_election.cc:290] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:48.995904 28852 leader_election.cc:304] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:48.990092 28937 raft_consensus.cc:515] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.998798 29100 raft_consensus.cc:493] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:16:48.999162 29041 raft_consensus.cc:493] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:16:48.999338 29100 raft_consensus.cc:515] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:48.999670 29041 raft_consensus.cc:515] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.000092 28937 leader_election.cc:290] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:49.001257 29100 leader_election.cc:290] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:49.002048 29041 leader_election.cc:290] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:16:49.002808 28701 leader_election.cc:343] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:49.003870 28989 raft_consensus.cc:2749] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:49.003880 28933 tablet_bootstrap.cc:492] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:49.004132 28701 leader_election.cc:304] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:49.005044 28933 ts_tablet_manager.cc:1403] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.229s user 0.016s sys 0.016s
I20260203 09:16:49.003463 28931 tablet_bootstrap.cc:654] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:49.008553 28989 raft_consensus.cc:2749] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:49.009285 29006 raft_consensus.cc:2749] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 09:16:49.009542 28701 leader_election.cc:343] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:49.009977 28701 leader_election.cc:304] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:49.011977 28989 raft_consensus.cc:2749] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260203 09:16:48.986723 28700 leader_election.cc:343] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:49.020958 28701 leader_election.cc:304] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:49.022483 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:49.022801 29151 raft_consensus.cc:2749] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:16:49.032934 29196 raft_consensus.cc:515] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.034857 29196 leader_election.cc:290] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:49.042356 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:49.044123 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:49.041136 28701 leader_election.cc:304] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:49.046550 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:49.047715 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:49.048162 28984 raft_consensus.cc:2749] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:16:49.046851 29006 raft_consensus.cc:493] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:16:49.050173 29006 raft_consensus.cc:515] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.048095 28731 raft_consensus.cc:3060] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:49.052175 29006 leader_election.cc:290] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:49.053593 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:49.047258 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:49.053586 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:49.056800 28852 leader_election.cc:304] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:49.051452 28933 raft_consensus.cc:359] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.058058 28933 raft_consensus.cc:385] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:49.058323 28933 raft_consensus.cc:740] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:49.059085 29006 raft_consensus.cc:2749] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:16:49.058988 28933 consensus_queue.cc:260] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.048401 29197 consensus_queue.cc:1048] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260203 09:16:49.074542 28933 ts_tablet_manager.cc:1434] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.069s user 0.004s sys 0.003s
I20260203 09:16:49.078289 28933 tablet_bootstrap.cc:492] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:49.079841 28701 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:49.081977 29151 raft_consensus.cc:2749] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:16:49.082860 28931 tablet_bootstrap.cc:492] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:49.083314 28931 ts_tablet_manager.cc:1403] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.143s user 0.011s sys 0.002s
I20260203 09:16:49.065472 29196 consensus_queue.cc:1048] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260203 09:16:49.109987 28931 raft_consensus.cc:359] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.111603 28931 raft_consensus.cc:385] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:49.111938 28931 raft_consensus.cc:740] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:49.113915 28931 consensus_queue.cc:260] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.124192 28932 tablet_bootstrap.cc:654] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:49.156392 29173 raft_consensus.cc:493] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:49.156991 29173 raft_consensus.cc:515] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.159053 29173 leader_election.cc:290] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:49.162503 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:49.140223 28731 raft_consensus.cc:2468] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
W20260203 09:16:49.165083 28777 leader_election.cc:343] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:49.113663 28701 leader_election.cc:304] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:49.171870 29151 raft_consensus.cc:2749] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:16:49.174778 28931 ts_tablet_manager.cc:1434] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.091s user 0.003s sys 0.009s
I20260203 09:16:49.176035 28931 tablet_bootstrap.cc:492] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:49.180876 28852 leader_election.cc:304] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:49.184669 29150 raft_consensus.cc:2804] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:16:49.185349 29150 raft_consensus.cc:697] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:49.186180 29173 raft_consensus.cc:493] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:49.187254 29173 raft_consensus.cc:515] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.186287 29150 consensus_queue.cc:237] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.189656 29173 leader_election.cc:290] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:49.176961 29035 raft_consensus.cc:493] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:49.197360 29035 raft_consensus.cc:515] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.199487 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:16:49.201956 28777 leader_election.cc:343] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:16:49.180558 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 71593.4us
I20260203 09:16:49.208482 29035 leader_election.cc:290] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:49.218890 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:49.221025 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:49.221896 28731 raft_consensus.cc:2468] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
W20260203 09:16:49.224395 28851 leader_election.cc:343] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:49.225033 28852 leader_election.cc:304] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:49.230734 29179 raft_consensus.cc:493] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:49.231161 29179 raft_consensus.cc:515] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.232856 28931 tablet_bootstrap.cc:654] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:49.235900 28887 raft_consensus.cc:1240] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
I20260203 09:16:49.227916 29150 raft_consensus.cc:2804] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:49.249217 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:49.249536 28729 raft_consensus.cc:3060] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:49.241042 29179 leader_election.cc:290] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:49.257822 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47301e2bbfc94767a9905b0e12141d6d" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:49.261407 28732 raft_consensus.cc:1240] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
I20260203 09:16:49.262876 28932 tablet_bootstrap.cc:492] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:49.265130 28933 tablet_bootstrap.cc:654] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
W20260203 09:16:49.268129 28777 leader_election.cc:343] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:49.275350 28932 ts_tablet_manager.cc:1403] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.287s user 0.014s sys 0.028s
I20260203 09:16:49.269290 28734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:49.265830 28633 catalog_manager.cc:5654] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:49.264168 29150 raft_consensus.cc:493] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:49.281148 29177 consensus_queue.cc:1059] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260203 09:16:49.281513 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:49.282640 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:49.284842 29177 consensus_queue.cc:1243] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer 77541303e1934638ba82f0f43f707adc log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260203 09:16:49.291038 29141 raft_consensus.cc:3055] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:16:49.291440 29141 raft_consensus.cc:740] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:16:49.294044 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:49.285007 28730 raft_consensus.cc:2468] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
I20260203 09:16:49.285948 29150 raft_consensus.cc:3060] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:49.300256 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:49.302621 29141 consensus_queue.cc:260] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.304044 29141 raft_consensus.cc:3060] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:49.306051 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:49.315501 28931 tablet_bootstrap.cc:492] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:49.316020 28931 ts_tablet_manager.cc:1403] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.140s user 0.016s sys 0.006s
I20260203 09:16:49.322643 28931 raft_consensus.cc:359] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.323297 28931 raft_consensus.cc:385] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:49.323566 28931 raft_consensus.cc:740] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:49.325001 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:49.326992 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:49.328189 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:49.324167 28931 consensus_queue.cc:260] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.341204 29150 raft_consensus.cc:515] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.343852 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:49.344432 28731 raft_consensus.cc:3060] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:49.345027 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
W20260203 09:16:49.346266 28851 leader_election.cc:343] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:49.355214 29150 leader_election.cc:290] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:49.358336 28932 raft_consensus.cc:359] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.359287 28932 raft_consensus.cc:385] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:49.361728 28932 raft_consensus.cc:740] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
W20260203 09:16:49.361320 28683 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:16:49.365058 28731 raft_consensus.cc:2468] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:49.359983 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:49.366628 29173 consensus_queue.cc:1048] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260203 09:16:49.366955 28932 consensus_queue.cc:260] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.373687 28777 leader_election.cc:304] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:16:49.376233 28777 leader_election.cc:343] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:49.376585 28777 leader_election.cc:304] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:49.375837 28852 leader_election.cc:304] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:49.383165 28931 ts_tablet_manager.cc:1434] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.067s user 0.004s sys 0.002s
I20260203 09:16:49.384358 28931 tablet_bootstrap.cc:492] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
W20260203 09:16:49.385372 28777 leader_election.cc:343] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:49.385864 28777 leader_election.cc:304] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:49.387053 28777 leader_election.cc:304] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:16:49.392736 28633 catalog_manager.cc:5654] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 1 to 2, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 2 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:49.389117 28988 raft_consensus.cc:2804] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:49.384789 29179 raft_consensus.cc:2749] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:49.384903 29173 raft_consensus.cc:2749] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:16:49.392798 29150 raft_consensus.cc:493] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:49.397099 28932 ts_tablet_manager.cc:1434] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.121s user 0.007s sys 0.001s
I20260203 09:16:49.395300 29141 raft_consensus.cc:2804] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:49.399655 28777 leader_election.cc:304] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:49.398741 28988 raft_consensus.cc:697] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:49.401152 29173 raft_consensus.cc:2749] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:16:49.402964 28988 consensus_queue.cc:237] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.404454 28933 tablet_bootstrap.cc:492] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:49.404942 28933 ts_tablet_manager.cc:1403] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.330s user 0.023s sys 0.038s
I20260203 09:16:49.405058 29151 raft_consensus.cc:493] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:49.399941 29141 raft_consensus.cc:493] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:49.408252 29141 raft_consensus.cc:3060] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:49.409967 28933 raft_consensus.cc:359] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.405557 29151 raft_consensus.cc:515] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.398931 29150 raft_consensus.cc:515] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.414496 28933 raft_consensus.cc:385] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:49.396937 28701 leader_election.cc:304] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:49.416548 29223 raft_consensus.cc:2749] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:49.416177 29151 leader_election.cc:290] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:49.418421 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:49.421937 28984 raft_consensus.cc:2749] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:16:49.422101 28701 leader_election.cc:304] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:49.422592 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:49.422937 28989 raft_consensus.cc:2749] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 09:16:49.422163 28700 leader_election.cc:343] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:49.417994 28933 raft_consensus.cc:740] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:49.419899 29150 leader_election.cc:290] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:49.424247 28933 consensus_queue.cc:260] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.431950 28932 tablet_bootstrap.cc:492] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:49.434067 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:49.434453 29141 raft_consensus.cc:515] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.424250 28701 leader_election.cc:304] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:49.437114 29151 raft_consensus.cc:2749] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:49.437733 28809 raft_consensus.cc:2393] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 1: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:16:49.438319 28701 leader_election.cc:304] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:49.433969 28729 raft_consensus.cc:2468] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:49.438951 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:49.446156 29151 raft_consensus.cc:2749] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:16:49.447100 28852 leader_election.cc:304] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:49.447899 28931 tablet_bootstrap.cc:654] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:49.436388 29141 leader_election.cc:290] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:49.452755 28933 ts_tablet_manager.cc:1434] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.048s user 0.007s sys 0.000s
I20260203 09:16:49.446108 28887 raft_consensus.cc:3060] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:49.458168 28933 tablet_bootstrap.cc:492] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:49.458106 28701 leader_election.cc:304] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:49.459661 28984 raft_consensus.cc:2749] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 09:16:49.463853 28701 leader_election.cc:343] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:49.464406 28701 leader_election.cc:304] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:49.470396 28984 raft_consensus.cc:2749] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:49.480023 28933 tablet_bootstrap.cc:654] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:49.484326 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:49.484477 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:49.485002 28729 raft_consensus.cc:3060] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:49.488940 28734 raft_consensus.cc:3060] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:49.489871 28931 tablet_bootstrap.cc:492] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:49.490244 28931 ts_tablet_manager.cc:1403] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.106s user 0.010s sys 0.008s
W20260203 09:16:49.493166 28701 leader_election.cc:343] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:49.490881 28887 raft_consensus.cc:2468] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:49.504093 28777 leader_election.cc:304] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:49.502893 29150 raft_consensus.cc:2764] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260203 09:16:49.507151 29223 raft_consensus.cc:2804] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:49.507705 29223 raft_consensus.cc:697] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:16:49.508574 29223 consensus_queue.cc:237] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.513969 28729 raft_consensus.cc:2468] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:49.496526 28701 leader_election.cc:304] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:49.520020 28932 tablet_bootstrap.cc:654] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:49.519546 28989 raft_consensus.cc:2749] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:49.526294 28933 tablet_bootstrap.cc:492] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:49.526871 28933 ts_tablet_manager.cc:1403] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.069s user 0.016s sys 0.018s
I20260203 09:16:49.529579 28933 raft_consensus.cc:359] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.535334 28933 raft_consensus.cc:385] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:49.537819 28933 raft_consensus.cc:740] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:49.538614 28933 consensus_queue.cc:260] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.542726 28933 ts_tablet_manager.cc:1434] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.016s user 0.005s sys 0.000s
I20260203 09:16:49.530241 28931 raft_consensus.cc:359] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.545815 28931 raft_consensus.cc:385] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:49.546172 28931 raft_consensus.cc:740] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:49.534533 28631 catalog_manager.cc:5654] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:49.546864 28931 consensus_queue.cc:260] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.549944 28931 ts_tablet_manager.cc:1434] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.059s user 0.004s sys 0.004s
I20260203 09:16:49.552002 28931 tablet_bootstrap.cc:492] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:49.561568 28933 tablet_bootstrap.cc:492] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:49.565316 28635 catalog_manager.cc:5654] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 0 to 1, leader changed from <none> to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:49.574191 28931 tablet_bootstrap.cc:654] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:49.574455 28932 tablet_bootstrap.cc:492] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:49.574918 28932 ts_tablet_manager.cc:1403] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.143s user 0.018s sys 0.011s
I20260203 09:16:49.576162 28933 tablet_bootstrap.cc:654] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:49.577756 28932 raft_consensus.cc:359] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.578456 28932 raft_consensus.cc:385] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:49.578717 28932 raft_consensus.cc:740] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:49.579522 28932 consensus_queue.cc:260] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.582984 28731 raft_consensus.cc:1275] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:49.584811 29197 consensus_queue.cc:1048] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:49.588513 28932 ts_tablet_manager.cc:1434] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.013s user 0.005s sys 0.001s
I20260203 09:16:49.589524 28932 tablet_bootstrap.cc:492] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:49.598104 28933 tablet_bootstrap.cc:492] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:49.598897 28933 ts_tablet_manager.cc:1403] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.038s user 0.009s sys 0.010s
I20260203 09:16:49.601683 28933 raft_consensus.cc:359] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.602434 28933 raft_consensus.cc:385] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:49.602710 28933 raft_consensus.cc:740] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:49.603358 28933 consensus_queue.cc:260] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.606887 28931 tablet_bootstrap.cc:492] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:49.607407 28932 tablet_bootstrap.cc:654] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:49.609030 28933 ts_tablet_manager.cc:1434] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.010s user 0.005s sys 0.002s
I20260203 09:16:49.607376 28931 ts_tablet_manager.cc:1403] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.056s user 0.011s sys 0.019s
I20260203 09:16:49.611961 28931 raft_consensus.cc:359] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.612672 28931 raft_consensus.cc:385] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:49.612947 28931 raft_consensus.cc:740] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:49.613058 29150 raft_consensus.cc:493] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:49.613505 29150 raft_consensus.cc:515] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.613610 28931 consensus_queue.cc:260] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.615772 28933 tablet_bootstrap.cc:492] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:49.620024 28931 ts_tablet_manager.cc:1434] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.010s user 0.005s sys 0.001s
I20260203 09:16:49.621065 28931 tablet_bootstrap.cc:492] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:49.615691 29150 leader_election.cc:290] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:49.622733 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:49.644352 28809 raft_consensus.cc:2468] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:49.645526 28851 leader_election.cc:304] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:49.646344 29197 raft_consensus.cc:2804] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:49.646808 29197 raft_consensus.cc:493] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:49.647169 29197 raft_consensus.cc:3060] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:49.652982 28931 tablet_bootstrap.cc:654] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:49.653625 28933 tablet_bootstrap.cc:654] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:49.666639 28989 raft_consensus.cc:493] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:49.667210 28989 raft_consensus.cc:515] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.669133 28989 leader_election.cc:290] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:49.670572 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:49.672317 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:49.678013 28730 raft_consensus.cc:3060] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:49.680110 28700 leader_election.cc:304] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:49.652769 28734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:16:49.693432 28852 leader_election.cc:343] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:49.703147 28932 tablet_bootstrap.cc:492] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:49.703630 28932 ts_tablet_manager.cc:1403] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.114s user 0.021s sys 0.033s
I20260203 09:16:49.718411 28932 raft_consensus.cc:359] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.719168 28932 raft_consensus.cc:385] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:49.719460 28932 raft_consensus.cc:740] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:49.720084 28932 consensus_queue.cc:260] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.722035 28933 tablet_bootstrap.cc:492] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:49.722625 28933 ts_tablet_manager.cc:1403] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.107s user 0.012s sys 0.012s
I20260203 09:16:49.704473 29197 raft_consensus.cc:515] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.728165 28931 tablet_bootstrap.cc:492] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:49.728317 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:49.728765 28931 ts_tablet_manager.cc:1403] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.108s user 0.017s sys 0.013s
I20260203 09:16:49.728938 28809 raft_consensus.cc:3060] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:49.733095 28734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
W20260203 09:16:49.736538 28852 leader_election.cc:343] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:49.734769 29197 leader_election.cc:290] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:49.740485 28932 ts_tablet_manager.cc:1434] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.037s user 0.008s sys 0.000s
I20260203 09:16:49.740957 28933 raft_consensus.cc:359] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.741757 28933 raft_consensus.cc:385] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:49.742098 28933 raft_consensus.cc:740] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:49.741505 28932 tablet_bootstrap.cc:492] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:49.742842 28933 consensus_queue.cc:260] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.744773 28808 raft_consensus.cc:1275] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:49.745222 28933 ts_tablet_manager.cc:1434] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.022s user 0.008s sys 0.004s
I20260203 09:16:49.746192 28933 tablet_bootstrap.cc:492] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:49.748637 28988 consensus_queue.cc:1048] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:49.762910 28931 raft_consensus.cc:359] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.763468 28931 raft_consensus.cc:385] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:49.763731 28931 raft_consensus.cc:740] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:49.757112 28809 raft_consensus.cc:2468] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:49.764330 28931 consensus_queue.cc:260] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.769685 28931 ts_tablet_manager.cc:1434] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.041s user 0.005s sys 0.001s
I20260203 09:16:49.770627 28931 tablet_bootstrap.cc:492] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:49.773052 28933 tablet_bootstrap.cc:654] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:49.775055 28851 leader_election.cc:304] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:49.785326 28988 raft_consensus.cc:2804] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:49.788671 28988 raft_consensus.cc:697] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:49.792018 28988 consensus_queue.cc:237] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.795974 28932 tablet_bootstrap.cc:654] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:49.799998 28931 tablet_bootstrap.cc:654] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:49.800117 29196 consensus_queue.cc:1048] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:49.805155 28989 raft_consensus.cc:2749] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:49.802294 29226 raft_consensus.cc:493] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:49.816100 28933 tablet_bootstrap.cc:492] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:49.816706 28933 ts_tablet_manager.cc:1403] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.071s user 0.006s sys 0.011s
I20260203 09:16:49.821547 28932 tablet_bootstrap.cc:492] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:49.822117 28932 ts_tablet_manager.cc:1403] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.081s user 0.012s sys 0.000s
I20260203 09:16:49.820039 28933 raft_consensus.cc:359] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.824425 28933 raft_consensus.cc:385] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:49.824932 28933 raft_consensus.cc:740] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:49.831661 28933 consensus_queue.cc:260] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.834573 28933 ts_tablet_manager.cc:1434] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.018s user 0.004s sys 0.002s
I20260203 09:16:49.836086 28933 tablet_bootstrap.cc:492] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:49.824975 29226 raft_consensus.cc:515] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.850924 29226 leader_election.cc:290] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:49.853570 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:49.855973 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:49.857589 28777 leader_election.cc:304] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:49.858332 29223 raft_consensus.cc:2749] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:49.857874 28932 raft_consensus.cc:359] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.858981 28932 raft_consensus.cc:385] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:49.859282 28932 raft_consensus.cc:740] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:49.858726 28635 catalog_manager.cc:5654] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:49.860146 28932 consensus_queue.cc:260] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.861009 28989 raft_consensus.cc:493] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:49.861614 28989 raft_consensus.cc:515] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.864727 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:16:49.866290 28701 leader_election.cc:343] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:49.870456 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:49.872197 28989 leader_election.cc:290] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:16:49.872548 28700 leader_election.cc:343] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:49.873047 28700 leader_election.cc:304] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:49.874300 28984 raft_consensus.cc:2749] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:49.880432 28932 ts_tablet_manager.cc:1434] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.057s user 0.015s sys 0.001s
I20260203 09:16:49.882006 28932 tablet_bootstrap.cc:492] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:49.890880 28933 tablet_bootstrap.cc:654] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:49.891484 28931 tablet_bootstrap.cc:492] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:49.891943 28931 ts_tablet_manager.cc:1403] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.122s user 0.005s sys 0.006s
I20260203 09:16:49.893697 28932 tablet_bootstrap.cc:654] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:49.895022 28931 raft_consensus.cc:359] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.895566 28931 raft_consensus.cc:385] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:49.895776 28931 raft_consensus.cc:740] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:49.896577 28931 consensus_queue.cc:260] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.900521 28931 ts_tablet_manager.cc:1434] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.008s user 0.006s sys 0.002s
I20260203 09:16:49.901763 28931 tablet_bootstrap.cc:492] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:49.921922 29141 raft_consensus.cc:493] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:49.922457 29141 raft_consensus.cc:515] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.924324 29141 leader_election.cc:290] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:49.928465 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b2c469d7255413d9f61a7cbaa4481a7" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:49.928687 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b2c469d7255413d9f61a7cbaa4481a7" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:49.929195 28887 raft_consensus.cc:2468] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
I20260203 09:16:49.929347 28729 raft_consensus.cc:2468] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
I20260203 09:16:49.931674 28777 leader_election.cc:304] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:49.932448 29141 raft_consensus.cc:2804] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:49.932925 29141 raft_consensus.cc:493] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:49.933512 29141 raft_consensus.cc:3060] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:49.946942 29177 raft_consensus.cc:493] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:49.947485 29177 raft_consensus.cc:515] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.948289 28933 tablet_bootstrap.cc:492] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:49.951184 29226 consensus_queue.cc:1048] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:49.952024 28933 ts_tablet_manager.cc:1403] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.116s user 0.017s sys 0.007s
I20260203 09:16:49.949433 29177 leader_election.cc:290] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:49.952133 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:49.951098 29141 raft_consensus.cc:515] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:16:49.954030 28777 leader_election.cc:343] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:49.947495 28811 raft_consensus.cc:3060] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:49.955699 28734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:49.961373 28734 raft_consensus.cc:2468] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
I20260203 09:16:49.957729 29223 raft_consensus.cc:493] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:49.959983 28933 raft_consensus.cc:359] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.962859 29223 raft_consensus.cc:515] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.963367 28777 leader_election.cc:304] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:16:49.964506 29177 raft_consensus.cc:2804] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:49.964900 29177 raft_consensus.cc:493] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:49.965200 29177 raft_consensus.cc:3060] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:49.962899 28933 raft_consensus.cc:385] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:49.967308 28933 raft_consensus.cc:740] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:49.969175 28933 consensus_queue.cc:260] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:49.963423 28931 tablet_bootstrap.cc:654] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:49.974802 28933 ts_tablet_manager.cc:1434] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.022s user 0.006s sys 0.000s
I20260203 09:16:49.975584 28933 tablet_bootstrap.cc:492] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:49.978039 29223 leader_election.cc:290] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:49.978902 28734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:49.980792 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:49.983811 28932 tablet_bootstrap.cc:492] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
W20260203 09:16:49.980307 28777 leader_election.cc:343] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:49.984338 28932 ts_tablet_manager.cc:1403] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.103s user 0.010s sys 0.012s
W20260203 09:16:49.986776 28777 leader_election.cc:343] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:49.987450 28777 leader_election.cc:304] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:49.989884 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b2c469d7255413d9f61a7cbaa4481a7" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:49.990144 29223 raft_consensus.cc:2749] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:49.990507 28885 raft_consensus.cc:3060] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:49.991475 28734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b2c469d7255413d9f61a7cbaa4481a7" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:49.992113 28734 raft_consensus.cc:3060] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:49.985512 29141 leader_election.cc:290] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:49.995893 29177 raft_consensus.cc:515] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.006079 28932 raft_consensus.cc:359] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.006878 28932 raft_consensus.cc:385] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:50.007131 28932 raft_consensus.cc:740] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:50.007741 28932 consensus_queue.cc:260] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.008100 28734 raft_consensus.cc:2468] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:50.010682 28932 ts_tablet_manager.cc:1434] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.023s user 0.004s sys 0.001s
I20260203 09:16:50.012984 28777 leader_election.cc:304] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:50.012606 29035 consensus_queue.cc:1048] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260203 09:16:50.025882 28932 tablet_bootstrap.cc:492] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:50.017177 29141 raft_consensus.cc:2804] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:50.028432 29177 leader_election.cc:290] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:50.028296 28734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:50.029577 28734 raft_consensus.cc:3060] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:50.029511 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:50.031212 28886 raft_consensus.cc:3060] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:50.034385 28931 tablet_bootstrap.cc:492] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:50.034847 28931 ts_tablet_manager.cc:1403] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.133s user 0.012s sys 0.016s
I20260203 09:16:50.032049 29141 raft_consensus.cc:697] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:16:50.044711 29226 consensus_queue.cc:1048] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:50.041564 29141 consensus_queue.cc:237] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.051995 29035 raft_consensus.cc:493] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:50.053114 29035 raft_consensus.cc:515] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.053468 28886 raft_consensus.cc:2468] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:50.025529 28885 raft_consensus.cc:2468] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:50.062943 28777 leader_election.cc:304] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:50.063714 29223 raft_consensus.cc:2804] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:50.064184 29223 raft_consensus.cc:697] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:16:50.065043 29223 consensus_queue.cc:237] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.066020 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:50.083861 28730 raft_consensus.cc:2468] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:50.085763 28852 leader_election.cc:304] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:50.087301 29196 raft_consensus.cc:2804] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:50.087683 29196 raft_consensus.cc:493] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:50.087985 29196 raft_consensus.cc:3060] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:50.089934 28734 raft_consensus.cc:2468] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:50.092871 28932 tablet_bootstrap.cc:654] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:50.099323 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:50.100080 28808 raft_consensus.cc:2468] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:50.102978 29035 leader_election.cc:290] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:50.103652 28989 raft_consensus.cc:493] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:50.104113 28989 raft_consensus.cc:515] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.112067 28933 tablet_bootstrap.cc:654] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:50.128435 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:50.124809 28984 raft_consensus.cc:493] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:50.124768 28989 leader_election.cc:290] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:16:50.130805 28700 leader_election.cc:343] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:50.133141 28984 raft_consensus.cc:515] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.135470 28984 leader_election.cc:290] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:50.136802 28635 catalog_manager.cc:5654] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 0 to 1, leader changed from <none> to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:50.137538 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:50.139519 28808 raft_consensus.cc:2393] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 1: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:16:50.139617 28635 catalog_manager.cc:5654] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 0 to 1, leader changed from <none> to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:50.147439 28931 raft_consensus.cc:359] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.148159 28931 raft_consensus.cc:385] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:50.148414 28931 raft_consensus.cc:740] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:50.149138 28931 consensus_queue.cc:260] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.160434 28931 ts_tablet_manager.cc:1434] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.125s user 0.006s sys 0.002s
I20260203 09:16:50.161938 28931 tablet_bootstrap.cc:492] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:50.165237 29196 raft_consensus.cc:515] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.168121 28933 tablet_bootstrap.cc:492] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:50.189047 29196 leader_election.cc:290] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:50.192778 28933 ts_tablet_manager.cc:1403] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.217s user 0.013s sys 0.004s
I20260203 09:16:50.205094 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:50.206018 28811 raft_consensus.cc:3060] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:50.208004 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:50.208724 28729 raft_consensus.cc:3060] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:50.216425 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:50.216197 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:50.217969 28701 leader_election.cc:304] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:50.219506 28984 raft_consensus.cc:3060] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:50.233112 28984 raft_consensus.cc:2749] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:50.236543 28933 raft_consensus.cc:359] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.239832 28933 raft_consensus.cc:385] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:50.240183 28933 raft_consensus.cc:740] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:50.239392 28811 raft_consensus.cc:2468] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:50.238448 28931 tablet_bootstrap.cc:654] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:50.241489 28851 leader_election.cc:304] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:50.241883 28933 consensus_queue.cc:260] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:16:50.244089 28701 leader_election.cc:343] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:50.244427 28701 leader_election.cc:304] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:50.248939 29256 raft_consensus.cc:2804] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:50.253723 28937 raft_consensus.cc:2749] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:50.254379 28729 raft_consensus.cc:2468] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:50.256251 29256 raft_consensus.cc:697] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:50.257750 29256 consensus_queue.cc:237] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.262049 28932 tablet_bootstrap.cc:492] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:50.262549 28932 ts_tablet_manager.cc:1403] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.237s user 0.010s sys 0.021s
I20260203 09:16:50.267313 28932 raft_consensus.cc:359] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.267918 28932 raft_consensus.cc:385] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:50.268141 28932 raft_consensus.cc:740] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:50.268754 28932 consensus_queue.cc:260] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.270359 28932 ts_tablet_manager.cc:1434] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.008s user 0.005s sys 0.001s
I20260203 09:16:50.271087 28932 tablet_bootstrap.cc:492] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:50.273396 28933 ts_tablet_manager.cc:1434] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.080s user 0.006s sys 0.001s
I20260203 09:16:50.278544 28932 tablet_bootstrap.cc:654] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:50.286763 28931 tablet_bootstrap.cc:492] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:50.287240 28931 ts_tablet_manager.cc:1403] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.126s user 0.012s sys 0.001s
I20260203 09:16:50.288122 28635 catalog_manager.cc:5654] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:50.292790 28931 raft_consensus.cc:359] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.293653 28931 raft_consensus.cc:385] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:50.293929 28931 raft_consensus.cc:740] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:50.295370 28931 consensus_queue.cc:260] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.303589 28931 ts_tablet_manager.cc:1434] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20260203 09:16:50.304618 28931 tablet_bootstrap.cc:492] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:50.308005 28932 tablet_bootstrap.cc:492] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:50.308511 28932 ts_tablet_manager.cc:1403] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.038s user 0.008s sys 0.004s
I20260203 09:16:50.309306 28933 tablet_bootstrap.cc:492] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:50.311184 28932 raft_consensus.cc:359] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.311908 28932 raft_consensus.cc:385] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:50.312170 28932 raft_consensus.cc:740] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:50.314743 28932 consensus_queue.cc:260] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.320731 28931 tablet_bootstrap.cc:654] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:50.321676 28932 ts_tablet_manager.cc:1434] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.013s user 0.004s sys 0.002s
I20260203 09:16:50.322700 28932 tablet_bootstrap.cc:492] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:50.327507 29035 consensus_queue.cc:1048] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:50.330447 28932 tablet_bootstrap.cc:654] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:50.352228 28933 tablet_bootstrap.cc:654] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:50.362233 28931 tablet_bootstrap.cc:492] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:50.362728 28931 ts_tablet_manager.cc:1403] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.058s user 0.009s sys 0.015s
I20260203 09:16:50.370323 28931 raft_consensus.cc:359] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.371088 28931 raft_consensus.cc:385] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:50.371343 28931 raft_consensus.cc:740] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:50.372004 28931 consensus_queue.cc:260] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.374509 28931 ts_tablet_manager.cc:1434] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.012s user 0.004s sys 0.004s
I20260203 09:16:50.375573 28931 tablet_bootstrap.cc:492] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:50.376711 29256 consensus_queue.cc:1048] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:50.394510 28932 tablet_bootstrap.cc:492] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:50.395134 28932 ts_tablet_manager.cc:1403] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.073s user 0.008s sys 0.007s
I20260203 09:16:50.403777 28932 raft_consensus.cc:359] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.406790 28932 raft_consensus.cc:385] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:50.407059 28932 raft_consensus.cc:740] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:50.410197 28932 consensus_queue.cc:260] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.417346 28932 ts_tablet_manager.cc:1434] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.022s user 0.007s sys 0.001s
I20260203 09:16:50.419382 28933 tablet_bootstrap.cc:492] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:50.420730 28932 tablet_bootstrap.cc:492] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:50.423923 28933 ts_tablet_manager.cc:1403] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.126s user 0.011s sys 0.005s
I20260203 09:16:50.430003 28931 tablet_bootstrap.cc:654] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:50.431236 29035 raft_consensus.cc:493] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:50.431855 29035 raft_consensus.cc:515] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.432837 28984 raft_consensus.cc:493] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:50.433247 29141 raft_consensus.cc:493] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:50.433786 29035 leader_election.cc:290] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:50.433322 28984 raft_consensus.cc:515] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.434409 28933 raft_consensus.cc:359] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.433805 29141 raft_consensus.cc:515] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.437131 29141 leader_election.cc:290] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:50.437304 28932 tablet_bootstrap.cc:654] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:50.435084 28933 raft_consensus.cc:385] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:50.438472 28933 raft_consensus.cc:740] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:50.439195 28933 consensus_queue.cc:260] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.441859 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:50.444554 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:50.445569 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:16:50.446511 28777 leader_election.cc:343] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:50.443342 28805 raft_consensus.cc:2468] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
W20260203 09:16:50.450654 28852 leader_election.cc:343] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:50.451411 28734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:50.454579 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:50.455291 28811 raft_consensus.cc:2468] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 0.
I20260203 09:16:50.469190 28984 leader_election.cc:290] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:50.539829 29188 raft_consensus.cc:493] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:50.540479 29188 raft_consensus.cc:515] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:16:50.781793 28777 leader_election.cc:343] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:50.783857 28777 leader_election.cc:304] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:50.830771 28933 ts_tablet_manager.cc:1434] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.406s user 0.018s sys 0.016s
I20260203 09:16:50.895722 28931 tablet_bootstrap.cc:492] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:50.898119 28984 raft_consensus.cc:493] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:50.905390 29188 leader_election.cc:290] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:50.907577 28851 leader_election.cc:304] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:50.909866 28933 tablet_bootstrap.cc:492] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:50.948338 29226 raft_consensus.cc:2749] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:50.949251 29226 raft_consensus.cc:493] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:50.949972 29226 raft_consensus.cc:515] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.956581 28984 raft_consensus.cc:515] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.959503 28984 leader_election.cc:290] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:16:50.962687 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 497451us
I20260203 09:16:50.963469 29188 raft_consensus.cc:2804] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:50.964022 29188 raft_consensus.cc:493] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:50.964391 29188 raft_consensus.cc:3060] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:50.974723 28700 leader_election.cc:304] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:50.975592 28931 ts_tablet_manager.cc:1403] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.600s user 0.027s sys 0.007s
W20260203 09:16:50.975963 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 503762us
I20260203 09:16:50.986876 29276 raft_consensus.cc:493] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:50.987813 29276 raft_consensus.cc:515] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:50.995352 29276 leader_election.cc:290] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:50.992699 29226 leader_election.cc:290] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:51.003999 29278 raft_consensus.cc:493] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:51.005910 29278 raft_consensus.cc:515] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.009130 28988 raft_consensus.cc:493] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:51.010048 28988 raft_consensus.cc:515] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.008195 29278 leader_election.cc:290] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:51.013574 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:51.014607 28730 raft_consensus.cc:2468] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:51.020771 28988 leader_election.cc:290] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:51.021342 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:51.022169 28883 raft_consensus.cc:2468] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 0.
I20260203 09:16:51.003485 28984 raft_consensus.cc:2804] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260203 09:16:51.055146 28683 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:16:51.055377 28984 raft_consensus.cc:493] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:51.056258 28984 raft_consensus.cc:3060] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:51.029907 28933 tablet_bootstrap.cc:654] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
W20260203 09:16:51.033716 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 507301us
I20260203 09:16:51.040884 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:51.046160 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:51.047401 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:51.054028 28931 raft_consensus.cc:359] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.059947 28806 raft_consensus.cc:2468] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 0.
I20260203 09:16:51.060303 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:51.061913 28883 raft_consensus.cc:2468] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 0.
I20260203 09:16:51.071835 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:51.072788 28729 raft_consensus.cc:2468] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
I20260203 09:16:51.058939 28931 raft_consensus.cc:385] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:51.075814 28931 raft_consensus.cc:740] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:51.078649 29188 raft_consensus.cc:515] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.081763 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:51.084120 28887 raft_consensus.cc:2468] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
I20260203 09:16:51.090116 28932 tablet_bootstrap.cc:492] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:51.091100 28932 ts_tablet_manager.cc:1403] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.671s user 0.035s sys 0.033s
I20260203 09:16:51.085672 28931 consensus_queue.cc:260] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.093318 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:51.094383 28736 raft_consensus.cc:2468] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
I20260203 09:16:51.095541 28932 raft_consensus.cc:359] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.097276 29188 leader_election.cc:290] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:51.096433 28932 raft_consensus.cc:385] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:51.098278 28932 raft_consensus.cc:740] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:51.100867 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:51.106725 28932 consensus_queue.cc:260] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.113829 28932 ts_tablet_manager.cc:1434] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.022s user 0.007s sys 0.002s
W20260203 09:16:51.124815 28701 leader_election.cc:343] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:51.126780 28931 ts_tablet_manager.cc:1434] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.151s user 0.005s sys 0.006s
I20260203 09:16:51.128885 28701 leader_election.cc:304] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:51.132957 28932 tablet_bootstrap.cc:492] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:51.133208 29275 raft_consensus.cc:2804] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:51.133769 29275 raft_consensus.cc:493] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:51.134159 29275 raft_consensus.cc:3060] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:51.160383 28933 tablet_bootstrap.cc:492] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:51.161087 28933 ts_tablet_manager.cc:1403] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.252s user 0.017s sys 0.011s
I20260203 09:16:51.162652 28931 tablet_bootstrap.cc:492] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
W20260203 09:16:51.163369 28700 leader_election.cc:343] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:51.163870 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:51.166282 28700 leader_election.cc:304] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:51.166507 28806 raft_consensus.cc:2468] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:51.164520 28933 raft_consensus.cc:359] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.168594 29286 raft_consensus.cc:2749] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:51.167654 28933 raft_consensus.cc:385] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:51.170054 28933 raft_consensus.cc:740] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:51.170765 28933 consensus_queue.cc:260] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.174861 28932 tablet_bootstrap.cc:654] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:51.176606 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:51.184846 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:51.185708 28730 raft_consensus.cc:3060] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:51.192396 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:51.193451 28807 raft_consensus.cc:3060] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:51.193573 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:51.194347 28805 raft_consensus.cc:2468] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:51.195093 28933 ts_tablet_manager.cc:1434] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.034s user 0.004s sys 0.002s
I20260203 09:16:51.181558 29275 raft_consensus.cc:515] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.199391 29275 leader_election.cc:290] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:51.200830 28933 tablet_bootstrap.cc:492] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:51.200559 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:51.201426 28887 raft_consensus.cc:3060] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:51.213929 28984 raft_consensus.cc:515] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.215556 28729 raft_consensus.cc:2393] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 1: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:16:51.219007 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:51.219867 28805 raft_consensus.cc:3060] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:51.218953 28887 raft_consensus.cc:2468] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:16:51.231956 28852 leader_election.cc:304] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:51.232568 28701 leader_election.cc:304] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:51.233206 29256 raft_consensus.cc:2764] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260203 09:16:51.233688 29275 raft_consensus.cc:2804] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:51.234068 28805 raft_consensus.cc:2468] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:16:51.234241 29275 raft_consensus.cc:697] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:16:51.235167 29275 consensus_queue.cc:237] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.242205 28730 raft_consensus.cc:2468] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:51.242075 28807 raft_consensus.cc:2468] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:51.246151 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:51.246882 28806 raft_consensus.cc:3060] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:51.249189 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:51.252630 28883 raft_consensus.cc:3060] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:51.248271 28984 leader_election.cc:290] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:51.275278 28851 leader_election.cc:304] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:51.280079 28777 leader_election.cc:304] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:51.268175 29197 consensus_queue.cc:1048] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260203 09:16:51.282194 29291 raft_consensus.cc:2764] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260203 09:16:51.263577 28883 raft_consensus.cc:2468] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:16:51.285004 29282 consensus_queue.cc:1048] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:51.287315 28806 raft_consensus.cc:2468] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:16:51.287563 28777 leader_election.cc:304] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:51.285012 29035 raft_consensus.cc:2764] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260203 09:16:51.288604 28700 leader_election.cc:304] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:51.289187 29291 consensus_queue.cc:1048] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:51.290230 28933 tablet_bootstrap.cc:654] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:51.293097 29286 raft_consensus.cc:2804] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:51.294525 29272 consensus_queue.cc:1048] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260203 09:16:51.295272 29286 raft_consensus.cc:697] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:16:51.296133 29286 consensus_queue.cc:237] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.288367 29141 raft_consensus.cc:2804] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:51.300213 29141 raft_consensus.cc:493] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:51.300588 29141 raft_consensus.cc:3060] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:51.315073 28852 leader_election.cc:304] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:51.316984 29256 raft_consensus.cc:2804] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:51.318907 29256 raft_consensus.cc:697] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:51.324415 29256 consensus_queue.cc:237] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.325174 29141 raft_consensus.cc:515] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.327317 29141 leader_election.cc:290] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:51.328140 28931 tablet_bootstrap.cc:654] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:51.329412 28932 tablet_bootstrap.cc:492] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:51.330017 28932 ts_tablet_manager.cc:1403] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.197s user 0.015s sys 0.007s
I20260203 09:16:51.328971 29291 consensus_queue.cc:1048] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260203 09:16:51.338057 28777 leader_election.cc:343] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:51.340080 29291 consensus_queue.cc:1048] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:51.340199 28932 raft_consensus.cc:359] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.340989 28932 raft_consensus.cc:385] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:51.341284 28932 raft_consensus.cc:740] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:51.342505 28933 tablet_bootstrap.cc:492] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:51.343320 28933 ts_tablet_manager.cc:1403] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.143s user 0.013s sys 0.011s
I20260203 09:16:51.347529 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:51.348263 28736 raft_consensus.cc:3060] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:51.346802 28933 raft_consensus.cc:359] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.350704 28933 raft_consensus.cc:385] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:51.351047 28933 raft_consensus.cc:740] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:51.352414 28933 consensus_queue.cc:260] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.360922 28932 consensus_queue.cc:260] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.365298 28931 tablet_bootstrap.cc:492] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:51.365872 28931 ts_tablet_manager.cc:1403] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.203s user 0.016s sys 0.006s
I20260203 09:16:51.368009 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
W20260203 09:16:51.374639 28777 leader_election.cc:343] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:51.389361 28736 raft_consensus.cc:2468] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:51.390578 28777 leader_election.cc:304] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:16:51.392860 29272 raft_consensus.cc:2804] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:51.396008 29272 raft_consensus.cc:697] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:16:51.396943 29272 consensus_queue.cc:237] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.367097 28635 catalog_manager.cc:5654] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 0 to 1, leader changed from <none> to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:51.409718 28933 ts_tablet_manager.cc:1434] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.066s user 0.008s sys 0.000s
I20260203 09:16:51.417054 28932 ts_tablet_manager.cc:1434] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.087s user 0.009s sys 0.002s
I20260203 09:16:51.439324 28933 tablet_bootstrap.cc:492] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:51.445346 28931 raft_consensus.cc:359] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.450071 28931 raft_consensus.cc:385] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:51.450902 28931 raft_consensus.cc:740] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
W20260203 09:16:51.459632 29303 log.cc:927] Time spent T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.051s user 0.001s sys 0.000s
I20260203 09:16:51.470096 28932 tablet_bootstrap.cc:492] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:51.451979 29141 raft_consensus.cc:493] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:51.495077 28931 consensus_queue.cc:260] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:16:51.498379 29299 log.cc:927] Time spent T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.085s user 0.003s sys 0.000s
I20260203 09:16:51.515067 29035 raft_consensus.cc:493] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:51.515590 29035 raft_consensus.cc:515] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.533748 28931 ts_tablet_manager.cc:1434] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.168s user 0.009s sys 0.002s
I20260203 09:16:51.525023 29035 leader_election.cc:290] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:51.505715 29141 raft_consensus.cc:515] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.549502 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:51.550268 28933 tablet_bootstrap.cc:654] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
W20260203 09:16:51.557159 28851 leader_election.cc:343] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:51.564025 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:51.564936 28731 raft_consensus.cc:2468] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:51.567456 29141 leader_election.cc:290] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:51.581218 28931 tablet_bootstrap.cc:492] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:51.592445 28932 tablet_bootstrap.cc:654] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:51.594170 29223 raft_consensus.cc:493] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:51.594756 29223 raft_consensus.cc:515] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.599613 28931 tablet_bootstrap.cc:654] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:51.605368 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:51.606384 28737 raft_consensus.cc:2468] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
I20260203 09:16:51.609516 28852 leader_election.cc:304] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:51.610536 29273 raft_consensus.cc:2804] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:51.610934 29273 raft_consensus.cc:493] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:51.611251 29273 raft_consensus.cc:3060] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:51.630028 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:51.637415 29223 leader_election.cc:290] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:16:51.678570 28777 leader_election.cc:343] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:51.660840 29273 raft_consensus.cc:515] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.682699 29273 leader_election.cc:290] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:51.680423 28777 leader_election.cc:304] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:16:51.685925 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:51.686654 28737 raft_consensus.cc:3060] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:51.687922 28631 catalog_manager.cc:5654] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 0 to 1, leader changed from <none> to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:51.694334 29223 raft_consensus.cc:2804] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:51.694708 28737 raft_consensus.cc:2468] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:51.694867 29223 raft_consensus.cc:493] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:51.695410 29223 raft_consensus.cc:3060] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:51.700031 28852 leader_election.cc:304] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:51.701040 29281 raft_consensus.cc:2804] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:51.701545 29281 raft_consensus.cc:697] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:51.702371 29281 consensus_queue.cc:237] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.703356 29223 raft_consensus.cc:515] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.710875 28932 tablet_bootstrap.cc:492] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:51.711549 28932 ts_tablet_manager.cc:1403] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.246s user 0.022s sys 0.027s
I20260203 09:16:51.714289 28932 raft_consensus.cc:359] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.715212 28932 raft_consensus.cc:385] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:51.715705 28932 raft_consensus.cc:740] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:51.716866 29275 consensus_queue.cc:1048] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:51.717020 28932 consensus_queue.cc:260] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.718305 28933 tablet_bootstrap.cc:492] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:51.718851 28933 ts_tablet_manager.cc:1403] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.295s user 0.025s sys 0.023s
I20260203 09:16:51.720111 28932 ts_tablet_manager.cc:1434] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260203 09:16:51.722388 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:51.714870 29223 leader_election.cc:290] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:51.724303 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:51.723392 29277 consensus_queue.cc:1048] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:51.724105 28932 tablet_bootstrap.cc:492] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:51.733179 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:51.733263 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:51.733932 28737 raft_consensus.cc:3060] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:51.736735 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
W20260203 09:16:51.735872 28777 leader_election.cc:343] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:51.737686 29281 raft_consensus.cc:493] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:16:51.744565 28777 leader_election.cc:343] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:51.742344 28932 tablet_bootstrap.cc:654] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:51.745321 29277 consensus_queue.cc:1048] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260203 09:16:51.745136 29281 raft_consensus.cc:515] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.751118 28931 tablet_bootstrap.cc:492] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:51.751701 28931 ts_tablet_manager.cc:1403] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.171s user 0.013s sys 0.004s
I20260203 09:16:51.751274 28933 raft_consensus.cc:359] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.752101 28933 raft_consensus.cc:385] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260203 09:16:51.753227 28777 leader_election.cc:343] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:51.754740 28777 leader_election.cc:304] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:16:51.755954 28851 leader_election.cc:343] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:51.756034 29223 raft_consensus.cc:2749] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:51.752449 28933 raft_consensus.cc:740] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:51.745271 28737 raft_consensus.cc:2468] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:51.764525 29281 leader_election.cc:290] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:51.767273 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:16:51.771044 28852 leader_election.cc:343] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:51.767134 28633 catalog_manager.cc:5654] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:51.777562 28777 leader_election.cc:304] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:16:51.776829 28933 consensus_queue.cc:260] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.781209 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:16:51.782626 28851 leader_election.cc:343] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:51.783025 28851 leader_election.cc:304] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:51.783511 29279 raft_consensus.cc:2804] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:51.784011 29279 raft_consensus.cc:697] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:16:51.784780 28933 ts_tablet_manager.cc:1434] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.066s user 0.007s sys 0.001s
I20260203 09:16:51.785760 29273 raft_consensus.cc:2749] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:51.786142 29279 consensus_queue.cc:237] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.786034 28933 tablet_bootstrap.cc:492] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:51.801379 28931 raft_consensus.cc:359] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.802350 28931 raft_consensus.cc:385] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:51.802865 28931 raft_consensus.cc:740] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:51.803821 28931 consensus_queue.cc:260] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.813418 29279 raft_consensus.cc:493] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:51.814144 29279 raft_consensus.cc:515] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.817804 29279 leader_election.cc:290] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:51.825071 28931 ts_tablet_manager.cc:1434] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.073s user 0.010s sys 0.001s
I20260203 09:16:51.836131 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:51.841279 29223 consensus_queue.cc:1048] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:51.842257 29196 raft_consensus.cc:493] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:51.842762 29196 raft_consensus.cc:515] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.855520 28931 tablet_bootstrap.cc:492] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:51.856139 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:51.849364 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:51.857065 28729 raft_consensus.cc:2393] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 1: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:16:51.860736 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:51.841084 28737 raft_consensus.cc:2468] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
I20260203 09:16:51.862990 28851 leader_election.cc:304] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:16:51.862839 28777 leader_election.cc:343] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:51.863122 28633 catalog_manager.cc:5654] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } }
I20260203 09:16:51.867703 29271 raft_consensus.cc:3060] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:51.868242 28932 tablet_bootstrap.cc:492] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:51.867086 28777 leader_election.cc:304] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:16:51.868966 28932 ts_tablet_manager.cc:1403] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.146s user 0.013s sys 0.018s
I20260203 09:16:51.854929 29196 leader_election.cc:290] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:51.870362 29279 raft_consensus.cc:2804] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:51.872730 29279 raft_consensus.cc:493] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:51.873080 29279 raft_consensus.cc:3060] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:51.892010 29286 consensus_queue.cc:1048] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:51.904939 29273 consensus_queue.cc:1048] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260203 09:16:51.920087 28932 raft_consensus.cc:359] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.920912 28932 raft_consensus.cc:385] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:51.921185 28932 raft_consensus.cc:740] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:51.921854 28932 consensus_queue.cc:260] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.927654 29271 raft_consensus.cc:2749] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:51.929360 28933 tablet_bootstrap.cc:654] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:51.938400 28635 catalog_manager.cc:5654] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:51.947888 29035 raft_consensus.cc:493] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:51.948411 29035 raft_consensus.cc:515] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.951037 29035 leader_election.cc:290] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:51.954277 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:51.955006 28737 raft_consensus.cc:2468] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:51.958328 28932 ts_tablet_manager.cc:1434] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.089s user 0.009s sys 0.002s
I20260203 09:16:51.958477 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:51.959136 28805 raft_consensus.cc:2468] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:51.959792 28932 tablet_bootstrap.cc:492] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:51.961735 28851 leader_election.cc:304] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:51.966920 29035 consensus_queue.cc:1048] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:51.962659 29281 raft_consensus.cc:2804] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:51.967732 29281 raft_consensus.cc:493] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:51.968093 29281 raft_consensus.cc:3060] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:51.973274 29279 raft_consensus.cc:515] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:51.976544 28931 tablet_bootstrap.cc:654] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:51.977522 29223 consensus_queue.cc:1048] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:52.007032 28635 catalog_manager.cc:5654] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 0 to 1, leader changed from <none> to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:52.022606 28932 tablet_bootstrap.cc:654] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:52.023063 29279 leader_election.cc:290] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:52.014344 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:52.032088 28730 raft_consensus.cc:3060] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:52.049165 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
W20260203 09:16:52.073868 28777 leader_election.cc:343] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:52.100193 28730 raft_consensus.cc:2468] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:52.117743 28777 leader_election.cc:304] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:16:52.118664 29279 raft_consensus.cc:2804] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:52.119184 29279 raft_consensus.cc:697] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:16:52.120040 29279 consensus_queue.cc:237] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.122473 28933 tablet_bootstrap.cc:492] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:52.123246 28933 ts_tablet_manager.cc:1403] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.337s user 0.027s sys 0.048s
I20260203 09:16:52.145351 28931 tablet_bootstrap.cc:492] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:52.145941 28931 ts_tablet_manager.cc:1403] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.296s user 0.025s sys 0.027s
I20260203 09:16:52.105659 29281 raft_consensus.cc:515] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.151391 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:52.152088 28730 raft_consensus.cc:3060] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:52.149364 28931 raft_consensus.cc:359] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.153683 28931 raft_consensus.cc:385] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:52.153977 28931 raft_consensus.cc:740] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:52.154656 28931 consensus_queue.cc:260] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.149439 29281 leader_election.cc:290] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:52.168622 28933 raft_consensus.cc:359] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.169459 28933 raft_consensus.cc:385] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:52.169744 28933 raft_consensus.cc:740] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:52.173980 28933 consensus_queue.cc:260] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.179198 28933 ts_tablet_manager.cc:1434] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.056s user 0.007s sys 0.000s
I20260203 09:16:52.191207 28933 tablet_bootstrap.cc:492] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:52.174176 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:52.191982 28932 tablet_bootstrap.cc:492] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:52.193300 28932 ts_tablet_manager.cc:1403] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.234s user 0.008s sys 0.009s
I20260203 09:16:52.195964 28810 raft_consensus.cc:3060] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:52.199074 28931 ts_tablet_manager.cc:1434] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.053s user 0.008s sys 0.001s
I20260203 09:16:52.208087 28931 tablet_bootstrap.cc:492] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:52.224318 29291 consensus_queue.cc:1048] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:52.231490 28810 raft_consensus.cc:2468] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:52.235754 28851 leader_election.cc:304] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:52.237179 29196 raft_consensus.cc:2804] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:52.219383 28932 raft_consensus.cc:359] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.239567 28932 raft_consensus.cc:385] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:52.239998 28932 raft_consensus.cc:740] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:52.237706 29196 raft_consensus.cc:697] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:52.242631 28932 consensus_queue.cc:260] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.264775 29196 consensus_queue.cc:237] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.266841 28730 raft_consensus.cc:2468] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:52.268206 28932 ts_tablet_manager.cc:1434] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.075s user 0.005s sys 0.003s
I20260203 09:16:52.268383 28933 tablet_bootstrap.cc:654] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:52.277614 28932 tablet_bootstrap.cc:492] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:52.279628 28988 raft_consensus.cc:493] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:52.281831 28631 catalog_manager.cc:5654] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 0 to 1, leader changed from <none> to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:52.282722 28988 raft_consensus.cc:515] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.284614 28988 leader_election.cc:290] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:52.288079 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:16:52.292827 28851 consensus_peers.cc:597] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:16:52.299727 28683 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:16:52.299919 28931 tablet_bootstrap.cc:654] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:52.305990 29273 consensus_queue.cc:1048] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:52.319670 28885 raft_consensus.cc:3060] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:52.327117 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:52.332450 28851 leader_election.cc:304] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:52.343036 29273 raft_consensus.cc:2749] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:52.343575 28932 tablet_bootstrap.cc:654] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:52.345752 29278 consensus_queue.cc:1048] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:52.347177 28984 raft_consensus.cc:493] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:52.349249 28984 raft_consensus.cc:515] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.350663 28634 catalog_manager.cc:5654] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:52.351522 28984 leader_election.cc:290] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:52.353753 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:52.354542 28810 raft_consensus.cc:2468] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 0.
I20260203 09:16:52.357478 28700 leader_election.cc:304] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:52.363021 28933 tablet_bootstrap.cc:492] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:52.363875 28933 ts_tablet_manager.cc:1403] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.173s user 0.008s sys 0.012s
I20260203 09:16:52.360843 28984 raft_consensus.cc:2804] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:52.362290 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:52.374501 28984 raft_consensus.cc:493] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:52.377722 28984 raft_consensus.cc:3060] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:52.378841 28932 tablet_bootstrap.cc:492] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:52.386600 28932 ts_tablet_manager.cc:1403] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.109s user 0.010s sys 0.002s
I20260203 09:16:52.385857 28931 tablet_bootstrap.cc:492] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:52.387591 28931 ts_tablet_manager.cc:1403] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.180s user 0.009s sys 0.006s
W20260203 09:16:52.386111 28701 leader_election.cc:343] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:52.396004 28931 raft_consensus.cc:359] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.396754 28931 raft_consensus.cc:385] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:52.397083 28931 raft_consensus.cc:740] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:52.397672 28931 consensus_queue.cc:260] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.397281 28984 raft_consensus.cc:515] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.407205 28984 leader_election.cc:290] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:52.408209 28931 ts_tablet_manager.cc:1434] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.020s user 0.005s sys 0.002s
I20260203 09:16:52.409415 28931 tablet_bootstrap.cc:492] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:52.410184 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:52.410383 29291 raft_consensus.cc:493] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:52.411041 29291 raft_consensus.cc:515] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.410228 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
W20260203 09:16:52.411779 28701 leader_election.cc:343] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:52.413301 28932 raft_consensus.cc:359] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.414011 28932 raft_consensus.cc:385] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:52.414256 28932 raft_consensus.cc:740] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:52.414911 28932 consensus_queue.cc:260] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.416375 28931 tablet_bootstrap.cc:654] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:52.412254 28805 raft_consensus.cc:3060] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:52.419359 29291 leader_election.cc:290] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:52.420938 28932 ts_tablet_manager.cc:1434] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.034s user 0.007s sys 0.001s
I20260203 09:16:52.422611 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:16:52.425063 28777 leader_election.cc:343] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:52.425846 28932 tablet_bootstrap.cc:492] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:52.425056 28933 raft_consensus.cc:359] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.433836 28933 raft_consensus.cc:385] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:52.434108 28933 raft_consensus.cc:740] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:52.436053 28805 raft_consensus.cc:2468] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:16:52.441454 28700 leader_election.cc:304] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:16:52.442453 28984 raft_consensus.cc:2804] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:52.442935 28984 raft_consensus.cc:697] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:16:52.443769 28984 consensus_queue.cc:237] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.432533 28932 tablet_bootstrap.cc:654] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:52.451077 28933 consensus_queue.cc:260] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.464221 28932 tablet_bootstrap.cc:492] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:52.464872 28932 ts_tablet_manager.cc:1403] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.039s user 0.011s sys 0.001s
I20260203 09:16:52.467842 28932 raft_consensus.cc:359] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.470853 28635 catalog_manager.cc:5654] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 0 to 1, leader changed from <none> to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:52.473827 28932 raft_consensus.cc:385] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:52.474223 28932 raft_consensus.cc:740] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:52.474943 28932 consensus_queue.cc:260] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.471963 28933 ts_tablet_manager.cc:1434] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.108s user 0.006s sys 0.000s
I20260203 09:16:52.477684 28933 tablet_bootstrap.cc:492] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:52.478250 28932 ts_tablet_manager.cc:1434] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.013s user 0.005s sys 0.001s
I20260203 09:16:52.487944 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:52.491410 28932 tablet_bootstrap.cc:492] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:52.500665 28884 raft_consensus.cc:2468] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
I20260203 09:16:52.504204 28933 tablet_bootstrap.cc:654] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:52.505843 28932 tablet_bootstrap.cc:654] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:52.508035 28988 raft_consensus.cc:493] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:52.508504 28988 raft_consensus.cc:515] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.510445 28988 leader_election.cc:290] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:52.514772 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:52.514911 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:52.515676 28805 raft_consensus.cc:2393] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 1: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:16:52.524824 28777 leader_election.cc:304] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:52.526674 29278 raft_consensus.cc:2804] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:52.527132 29278 raft_consensus.cc:493] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:52.527489 29278 raft_consensus.cc:3060] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:52.529042 28931 tablet_bootstrap.cc:492] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:52.529645 28931 ts_tablet_manager.cc:1403] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.120s user 0.034s sys 0.017s
I20260203 09:16:52.530900 28932 tablet_bootstrap.cc:492] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:52.531397 28932 ts_tablet_manager.cc:1403] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.047s user 0.014s sys 0.000s
I20260203 09:16:52.532076 28851 leader_election.cc:304] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:52.532292 28931 raft_consensus.cc:359] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.533191 28931 raft_consensus.cc:385] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:52.533460 28931 raft_consensus.cc:740] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:52.537771 29273 raft_consensus.cc:3060] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:52.539783 28931 consensus_queue.cc:260] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.540997 28932 raft_consensus.cc:359] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.541682 28932 raft_consensus.cc:385] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:52.541941 28932 raft_consensus.cc:740] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:52.542172 29274 raft_consensus.cc:493] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:52.542663 29274 raft_consensus.cc:515] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.544620 29274 leader_election.cc:290] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:52.546752 28932 consensus_queue.cc:260] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.546393 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:52.548358 28731 raft_consensus.cc:2393] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 1: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:16:52.551728 28988 raft_consensus.cc:493] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:52.552352 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:52.552354 28988 raft_consensus.cc:515] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.553175 28931 ts_tablet_manager.cc:1434] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.023s user 0.004s sys 0.005s
I20260203 09:16:52.554199 28931 tablet_bootstrap.cc:492] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:52.554378 28988 leader_election.cc:290] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:52.555298 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:52.551774 28932 ts_tablet_manager.cc:1434] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.020s user 0.009s sys 0.000s
W20260203 09:16:52.557016 28852 leader_election.cc:343] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:52.559069 28851 leader_election.cc:304] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:52.559720 28988 raft_consensus.cc:3060] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:52.560343 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:52.562343 29273 raft_consensus.cc:2749] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:52.560925 28932 tablet_bootstrap.cc:492] T fba8b1b8685b431e8328cdb7df4ad1d0 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:52.564949 29278 raft_consensus.cc:515] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.562052 28931 tablet_bootstrap.cc:654] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
W20260203 09:16:52.570147 28851 leader_election.cc:343] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:52.578789 28851 leader_election.cc:304] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:52.580829 29281 raft_consensus.cc:2749] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:52.580197 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:52.585018 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:52.586227 28885 raft_consensus.cc:3060] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:52.587894 28932 tablet_bootstrap.cc:654] T fba8b1b8685b431e8328cdb7df4ad1d0 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
W20260203 09:16:52.587985 28777 leader_election.cc:343] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:52.567178 29278 leader_election.cc:290] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:52.606732 28988 raft_consensus.cc:2749] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:52.623903 28933 tablet_bootstrap.cc:492] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:52.623742 28885 raft_consensus.cc:2468] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:52.624589 28933 ts_tablet_manager.cc:1403] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.147s user 0.025s sys 0.016s
I20260203 09:16:52.628887 28932 tablet_bootstrap.cc:492] T fba8b1b8685b431e8328cdb7df4ad1d0 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:52.629369 28932 ts_tablet_manager.cc:1403] T fba8b1b8685b431e8328cdb7df4ad1d0 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.069s user 0.014s sys 0.001s
I20260203 09:16:52.632524 28933 raft_consensus.cc:359] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.633267 28933 raft_consensus.cc:385] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:52.633298 28777 leader_election.cc:304] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:52.633667 28933 raft_consensus.cc:740] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:52.634089 29223 raft_consensus.cc:2804] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:52.634567 29223 raft_consensus.cc:697] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:16:52.634253 28933 consensus_queue.cc:260] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.635396 29223 consensus_queue.cc:237] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.636307 28931 tablet_bootstrap.cc:492] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:52.636795 28931 ts_tablet_manager.cc:1403] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.083s user 0.015s sys 0.004s
I20260203 09:16:52.639294 28931 raft_consensus.cc:359] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.639917 28931 raft_consensus.cc:385] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:52.640139 28931 raft_consensus.cc:740] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:52.642165 28932 raft_consensus.cc:359] T fba8b1b8685b431e8328cdb7df4ad1d0 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.642709 28932 raft_consensus.cc:385] T fba8b1b8685b431e8328cdb7df4ad1d0 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:52.642947 28932 raft_consensus.cc:740] T fba8b1b8685b431e8328cdb7df4ad1d0 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:52.643532 28932 consensus_queue.cc:260] T fba8b1b8685b431e8328cdb7df4ad1d0 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.646538 28933 ts_tablet_manager.cc:1434] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.018s user 0.005s sys 0.000s
I20260203 09:16:52.647616 28933 tablet_bootstrap.cc:492] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:52.649152 28931 consensus_queue.cc:260] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.658984 29291 consensus_queue.cc:1048] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:52.660629 28931 ts_tablet_manager.cc:1434] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.024s user 0.004s sys 0.001s
I20260203 09:16:52.673482 28933 tablet_bootstrap.cc:654] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:52.677101 28931 tablet_bootstrap.cc:492] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:52.682049 29273 consensus_queue.cc:1048] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:52.682408 28631 catalog_manager.cc:5654] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 0 to 1, leader changed from <none> to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:52.659493 28932 ts_tablet_manager.cc:1434] T fba8b1b8685b431e8328cdb7df4ad1d0 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.030s user 0.003s sys 0.004s
I20260203 09:16:52.688426 28932 tablet_bootstrap.cc:492] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:52.688742 29273 consensus_queue.cc:1048] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:52.717519 28932 tablet_bootstrap.cc:654] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:52.735592 28931 tablet_bootstrap.cc:654] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:52.748605 29278 consensus_queue.cc:1048] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:52.798589 28810 raft_consensus.cc:3060] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:52.799261 28932 tablet_bootstrap.cc:492] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:52.799757 28932 ts_tablet_manager.cc:1403] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.112s user 0.008s sys 0.010s
I20260203 09:16:52.801707 29286 raft_consensus.cc:493] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:52.803107 29286 raft_consensus.cc:515] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.805423 28933 tablet_bootstrap.cc:492] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:52.805562 29286 leader_election.cc:290] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:52.807763 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:52.808427 28885 raft_consensus.cc:2468] T fba8b1b8685b431e8328cdb7df4ad1d0 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 0.
I20260203 09:16:52.813805 28701 leader_election.cc:304] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:52.814842 29275 raft_consensus.cc:2804] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:52.815239 29275 raft_consensus.cc:493] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:52.815512 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:52.815568 29275 raft_consensus.cc:3060] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:16:52.817771 28700 leader_election.cc:343] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:52.805941 28933 ts_tablet_manager.cc:1403] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.159s user 0.028s sys 0.007s
I20260203 09:16:52.826130 28931 tablet_bootstrap.cc:492] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:52.826689 28931 ts_tablet_manager.cc:1403] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.150s user 0.014s sys 0.012s
I20260203 09:16:52.826392 28932 raft_consensus.cc:359] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.827095 28932 raft_consensus.cc:385] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:52.827346 28932 raft_consensus.cc:740] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:52.827875 28932 consensus_queue.cc:260] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.835632 28933 raft_consensus.cc:359] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.836931 28933 raft_consensus.cc:385] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:52.837266 28933 raft_consensus.cc:740] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:52.839852 28931 raft_consensus.cc:359] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.844871 28931 raft_consensus.cc:385] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:52.845225 28931 raft_consensus.cc:740] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:52.845875 28984 raft_consensus.cc:493] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:52.846341 28984 raft_consensus.cc:515] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.848104 28984 leader_election.cc:290] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:52.848214 29275 raft_consensus.cc:515] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.849522 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:52.850364 28932 ts_tablet_manager.cc:1434] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.050s user 0.005s sys 0.003s
I20260203 09:16:52.845937 28933 consensus_queue.cc:260] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.851495 28805 raft_consensus.cc:2468] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 0.
I20260203 09:16:52.852005 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:52.853101 28933 ts_tablet_manager.cc:1434] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.034s user 0.005s sys 0.002s
I20260203 09:16:52.854084 28933 tablet_bootstrap.cc:492] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:52.854573 28700 leader_election.cc:304] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
W20260203 09:16:52.855935 28701 leader_election.cc:343] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:52.859016 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
W20260203 09:16:52.863898 28700 leader_election.cc:343] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:52.868211 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:52.869128 28884 raft_consensus.cc:3060] T fba8b1b8685b431e8328cdb7df4ad1d0 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:52.859488 29275 leader_election.cc:290] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:52.872191 28933 tablet_bootstrap.cc:654] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:52.861485 28932 tablet_bootstrap.cc:492] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:52.845872 28931 consensus_queue.cc:260] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.886793 28931 ts_tablet_manager.cc:1434] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.060s user 0.004s sys 0.002s
I20260203 09:16:52.856423 29286 raft_consensus.cc:2804] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:52.889444 29286 raft_consensus.cc:493] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:52.889947 29286 raft_consensus.cc:3060] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:52.894984 28884 raft_consensus.cc:2468] T fba8b1b8685b431e8328cdb7df4ad1d0 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:16:52.895308 28931 tablet_bootstrap.cc:492] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:52.898777 28701 leader_election.cc:304] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:52.899825 28984 raft_consensus.cc:2804] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:52.918627 28984 raft_consensus.cc:697] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:16:52.920048 28932 tablet_bootstrap.cc:654] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:52.919862 28984 consensus_queue.cc:237] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.942957 28933 tablet_bootstrap.cc:492] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:52.943460 28933 ts_tablet_manager.cc:1403] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.090s user 0.005s sys 0.028s
I20260203 09:16:52.943332 29286 raft_consensus.cc:515] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.945235 29286 leader_election.cc:290] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:52.945995 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:52.946273 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:52.946602 28810 raft_consensus.cc:3060] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:16:52.949504 28701 leader_election.cc:343] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:52.954387 28931 tablet_bootstrap.cc:654] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:52.976153 28933 raft_consensus.cc:359] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.976934 28933 raft_consensus.cc:385] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:52.977205 28933 raft_consensus.cc:740] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:52.977782 28933 consensus_queue.cc:260] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:52.980894 28634 catalog_manager.cc:5654] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 0 to 1, leader changed from <none> to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:52.990619 28810 raft_consensus.cc:2468] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:16:52.992121 28700 leader_election.cc:304] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:16:52.992563 28932 tablet_bootstrap.cc:492] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:52.993089 28932 ts_tablet_manager.cc:1403] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.132s user 0.014s sys 0.012s
I20260203 09:16:52.992364 28933 ts_tablet_manager.cc:1434] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.049s user 0.005s sys 0.002s
I20260203 09:16:52.993775 29363 raft_consensus.cc:2804] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:52.995940 28933 tablet_bootstrap.cc:492] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:52.997141 29363 raft_consensus.cc:697] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:16:52.998996 28931 tablet_bootstrap.cc:492] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:53.000348 28931 ts_tablet_manager.cc:1403] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.112s user 0.014s sys 0.000s
I20260203 09:16:53.000902 29286 consensus_queue.cc:1048] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:53.003706 29279 raft_consensus.cc:493] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:53.003820 28932 raft_consensus.cc:359] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.004506 28932 raft_consensus.cc:385] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:53.004236 29279 raft_consensus.cc:515] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.004823 28932 raft_consensus.cc:740] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:53.005496 28932 consensus_queue.cc:260] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.006431 29279 leader_election.cc:290] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:53.007704 28932 ts_tablet_manager.cc:1434] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20260203 09:16:53.008888 28932 tablet_bootstrap.cc:492] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:53.009186 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:53.001820 29363 consensus_queue.cc:237] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.009848 28730 raft_consensus.cc:2468] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
I20260203 09:16:53.011374 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:53.012722 28777 leader_election.cc:304] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:53.013625 29279 raft_consensus.cc:2804] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:53.013998 29279 raft_consensus.cc:493] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:53.014328 29279 raft_consensus.cc:3060] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:16:53.018348 28777 leader_election.cc:343] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:53.026964 28932 tablet_bootstrap.cc:654] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:53.031066 28931 raft_consensus.cc:359] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.031796 28931 raft_consensus.cc:385] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:53.032063 28931 raft_consensus.cc:740] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:53.032636 28931 consensus_queue.cc:260] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.033315 28984 consensus_queue.cc:1048] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:53.060075 29279 raft_consensus.cc:515] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.068213 28931 ts_tablet_manager.cc:1434] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.068s user 0.007s sys 0.000s
I20260203 09:16:53.074898 29290 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:53.075505 29290 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.076706 29279 leader_election.cc:290] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:53.077903 29290 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:53.080894 28933 tablet_bootstrap.cc:654] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:53.088883 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:53.081127 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:53.090646 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:53.091274 28731 raft_consensus.cc:3060] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:53.092491 28931 tablet_bootstrap.cc:492] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:53.094709 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:16:53.097465 28777 leader_election.cc:343] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:16:53.097676 28852 leader_election.cc:343] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:16:53.112798 28851 leader_election.cc:343] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:53.114830 28851 leader_election.cc:304] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:53.121100 29274 raft_consensus.cc:2749] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:53.111529 28731 raft_consensus.cc:2468] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:53.126513 28932 tablet_bootstrap.cc:492] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:53.127014 28932 ts_tablet_manager.cc:1403] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.119s user 0.005s sys 0.007s
I20260203 09:16:53.130201 28777 leader_election.cc:304] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:16:53.128523 29279 raft_consensus.cc:493] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:53.132799 29223 raft_consensus.cc:2804] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:53.135465 29223 raft_consensus.cc:697] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:16:53.137629 29279 raft_consensus.cc:515] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.137291 28634 catalog_manager.cc:5654] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 0 to 1, leader changed from <none> to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:53.139616 29279 leader_election.cc:290] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:53.137516 29223 consensus_queue.cc:237] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.142251 28932 raft_consensus.cc:359] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.143033 28932 raft_consensus.cc:385] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:53.143307 28932 raft_consensus.cc:740] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:53.143990 28932 consensus_queue.cc:260] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.146282 28932 ts_tablet_manager.cc:1434] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20260203 09:16:53.147369 28932 tablet_bootstrap.cc:492] T 6063a063fced4ff38761f892acbdfa76 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:53.158798 28933 tablet_bootstrap.cc:492] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:53.159308 28933 ts_tablet_manager.cc:1403] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.164s user 0.009s sys 0.004s
I20260203 09:16:53.165983 28931 tablet_bootstrap.cc:654] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:53.171664 28933 raft_consensus.cc:359] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.172482 28933 raft_consensus.cc:385] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:53.172804 28933 raft_consensus.cc:740] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:53.173480 28933 consensus_queue.cc:260] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.175577 29274 raft_consensus.cc:493] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:53.176507 29274 raft_consensus.cc:515] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.177019 28933 ts_tablet_manager.cc:1434] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.017s user 0.008s sys 0.000s
I20260203 09:16:53.178593 29274 leader_election.cc:290] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:53.179034 28932 tablet_bootstrap.cc:654] T 6063a063fced4ff38761f892acbdfa76 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:53.180047 28933 tablet_bootstrap.cc:492] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:53.183976 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:16:53.210101 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 78505.7us
I20260203 09:16:53.211328 29362 raft_consensus.cc:493] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:53.212036 29362 raft_consensus.cc:515] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.215097 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:53.209849 28631 catalog_manager.cc:5654] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 0 to 1, leader changed from <none> to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:53.217342 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:16:53.217686 28700 leader_election.cc:343] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:16:53.218873 28701 leader_election.cc:343] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:53.219302 28701 leader_election.cc:304] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:53.215170 29362 leader_election.cc:290] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:53.220374 29363 raft_consensus.cc:2749] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:53.220340 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:53.222013 28885 raft_consensus.cc:2468] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
I20260203 09:16:53.222774 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:53.223466 28731 raft_consensus.cc:2468] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
I20260203 09:16:53.226528 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:53.228209 28810 raft_consensus.cc:2393] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 1: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:16:53.238807 28777 leader_election.cc:304] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:53.239935 29279 raft_consensus.cc:2804] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:53.240442 29279 raft_consensus.cc:493] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:53.240854 29279 raft_consensus.cc:3060] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:53.241776 28931 tablet_bootstrap.cc:492] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:53.242254 28931 ts_tablet_manager.cc:1403] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.159s user 0.039s sys 0.011s
I20260203 09:16:53.243006 29223 consensus_queue.cc:1048] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:53.246491 28931 raft_consensus.cc:359] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.247368 28931 raft_consensus.cc:385] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:53.247710 28931 raft_consensus.cc:740] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:53.252099 28933 tablet_bootstrap.cc:654] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:53.252967 28931 consensus_queue.cc:260] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.256800 28931 ts_tablet_manager.cc:1434] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.014s user 0.009s sys 0.000s
I20260203 09:16:53.258468 28931 tablet_bootstrap.cc:492] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:53.261071 28851 leader_election.cc:304] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:53.262184 29281 raft_consensus.cc:3060] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:53.263468 29279 raft_consensus.cc:515] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.265539 28932 tablet_bootstrap.cc:492] T 6063a063fced4ff38761f892acbdfa76 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:53.266044 28932 ts_tablet_manager.cc:1403] T 6063a063fced4ff38761f892acbdfa76 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.119s user 0.017s sys 0.025s
I20260203 09:16:53.269599 29279 leader_election.cc:290] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:53.266175 28931 tablet_bootstrap.cc:654] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:53.273471 28732 raft_consensus.cc:3060] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:53.270509 29281 raft_consensus.cc:2749] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:53.268538 28932 raft_consensus.cc:359] T 6063a063fced4ff38761f892acbdfa76 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.275483 28932 raft_consensus.cc:385] T 6063a063fced4ff38761f892acbdfa76 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:53.275758 28932 raft_consensus.cc:740] T 6063a063fced4ff38761f892acbdfa76 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:53.276381 28932 consensus_queue.cc:260] T 6063a063fced4ff38761f892acbdfa76 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.280750 28933 tablet_bootstrap.cc:492] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:53.281260 28933 ts_tablet_manager.cc:1403] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.103s user 0.015s sys 0.000s
I20260203 09:16:53.283917 28933 raft_consensus.cc:359] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.284595 28933 raft_consensus.cc:385] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:53.285320 28932 ts_tablet_manager.cc:1434] T 6063a063fced4ff38761f892acbdfa76 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.019s user 0.005s sys 0.001s
I20260203 09:16:53.286415 28932 tablet_bootstrap.cc:492] T f4da79410aa74f5abca9517bbae98420 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:53.286679 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:53.287287 28732 raft_consensus.cc:3060] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:53.284891 28933 raft_consensus.cc:740] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:53.290532 28931 tablet_bootstrap.cc:492] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:53.291767 28931 ts_tablet_manager.cc:1403] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.034s user 0.009s sys 0.005s
I20260203 09:16:53.293426 28932 tablet_bootstrap.cc:654] T f4da79410aa74f5abca9517bbae98420 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:53.294966 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:53.295599 28886 raft_consensus.cc:3060] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:53.288141 28933 consensus_queue.cc:260] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.299700 28933 ts_tablet_manager.cc:1434] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20260203 09:16:53.300894 28933 tablet_bootstrap.cc:492] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:53.307428 29279 consensus_queue.cc:1048] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260203 09:16:53.320966 28931 raft_consensus.cc:359] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.321704 28931 raft_consensus.cc:385] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:53.321965 28931 raft_consensus.cc:740] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:53.325910 28886 raft_consensus.cc:2468] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:53.326138 28931 consensus_queue.cc:260] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.335734 28932 tablet_bootstrap.cc:492] T f4da79410aa74f5abca9517bbae98420 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:53.336239 28932 ts_tablet_manager.cc:1403] T f4da79410aa74f5abca9517bbae98420 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.050s user 0.008s sys 0.003s
I20260203 09:16:53.339993 28777 leader_election.cc:304] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:53.340237 28931 ts_tablet_manager.cc:1434] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.048s user 0.005s sys 0.001s
I20260203 09:16:53.342671 29279 raft_consensus.cc:2804] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:53.343186 29279 raft_consensus.cc:697] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:16:53.344033 29279 consensus_queue.cc:237] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.352470 28933 tablet_bootstrap.cc:654] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:53.360152 28932 raft_consensus.cc:359] T f4da79410aa74f5abca9517bbae98420 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.360970 28932 raft_consensus.cc:385] T f4da79410aa74f5abca9517bbae98420 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:53.361222 28932 raft_consensus.cc:740] T f4da79410aa74f5abca9517bbae98420 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:53.361831 28932 consensus_queue.cc:260] T f4da79410aa74f5abca9517bbae98420 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.363416 28932 ts_tablet_manager.cc:1434] T f4da79410aa74f5abca9517bbae98420 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.027s user 0.007s sys 0.000s
I20260203 09:16:53.364463 28932 tablet_bootstrap.cc:492] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:53.368742 28931 tablet_bootstrap.cc:492] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:53.366144 28732 raft_consensus.cc:2468] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:53.391886 28631 catalog_manager.cc:5654] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 0 to 1, leader changed from <none> to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
W20260203 09:16:53.395098 28683 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:16:53.429805 28931 tablet_bootstrap.cc:654] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:53.438449 29363 consensus_queue.cc:1048] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:53.465070 28933 tablet_bootstrap.cc:492] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:53.465631 28933 ts_tablet_manager.cc:1403] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.165s user 0.028s sys 0.023s
I20260203 09:16:53.471150 29363 consensus_queue.cc:1048] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:53.479832 28932 tablet_bootstrap.cc:654] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:53.489084 28812 raft_consensus.cc:3060] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:53.491377 28931 tablet_bootstrap.cc:492] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:53.491788 28931 ts_tablet_manager.cc:1403] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.123s user 0.012s sys 0.000s
I20260203 09:16:53.496053 28931 raft_consensus.cc:359] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.498759 28931 raft_consensus.cc:385] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:53.499050 28931 raft_consensus.cc:740] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:53.499627 28931 consensus_queue.cc:260] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.506489 28933 raft_consensus.cc:359] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.507319 28933 raft_consensus.cc:385] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:53.507997 28931 ts_tablet_manager.cc:1434] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.016s user 0.004s sys 0.002s
I20260203 09:16:53.509341 28931 tablet_bootstrap.cc:492] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:53.507666 28933 raft_consensus.cc:740] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:53.516005 29275 consensus_queue.cc:1048] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:53.515851 28933 consensus_queue.cc:260] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.521384 28933 ts_tablet_manager.cc:1434] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.055s user 0.007s sys 0.000s
I20260203 09:16:53.523623 29362 consensus_queue.cc:1048] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:53.532037 28933 tablet_bootstrap.cc:492] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:53.537806 28931 tablet_bootstrap.cc:654] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:53.539410 28932 tablet_bootstrap.cc:492] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:53.540094 28932 ts_tablet_manager.cc:1403] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.176s user 0.017s sys 0.005s
I20260203 09:16:53.543650 28932 raft_consensus.cc:359] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.544469 28932 raft_consensus.cc:385] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:53.544818 28932 raft_consensus.cc:740] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:53.545502 28932 consensus_queue.cc:260] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.547696 28932 ts_tablet_manager.cc:1434] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.007s user 0.002s sys 0.003s
I20260203 09:16:53.548982 28932 tablet_bootstrap.cc:492] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc: Bootstrap starting.
I20260203 09:16:53.557969 28932 tablet_bootstrap.cc:654] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:53.570969 28933 tablet_bootstrap.cc:654] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:53.575145 29373 raft_consensus.cc:493] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:53.575722 29373 raft_consensus.cc:515] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.579931 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:16:53.581394 28777 leader_election.cc:343] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:53.583083 29373 leader_election.cc:290] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:53.583238 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:53.583926 28885 raft_consensus.cc:2468] T f4da79410aa74f5abca9517bbae98420 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
I20260203 09:16:53.584278 29362 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:53.584767 29362 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.585384 28931 tablet_bootstrap.cc:492] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:53.585422 28777 leader_election.cc:304] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:16:53.585970 28931 ts_tablet_manager.cc:1403] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.077s user 0.016s sys 0.001s
I20260203 09:16:53.587543 29291 raft_consensus.cc:2804] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:53.587709 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:53.588379 28812 raft_consensus.cc:2468] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 0.
I20260203 09:16:53.587563 29362 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:53.589164 29291 raft_consensus.cc:493] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:53.589560 29291 raft_consensus.cc:3060] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:53.589849 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:53.590593 28885 raft_consensus.cc:2468] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 0.
I20260203 09:16:53.589933 28700 leader_election.cc:304] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:53.594223 29362 raft_consensus.cc:2804] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:53.594728 29362 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:53.595088 29362 raft_consensus.cc:3060] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:53.612751 28931 raft_consensus.cc:359] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.613631 28931 raft_consensus.cc:385] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:53.613909 28931 raft_consensus.cc:740] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:53.615228 28932 tablet_bootstrap.cc:492] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc: No bootstrap required, opened a new log
I20260203 09:16:53.622617 29281 raft_consensus.cc:493] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:53.629047 28931 consensus_queue.cc:260] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.629176 29281 raft_consensus.cc:515] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.642019 28933 tablet_bootstrap.cc:492] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:53.642499 28933 ts_tablet_manager.cc:1403] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.111s user 0.024s sys 0.009s
I20260203 09:16:53.643651 29281 leader_election.cc:290] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:53.630009 28932 ts_tablet_manager.cc:1403] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc: Time spent bootstrapping tablet: real 0.081s user 0.017s sys 0.035s
I20260203 09:16:53.644086 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:53.644956 28732 raft_consensus.cc:2393] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 1: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:16:53.646270 28932 raft_consensus.cc:359] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.646584 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:53.646943 28932 raft_consensus.cc:385] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:53.624929 29362 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.649195 28931 ts_tablet_manager.cc:1434] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.063s user 0.006s sys 0.001s
I20260203 09:16:53.649482 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:53.649859 28851 leader_election.cc:304] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:53.618127 29291 raft_consensus.cc:515] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.650161 28807 raft_consensus.cc:3060] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:53.651707 29290 raft_consensus.cc:3060] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:53.652041 29363 raft_consensus.cc:493] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:53.652552 29363 raft_consensus.cc:515] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.655706 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:53.657263 28807 raft_consensus.cc:2468] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
W20260203 09:16:53.657748 28700 leader_election.cc:343] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:53.650218 28931 tablet_bootstrap.cc:492] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e: Bootstrap starting.
I20260203 09:16:53.658463 28700 leader_election.cc:304] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:53.659307 29360 raft_consensus.cc:2804] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:53.647243 28932 raft_consensus.cc:740] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Initialized, Role: FOLLOWER
I20260203 09:16:53.659812 29360 raft_consensus.cc:697] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:16:53.660133 28932 consensus_queue.cc:260] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.644958 28933 raft_consensus.cc:359] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.661834 28933 raft_consensus.cc:385] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:53.662096 28933 raft_consensus.cc:740] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:53.667177 29363 leader_election.cc:290] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:53.660612 29360 consensus_queue.cc:237] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.671988 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:53.671988 28933 consensus_queue.cc:260] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.672845 28885 raft_consensus.cc:2468] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 0.
I20260203 09:16:53.673278 28932 ts_tablet_manager.cc:1434] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc: Time spent starting tablet: real 0.029s user 0.006s sys 0.000s
I20260203 09:16:53.673882 28701 leader_election.cc:304] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:53.674844 29363 raft_consensus.cc:2804] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:53.675210 29363 raft_consensus.cc:493] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:53.675530 29363 raft_consensus.cc:3060] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:53.677395 29362 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:53.686223 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:53.686858 28885 raft_consensus.cc:3060] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:53.689448 29373 consensus_queue.cc:1048] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:53.689954 29291 leader_election.cc:290] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:53.692025 29373 raft_consensus.cc:493] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:53.679946 28933 ts_tablet_manager.cc:1434] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.037s user 0.008s sys 0.000s
I20260203 09:16:53.694005 29363 raft_consensus.cc:515] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.697288 29373 raft_consensus.cc:515] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.709501 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:16:53.709524 29373 leader_election.cc:290] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:53.710995 29363 leader_election.cc:290] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:53.711694 28933 tablet_bootstrap.cc:492] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:53.716602 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:53.717276 28883 raft_consensus.cc:3060] T f4da79410aa74f5abca9517bbae98420 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:53.723773 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:53.724494 28889 raft_consensus.cc:2468] T 6063a063fced4ff38761f892acbdfa76 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
I20260203 09:16:53.725785 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:53.726446 28732 raft_consensus.cc:3060] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:16:53.728415 28700 leader_election.cc:343] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:53.733080 28777 leader_election.cc:304] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:53.733886 29373 raft_consensus.cc:2804] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:53.734246 29373 raft_consensus.cc:493] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:53.734555 29373 raft_consensus.cc:3060] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:53.754666 28931 tablet_bootstrap.cc:654] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:53.755908 29290 raft_consensus.cc:2749] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:16:53.757372 28933 tablet_bootstrap.cc:654] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:53.778184 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:53.778911 28737 raft_consensus.cc:2468] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 0.
I20260203 09:16:53.758514 28883 raft_consensus.cc:2468] T f4da79410aa74f5abca9517bbae98420 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:53.777691 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:53.784173 28631 catalog_manager.cc:5654] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 0 to 1, leader changed from <none> to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:53.776374 28885 raft_consensus.cc:2468] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:16:53.783962 29223 consensus_queue.cc:1048] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260203 09:16:53.788041 28884 raft_consensus.cc:3060] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:53.792925 28732 raft_consensus.cc:2468] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:53.801290 29373 raft_consensus.cc:515] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.805358 28884 raft_consensus.cc:2468] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:16:53.811653 29373 leader_election.cc:290] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:53.813251 28701 leader_election.cc:304] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:53.814453 29363 raft_consensus.cc:2804] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:53.815263 29363 raft_consensus.cc:697] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:16:53.817816 28988 raft_consensus.cc:493] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:53.818310 28988 raft_consensus.cc:515] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.820588 28988 leader_election.cc:290] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:53.816212 29363 consensus_queue.cc:237] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.829341 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:53.829819 28931 tablet_bootstrap.cc:492] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e: No bootstrap required, opened a new log
I20260203 09:16:53.831338 28931 ts_tablet_manager.cc:1403] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent bootstrapping tablet: real 0.181s user 0.002s sys 0.017s
I20260203 09:16:53.829968 28885 raft_consensus.cc:3060] T 6063a063fced4ff38761f892acbdfa76 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:53.833997 28931 raft_consensus.cc:359] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.834666 28931 raft_consensus.cc:385] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:53.834524 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:53.835047 28931 raft_consensus.cc:740] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Initialized, Role: FOLLOWER
I20260203 09:16:53.835685 28931 consensus_queue.cc:260] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.837843 28931 ts_tablet_manager.cc:1434] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260203 09:16:53.840166 28885 raft_consensus.cc:2468] T 6063a063fced4ff38761f892acbdfa76 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:53.841943 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:16:53.843883 28731 raft_consensus.cc:2468] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 0.
I20260203 09:16:53.845103 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:53.845794 28738 raft_consensus.cc:3060] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:53.845209 28777 leader_election.cc:304] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:53.847837 28777 leader_election.cc:304] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:53.847705 29223 consensus_queue.cc:1048] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:53.848523 29373 raft_consensus.cc:2804] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:53.847522 29395 raft_consensus.cc:2804] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:53.849527 29395 raft_consensus.cc:697] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:16:53.848994 29373 raft_consensus.cc:697] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:16:53.850520 29395 consensus_queue.cc:237] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.850662 29373 consensus_queue.cc:237] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.855592 28852 leader_election.cc:304] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:16:53.857297 29290 raft_consensus.cc:2804] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:16:53.857734 29290 raft_consensus.cc:493] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:16:53.858091 29290 raft_consensus.cc:3060] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:16:53.864683 28851 leader_election.cc:343] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:53.876250 28631 catalog_manager.cc:5654] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 0 to 1, leader changed from <none> to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:53.879855 28634 catalog_manager.cc:5654] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 0 to 1, leader changed from <none> to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:53.926242 28631 catalog_manager.cc:5654] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 0 to 1, leader changed from <none> to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:53.940369 29290 raft_consensus.cc:515] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.944885 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:53.945472 28732 raft_consensus.cc:3060] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:53.945659 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
W20260203 09:16:53.952160 28851 leader_election.cc:343] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:16:53.954975 29291 consensus_queue.cc:1048] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:53.951720 28738 raft_consensus.cc:2468] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:53.964898 28933 tablet_bootstrap.cc:492] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:53.951874 29290 leader_election.cc:290] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:53.965342 28933 ts_tablet_manager.cc:1403] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.264s user 0.022s sys 0.034s
I20260203 09:16:53.968197 28933 raft_consensus.cc:359] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.968868 28933 raft_consensus.cc:385] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:53.969270 28933 raft_consensus.cc:740] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:53.969903 28933 consensus_queue.cc:260] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:53.973624 28933 ts_tablet_manager.cc:1434] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260203 09:16:53.976300 28933 tablet_bootstrap.cc:492] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee: Bootstrap starting.
I20260203 09:16:53.980334 28732 raft_consensus.cc:2468] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:16:53.985766 28852 leader_election.cc:304] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:16:53.988049 29281 raft_consensus.cc:2804] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:16:53.989665 29281 raft_consensus.cc:697] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:53.990890 29281 consensus_queue.cc:237] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:54.008201 28933 tablet_bootstrap.cc:654] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee: Neither blocks nor log segments found. Creating new log.
I20260203 09:16:54.039633 28631 catalog_manager.cc:5654] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 0 to 1, leader changed from <none> to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:16:54.063637 28933 tablet_bootstrap.cc:492] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee: No bootstrap required, opened a new log
I20260203 09:16:54.064121 28933 ts_tablet_manager.cc:1403] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent bootstrapping tablet: real 0.088s user 0.029s sys 0.028s
I20260203 09:16:54.066780 28933 raft_consensus.cc:359] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:54.067480 28933 raft_consensus.cc:385] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:16:54.067744 28933 raft_consensus.cc:740] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Initialized, Role: FOLLOWER
I20260203 09:16:54.068449 28933 consensus_queue.cc:260] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:54.086097 28933 ts_tablet_manager.cc:1434] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent starting tablet: real 0.022s user 0.004s sys 0.004s
I20260203 09:16:54.105820 29360 consensus_queue.cc:1048] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:54.130631 28984 consensus_queue.cc:1048] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:54.192854 27553 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 09:16:54.210297 29409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:16:54.210764 28807 raft_consensus.cc:3060] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:16:54.237924 29410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:16:54.246126 29360 consensus_queue.cc:1048] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:54.248296 27553 server_base.cc:1060] running on GCE node
I20260203 09:16:54.254017 29373 consensus_queue.cc:1048] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260203 09:16:54.256925 29412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:16:54.261826 29398 consensus_queue.cc:1048] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:54.268920 27553 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260203 09:16:54.274036 27553 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260203 09:16:54.274436 27553 hybrid_clock.cc:648] HybridClock initialized: now 1770110214274412 us; error 0 us; skew 500 ppm
I20260203 09:16:54.278347 27553 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260203 09:16:54.276111 29373 consensus_queue.cc:1048] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:54.358290 29398 consensus_queue.cc:1048] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:54.362989 29360 consensus_queue.cc:1048] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:16:54.372609 27553 webserver.cc:492] Webserver started at http://127.26.232.68:42853/ using document root <none> and password file <none>
I20260203 09:16:54.378733 27553 fs_manager.cc:362] Metadata directory not provided
I20260203 09:16:54.381400 27553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 09:16:54.383255 27553 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 09:16:54.392766 27553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-3-root/instance:
uuid: "cf00f643e7da4a98a0a11ea92869c24a"
format_stamp: "Formatted at 2026-02-03 09:16:54 on dist-test-slave-x12j"
I20260203 09:16:54.517107 27553 fs_manager.cc:696] Time spent creating directory manager: real 0.079s user 0.010s sys 0.009s
I20260203 09:16:54.532790 28810 raft_consensus.cc:3060] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:16:54.537601 29423 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 09:16:54.539827 29395 raft_consensus.cc:493] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:16:54.540431 29395 raft_consensus.cc:515] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:54.543973 29395 leader_election.cc:290] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:54.545146 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:16:54.545454 29273 consensus_queue.cc:1048] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:54.545900 28731 raft_consensus.cc:2468] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:16:54.546901 28777 leader_election.cc:304] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:54.556772 27553 fs_manager.cc:730] Time spent opening block manager: real 0.036s user 0.003s sys 0.000s
I20260203 09:16:54.557252 27553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-3-root
uuid: "cf00f643e7da4a98a0a11ea92869c24a"
format_stamp: "Formatted at 2026-02-03 09:16:54 on dist-test-slave-x12j"
I20260203 09:16:54.557782 27553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 09:16:54.545548 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:16:54.566351 29395 raft_consensus.cc:2804] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:16:54.568041 29395 raft_consensus.cc:493] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:16:54.568496 29395 raft_consensus.cc:3060] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:54.579931 29395 raft_consensus.cc:515] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:54.584729 29395 leader_election.cc:290] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:54.594750 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:16:54.595702 28730 raft_consensus.cc:3060] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:54.598209 28810 raft_consensus.cc:1240] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Rejecting Update request from peer 77541303e1934638ba82f0f43f707adc for earlier term 1. Current term is 2. Ops: []
I20260203 09:16:54.607640 28730 raft_consensus.cc:2468] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:16:54.609249 28777 leader_election.cc:304] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:16:54.610049 29395 raft_consensus.cc:2804] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:16:54.610747 29395 raft_consensus.cc:697] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:16:54.610999 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:16:54.611611 29395 consensus_queue.cc:237] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:54.612036 29273 consensus_queue.cc:1048] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:54.613112 28988 consensus_queue.cc:1059] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:54.614244 29273 raft_consensus.cc:3055] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:16:54.614637 29273 raft_consensus.cc:740] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:16:54.615478 29273 consensus_queue.cc:260] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:16:54.617386 28730 raft_consensus.cc:1240] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Rejecting Update request from peer 77541303e1934638ba82f0f43f707adc for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260203 09:16:54.616606 29273 raft_consensus.cc:3060] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:16:54.645222 28634 catalog_manager.cc:5654] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 1 to 2, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 2 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:54.662680 27553 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 09:16:54.665616 27553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 09:16:54.673799 27553 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260203 09:16:54.681747 27553 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260203 09:16:54.682047 27553 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260203 09:16:54.682384 27553 ts_tablet_manager.cc:616] Registered 0 tablets
I20260203 09:16:54.682597 27553 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260203 09:16:55.090224 28730 raft_consensus.cc:1275] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:55.093904 29223 consensus_queue.cc:1048] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:16:55.117347 27553 rpc_server.cc:307] RPC server started. Bound to: 127.26.232.68:40627
I20260203 09:16:55.118986 29491 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.232.68:40627 every 8 connection(s)
I20260203 09:16:55.120786 28883 raft_consensus.cc:1275] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:16:55.122840 29490 consensus_queue.cc:1048] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:55.187402 27553 auto_leader_rebalancer-test.cc:417] add a tserver: cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:16:55.225419 29493 heartbeater.cc:344] Connected to a master server at 127.26.232.126:35239
I20260203 09:16:55.225972 29493 heartbeater.cc:461] Registering TS with master...
I20260203 09:16:55.226915 29493 heartbeater.cc:507] Master 127.26.232.126:35239 requested a full tablet report, sending...
I20260203 09:16:55.229588 28631 ts_manager.cc:194] Registered new tserver with Master: cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:16:55.231411 28631 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57772
I20260203 09:16:55.752286 28807 consensus_queue.cc:237] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:16:55.786669 28887 raft_consensus.cc:1275] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:16:55.788388 29223 consensus_queue.cc:1048] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:55.789619 28730 raft_consensus.cc:1275] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:16:55.802016 29279 consensus_queue.cc:1048] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260203 09:16:55.821895 28776 consensus_peers.cc:597] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e336e3590fc428e88c5353c9e96a36f. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:16:55.847659 29279 raft_consensus.cc:2955] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:55.850342 28730 raft_consensus.cc:2955] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:55.862663 28883 raft_consensus.cc:2955] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:55.885298 28631 catalog_manager.cc:5654] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:55.946251 28883 consensus_queue.cc:237] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:16:55.985947 28730 raft_consensus.cc:1275] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:16:55.988976 29500 consensus_queue.cc:1048] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:55.996145 28805 raft_consensus.cc:1275] T 4915f49d9ce24ab29a5c09e91dafd667 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:16:55.998677 29273 consensus_queue.cc:1048] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260203 09:16:56.016538 28851 consensus_peers.cc:597] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4915f49d9ce24ab29a5c09e91dafd667. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:16:56.032874 29273 raft_consensus.cc:2955] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:56.038013 28731 raft_consensus.cc:2955] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:56.052390 28807 raft_consensus.cc:2955] T 4915f49d9ce24ab29a5c09e91dafd667 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:56.056190 28635 catalog_manager.cc:5654] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:56.076673 28887 consensus_queue.cc:237] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:16:56.105922 28730 raft_consensus.cc:1275] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:16:56.106549 28805 raft_consensus.cc:1275] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:16:56.108378 29290 consensus_queue.cc:1048] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260203 09:16:56.115726 28851 consensus_peers.cc:597] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0322ad4122a64f6abccdfb1906919b8e. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:16:56.120529 29273 consensus_queue.cc:1048] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:56.148358 28731 raft_consensus.cc:2955] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:56.153411 29274 raft_consensus.cc:2955] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:56.174963 28887 consensus_queue.cc:237] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:16:56.195138 28805 raft_consensus.cc:2955] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:56.192792 28634 catalog_manager.cc:5654] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
W20260203 09:16:56.229839 28851 consensus_peers.cc:597] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 574d0205e57547c6938037563109a6d2. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:16:56.234566 29493 heartbeater.cc:499] Master 127.26.232.126:35239 was elected leader, sending a full tablet report...
I20260203 09:16:56.244166 28810 raft_consensus.cc:1275] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:16:56.245561 29290 consensus_queue.cc:1048] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:56.256871 28730 raft_consensus.cc:1275] T 574d0205e57547c6938037563109a6d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:16:56.258344 29290 consensus_queue.cc:1048] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:16:56.272162 29526 ts_tablet_manager.cc:933] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:56.279471 29273 raft_consensus.cc:2955] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:56.286777 28810 raft_consensus.cc:2955] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:56.285612 29526 tablet_copy_client.cc:323] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.66:41611
I20260203 09:16:56.307750 28635 catalog_manager.cc:5654] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:56.353766 28730 raft_consensus.cc:2955] T 574d0205e57547c6938037563109a6d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:56.354816 28823 tablet_copy_service.cc:140] P be3b58b70fd74625a8ae8dfd7db7f6ee: Received BeginTabletCopySession request for tablet 7e336e3590fc428e88c5353c9e96a36f from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:50256)
I20260203 09:16:56.355476 28823 tablet_copy_service.cc:161] P be3b58b70fd74625a8ae8dfd7db7f6ee: Beginning new tablet copy session on tablet 7e336e3590fc428e88c5353c9e96a36f from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:50256: session id = cf00f643e7da4a98a0a11ea92869c24a-7e336e3590fc428e88c5353c9e96a36f
I20260203 09:16:56.367964 28823 tablet_copy_source_session.cc:215] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:16:56.443107 29526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e336e3590fc428e88c5353c9e96a36f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:56.483282 29526 tablet_copy_client.cc:806] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:16:56.484314 29526 tablet_copy_client.cc:670] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:16:56.497622 29526 tablet_copy_client.cc:538] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:16:56.515575 29526 tablet_bootstrap.cc:492] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:16:56.564354 29531 ts_tablet_manager.cc:933] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:56.573331 29532 ts_tablet_manager.cc:933] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:56.573681 29531 tablet_copy_client.cc:323] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.67:42899
I20260203 09:16:56.594020 28899 tablet_copy_service.cc:140] P 77541303e1934638ba82f0f43f707adc: Received BeginTabletCopySession request for tablet 4915f49d9ce24ab29a5c09e91dafd667 from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:59280)
I20260203 09:16:56.594622 28899 tablet_copy_service.cc:161] P 77541303e1934638ba82f0f43f707adc: Beginning new tablet copy session on tablet 4915f49d9ce24ab29a5c09e91dafd667 from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:59280: session id = cf00f643e7da4a98a0a11ea92869c24a-4915f49d9ce24ab29a5c09e91dafd667
I20260203 09:16:56.604552 28899 tablet_copy_source_session.cc:215] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:16:56.604956 29532 tablet_copy_client.cc:323] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.67:42899
I20260203 09:16:56.606567 28899 tablet_copy_service.cc:140] P 77541303e1934638ba82f0f43f707adc: Received BeginTabletCopySession request for tablet 0322ad4122a64f6abccdfb1906919b8e from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:59280)
I20260203 09:16:56.607156 28899 tablet_copy_service.cc:161] P 77541303e1934638ba82f0f43f707adc: Beginning new tablet copy session on tablet 0322ad4122a64f6abccdfb1906919b8e from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:59280: session id = cf00f643e7da4a98a0a11ea92869c24a-0322ad4122a64f6abccdfb1906919b8e
I20260203 09:16:56.608352 29531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4915f49d9ce24ab29a5c09e91dafd667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:56.613320 29526 tablet_bootstrap.cc:492] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:16:56.617856 28899 tablet_copy_source_session.cc:215] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:16:56.630116 29526 tablet_bootstrap.cc:492] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:16:56.630867 29526 ts_tablet_manager.cc:1403] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.116s user 0.017s sys 0.011s
I20260203 09:16:56.634413 29532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0322ad4122a64f6abccdfb1906919b8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:56.643607 29531 tablet_copy_client.cc:806] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:16:56.644243 29531 tablet_copy_client.cc:670] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:16:56.648612 29531 tablet_copy_client.cc:538] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:16:56.651099 29526 raft_consensus.cc:359] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:16:56.651978 29526 raft_consensus.cc:740] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:16:56.652675 29526 consensus_queue.cc:260] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:16:56.670837 29531 tablet_bootstrap.cc:492] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:16:56.682521 29532 tablet_copy_client.cc:806] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:16:56.683447 29532 tablet_copy_client.cc:670] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:16:56.685966 29526 ts_tablet_manager.cc:1434] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.050s user 0.008s sys 0.001s
I20260203 09:16:56.699857 28823 tablet_copy_service.cc:342] P be3b58b70fd74625a8ae8dfd7db7f6ee: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-7e336e3590fc428e88c5353c9e96a36f received from {username='slave'} at 127.0.0.1:50256
I20260203 09:16:56.700413 28823 tablet_copy_service.cc:434] P be3b58b70fd74625a8ae8dfd7db7f6ee: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-7e336e3590fc428e88c5353c9e96a36f on tablet 7e336e3590fc428e88c5353c9e96a36f with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:16:56.709791 29532 tablet_copy_client.cc:538] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:16:56.723644 29532 tablet_bootstrap.cc:492] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:16:56.740041 29531 tablet_bootstrap.cc:492] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:16:56.741058 29531 tablet_bootstrap.cc:492] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:16:56.741807 29531 ts_tablet_manager.cc:1403] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.071s user 0.033s sys 0.009s
I20260203 09:16:56.774350 29531 raft_consensus.cc:359] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:16:56.775388 29531 raft_consensus.cc:740] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:16:56.787436 29532 tablet_bootstrap.cc:492] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:16:56.788532 29532 tablet_bootstrap.cc:492] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:16:56.790877 29532 ts_tablet_manager.cc:1403] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.067s user 0.030s sys 0.014s
I20260203 09:16:56.793819 29464 raft_consensus.cc:1217] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:16:56.776696 29531 consensus_queue.cc:260] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:16:56.814643 29532 raft_consensus.cc:359] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:16:56.816140 29532 raft_consensus.cc:740] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:16:56.817716 29531 ts_tablet_manager.cc:1434] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.076s user 0.003s sys 0.005s
I20260203 09:16:56.817895 29532 consensus_queue.cc:260] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:16:56.820822 29532 ts_tablet_manager.cc:1434] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.030s user 0.007s sys 0.000s
I20260203 09:16:56.824993 28899 tablet_copy_service.cc:342] P 77541303e1934638ba82f0f43f707adc: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-0322ad4122a64f6abccdfb1906919b8e received from {username='slave'} at 127.0.0.1:59280
I20260203 09:16:56.825464 28899 tablet_copy_service.cc:434] P 77541303e1934638ba82f0f43f707adc: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-0322ad4122a64f6abccdfb1906919b8e on tablet 0322ad4122a64f6abccdfb1906919b8e with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:16:56.832682 29532 ts_tablet_manager.cc:933] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:56.837764 28899 tablet_copy_service.cc:342] P 77541303e1934638ba82f0f43f707adc: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-4915f49d9ce24ab29a5c09e91dafd667 received from {username='slave'} at 127.0.0.1:59280
I20260203 09:16:56.838254 28899 tablet_copy_service.cc:434] P 77541303e1934638ba82f0f43f707adc: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-4915f49d9ce24ab29a5c09e91dafd667 on tablet 4915f49d9ce24ab29a5c09e91dafd667 with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:16:56.846863 29532 tablet_copy_client.cc:323] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.67:42899
I20260203 09:16:56.848613 28899 tablet_copy_service.cc:140] P 77541303e1934638ba82f0f43f707adc: Received BeginTabletCopySession request for tablet 574d0205e57547c6938037563109a6d2 from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:59280)
I20260203 09:16:56.849170 28899 tablet_copy_service.cc:161] P 77541303e1934638ba82f0f43f707adc: Beginning new tablet copy session on tablet 574d0205e57547c6938037563109a6d2 from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:59280: session id = cf00f643e7da4a98a0a11ea92869c24a-574d0205e57547c6938037563109a6d2
I20260203 09:16:56.867174 28899 tablet_copy_source_session.cc:215] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:16:56.870532 29532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 574d0205e57547c6938037563109a6d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:56.893728 29532 tablet_copy_client.cc:806] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:16:56.894428 29532 tablet_copy_client.cc:670] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:16:56.899274 29532 tablet_copy_client.cc:538] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:16:56.910501 29532 tablet_bootstrap.cc:492] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:16:57.038545 29532 tablet_bootstrap.cc:492] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:16:57.039631 29532 tablet_bootstrap.cc:492] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:16:57.040335 29532 ts_tablet_manager.cc:1403] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.130s user 0.059s sys 0.039s
I20260203 09:16:57.043300 29532 raft_consensus.cc:359] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:16:57.044410 29532 raft_consensus.cc:740] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:16:57.045230 29532 consensus_queue.cc:260] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:16:57.048195 29532 ts_tablet_manager.cc:1434] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260203 09:16:57.050833 28899 tablet_copy_service.cc:342] P 77541303e1934638ba82f0f43f707adc: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-574d0205e57547c6938037563109a6d2 received from {username='slave'} at 127.0.0.1:59280
I20260203 09:16:57.051251 28899 tablet_copy_service.cc:434] P 77541303e1934638ba82f0f43f707adc: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-574d0205e57547c6938037563109a6d2 on tablet 574d0205e57547c6938037563109a6d2 with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:16:57.131728 29464 raft_consensus.cc:1217] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:16:57.173694 29464 raft_consensus.cc:1217] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:16:57.377575 29530 raft_consensus.cc:1064] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:16:57.377966 29464 raft_consensus.cc:1217] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:16:57.380183 29530 consensus_queue.cc:237] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:16:57.399644 29464 raft_consensus.cc:1275] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:16:57.400956 29279 consensus_queue.cc:1048] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:16:57.405458 28731 raft_consensus.cc:1275] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:16:57.406824 29509 consensus_queue.cc:1048] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:16:57.411257 28883 raft_consensus.cc:1275] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:16:57.427238 29508 raft_consensus.cc:2955] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:57.438766 29530 consensus_queue.cc:1048] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:16:57.435622 29464 raft_consensus.cc:2955] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:57.454978 28731 raft_consensus.cc:2955] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:57.475314 28635 catalog_manager.cc:5654] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:16:57.481169 28883 raft_consensus.cc:2955] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:57.558820 28807 consensus_queue.cc:237] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:16:57.566371 28730 raft_consensus.cc:1275] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:16:57.566411 29464 raft_consensus.cc:1275] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:16:57.568240 29508 consensus_queue.cc:1048] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:16:57.568837 29279 consensus_queue.cc:1048] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:16:57.578014 29509 raft_consensus.cc:2955] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:57.582394 29464 raft_consensus.cc:2955] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:57.584944 28730 raft_consensus.cc:2955] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:57.592345 28618 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 7e336e3590fc428e88c5353c9e96a36f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:16:57.615607 28633 catalog_manager.cc:5654] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:57.629594 29274 raft_consensus.cc:1064] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:16:57.631781 29274 consensus_queue.cc:237] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:16:57.643412 29464 raft_consensus.cc:1275] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:16:57.645226 29550 consensus_queue.cc:1048] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:16:57.683178 28872 tablet_service.cc:1552] Processing DeleteTablet for tablet 7e336e3590fc428e88c5353c9e96a36f with delete_type TABLET_DATA_TOMBSTONED (TS 77541303e1934638ba82f0f43f707adc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40930
I20260203 09:16:57.690133 29554 tablet_replica.cc:333] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:16:57.691082 29554 raft_consensus.cc:2243] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:57.706831 29554 raft_consensus.cc:2272] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:57.709988 29554 ts_tablet_manager.cc:1916] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:16:57.710624 28807 raft_consensus.cc:1275] T 4915f49d9ce24ab29a5c09e91dafd667 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:16:57.731731 28731 raft_consensus.cc:1275] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:16:57.741444 29554 ts_tablet_manager.cc:1929] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:16:57.741993 29554 log.cc:1199] T 7e336e3590fc428e88c5353c9e96a36f P 77541303e1934638ba82f0f43f707adc: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-2-root/wals/7e336e3590fc428e88c5353c9e96a36f
I20260203 09:16:57.741835 29555 consensus_queue.cc:1048] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:16:57.747033 28619 catalog_manager.cc:4985] TS 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): tablet 7e336e3590fc428e88c5353c9e96a36f (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:16:57.755257 29555 raft_consensus.cc:2955] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:57.759475 29273 consensus_queue.cc:1048] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:16:57.766932 28731 raft_consensus.cc:2955] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:57.771440 29464 raft_consensus.cc:2955] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:57.774614 29552 raft_consensus.cc:1064] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:16:57.779986 28807 raft_consensus.cc:2955] T 4915f49d9ce24ab29a5c09e91dafd667 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:57.782498 29552 consensus_queue.cc:237] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:16:57.779953 28631 catalog_manager.cc:5654] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:16:57.809346 29500 raft_consensus.cc:1064] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:16:57.810714 28886 consensus_queue.cc:237] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:16:57.813014 29500 consensus_queue.cc:237] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:16:57.822454 28730 raft_consensus.cc:1275] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:16:57.832283 29273 consensus_queue.cc:1048] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:16:57.837175 29463 raft_consensus.cc:1275] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:16:57.837741 28738 raft_consensus.cc:1275] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:16:57.838009 29465 raft_consensus.cc:1275] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:16:57.840348 29552 consensus_queue.cc:1048] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:16:57.841228 28807 raft_consensus.cc:1275] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:16:57.844429 29555 consensus_queue.cc:1048] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:16:57.846060 29273 consensus_queue.cc:1048] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:16:57.848548 29273 consensus_queue.cc:1048] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:16:57.851218 29274 raft_consensus.cc:2955] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:57.860392 28738 raft_consensus.cc:2955] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:57.863919 28732 raft_consensus.cc:1275] T 574d0205e57547c6938037563109a6d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:16:57.868906 29465 raft_consensus.cc:1275] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:16:57.868789 28805 raft_consensus.cc:1275] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:16:57.873107 29552 consensus_queue.cc:1048] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:16:57.923938 29552 consensus_queue.cc:1048] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:16:57.927795 29273 consensus_queue.cc:1048] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260203 09:16:57.929497 29562 log.cc:927] Time spent T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.072s user 0.000s sys 0.001s
I20260203 09:16:57.921756 28634 catalog_manager.cc:5654] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:57.932245 29556 raft_consensus.cc:2955] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:57.933719 28619 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 4915f49d9ce24ab29a5c09e91dafd667 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:16:57.943323 28731 raft_consensus.cc:2955] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:57.958926 28802 tablet_service.cc:1552] Processing DeleteTablet for tablet 4915f49d9ce24ab29a5c09e91dafd667 with delete_type TABLET_DATA_TOMBSTONED (TS be3b58b70fd74625a8ae8dfd7db7f6ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36384
I20260203 09:16:57.972913 28805 raft_consensus.cc:2955] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:57.982879 29465 raft_consensus.cc:2955] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:57.996378 29463 raft_consensus.cc:2955] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:57.998270 28634 catalog_manager.cc:5654] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:58.019186 29274 raft_consensus.cc:2955] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:58.021595 28807 raft_consensus.cc:2955] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:58.030998 28732 raft_consensus.cc:2955] T 574d0205e57547c6938037563109a6d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:58.048928 29566 tablet_replica.cc:333] T 4915f49d9ce24ab29a5c09e91dafd667 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:16:58.050715 29566 raft_consensus.cc:2243] T 4915f49d9ce24ab29a5c09e91dafd667 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:58.051493 29566 raft_consensus.cc:2272] T 4915f49d9ce24ab29a5c09e91dafd667 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:58.057024 28887 consensus_queue.cc:237] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:16:58.060251 29566 ts_tablet_manager.cc:1916] T 4915f49d9ce24ab29a5c09e91dafd667 P be3b58b70fd74625a8ae8dfd7db7f6ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:16:58.059760 29464 raft_consensus.cc:2955] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:58.070495 28635 catalog_manager.cc:5654] T 574d0205e57547c6938037563109a6d2 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:58.073969 29465 raft_consensus.cc:1275] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:16:58.086117 29566 ts_tablet_manager.cc:1929] T 4915f49d9ce24ab29a5c09e91dafd667 P be3b58b70fd74625a8ae8dfd7db7f6ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:16:58.091933 29566 log.cc:1199] T 4915f49d9ce24ab29a5c09e91dafd667 P be3b58b70fd74625a8ae8dfd7db7f6ee: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-1-root/wals/4915f49d9ce24ab29a5c09e91dafd667
I20260203 09:16:58.092325 29550 consensus_queue.cc:1048] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:16:58.103246 28807 raft_consensus.cc:1275] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:16:58.104424 28618 catalog_manager.cc:4985] TS be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): tablet 4915f49d9ce24ab29a5c09e91dafd667 (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:16:58.113094 29555 consensus_queue.cc:1048] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:16:58.126451 28883 consensus_queue.cc:237] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:16:58.128525 29556 raft_consensus.cc:2955] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:58.140902 28812 raft_consensus.cc:1275] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:16:58.143867 29464 raft_consensus.cc:2955] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:58.149734 29465 raft_consensus.cc:1275] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:16:58.149904 28619 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 0322ad4122a64f6abccdfb1906919b8e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:16:58.151173 29550 consensus_queue.cc:1048] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:16:58.161949 29550 consensus_queue.cc:1048] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:16:58.163900 28810 raft_consensus.cc:2955] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:58.162534 28635 catalog_manager.cc:5654] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc reported cstate change: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:16:58.183552 29464 raft_consensus.cc:2955] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:58.179704 29556 raft_consensus.cc:2955] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:58.199020 28721 tablet_service.cc:1552] Processing DeleteTablet for tablet 0322ad4122a64f6abccdfb1906919b8e with delete_type TABLET_DATA_TOMBSTONED (TS 847a7af9f0e2497cbb9025cc2c62557e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43606
I20260203 09:16:58.201692 28805 raft_consensus.cc:2955] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:58.222676 28619 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 574d0205e57547c6938037563109a6d2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:16:58.224567 29569 tablet_replica.cc:333] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:16:58.230013 28634 catalog_manager.cc:5654] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:16:58.231165 29569 raft_consensus.cc:2243] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:58.232846 29569 raft_consensus.cc:2272] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:58.241603 29569 ts_tablet_manager.cc:1916] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:16:58.262193 28721 tablet_service.cc:1552] Processing DeleteTablet for tablet 574d0205e57547c6938037563109a6d2 with delete_type TABLET_DATA_TOMBSTONED (TS 847a7af9f0e2497cbb9025cc2c62557e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43606
I20260203 09:16:58.267309 29569 ts_tablet_manager.cc:1929] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:16:58.267881 29569 log.cc:1199] T 0322ad4122a64f6abccdfb1906919b8e P 847a7af9f0e2497cbb9025cc2c62557e: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-0-root/wals/0322ad4122a64f6abccdfb1906919b8e
I20260203 09:16:58.269440 28619 catalog_manager.cc:4985] TS 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): tablet 0322ad4122a64f6abccdfb1906919b8e (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:16:58.270411 29569 tablet_replica.cc:333] T 574d0205e57547c6938037563109a6d2 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:16:58.278685 29569 raft_consensus.cc:2243] T 574d0205e57547c6938037563109a6d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:16:58.279270 29569 raft_consensus.cc:2272] T 574d0205e57547c6938037563109a6d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:16:58.281909 29569 ts_tablet_manager.cc:1916] T 574d0205e57547c6938037563109a6d2 P 847a7af9f0e2497cbb9025cc2c62557e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:16:58.293223 29569 ts_tablet_manager.cc:1929] T 574d0205e57547c6938037563109a6d2 P 847a7af9f0e2497cbb9025cc2c62557e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:16:58.293542 29569 log.cc:1199] T 574d0205e57547c6938037563109a6d2 P 847a7af9f0e2497cbb9025cc2c62557e: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-0-root/wals/574d0205e57547c6938037563109a6d2
I20260203 09:16:58.294754 28619 catalog_manager.cc:4985] TS 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): tablet 574d0205e57547c6938037563109a6d2 (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:16:59.313030 28886 consensus_queue.cc:237] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:16:59.329361 28805 raft_consensus.cc:1275] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260203 09:16:59.329651 28851 consensus_peers.cc:597] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f2a68daf4384c47ba2a6a46ac297f00. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:16:59.333776 28731 raft_consensus.cc:1275] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:16:59.336869 29556 consensus_queue.cc:1048] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:16:59.344242 29500 consensus_queue.cc:1048] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260203 09:16:59.382411 29550 raft_consensus.cc:2955] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:59.398296 28805 raft_consensus.cc:2955] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:59.406385 28738 raft_consensus.cc:2955] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:59.421038 28805 consensus_queue.cc:237] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:16:59.428179 28635 catalog_manager.cc:5654] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
W20260203 09:16:59.444119 28776 consensus_peers.cc:597] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a0b96e8815b1443c99aaa50410b2c6d1. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:16:59.446026 28887 raft_consensus.cc:1275] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:16:59.447096 28731 raft_consensus.cc:1275] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:16:59.448978 29530 consensus_queue.cc:1048] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:59.449890 29279 consensus_queue.cc:1048] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:16:59.459527 29279 raft_consensus.cc:2955] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:59.470954 28883 raft_consensus.cc:2955] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:59.476758 28731 raft_consensus.cc:2955] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:59.530918 28631 catalog_manager.cc:5654] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:59.537227 28883 consensus_queue.cc:237] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:16:59.553939 28731 raft_consensus.cc:1275] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260203 09:16:59.554020 28805 raft_consensus.cc:1275] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260203 09:16:59.555039 28851 consensus_peers.cc:597] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bf838e5b1f6141bfb1cd1bc26a8b0006. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:16:59.555336 29550 consensus_queue.cc:1048] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:16:59.556407 29573 consensus_queue.cc:1048] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:16:59.575639 29550 raft_consensus.cc:2955] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:59.577584 28738 raft_consensus.cc:2955] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:59.579277 28805 raft_consensus.cc:2955] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:59.601437 28631 catalog_manager.cc:5654] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc reported cstate change: config changed from index -1 to 3, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 2 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260203 09:16:59.654332 28738 consensus_queue.cc:237] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:16:59.703114 28883 raft_consensus.cc:1275] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:16:59.704912 29523 consensus_queue.cc:1048] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:16:59.711231 28805 raft_consensus.cc:1275] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:16:59.712805 29523 consensus_queue.cc:1048] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:16:59.716300 29560 raft_consensus.cc:2955] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:59.727035 28883 raft_consensus.cc:2955] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
W20260203 09:16:59.732774 28700 consensus_peers.cc:597] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fabfb779b8894cf0b22204fe12768dc3. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:16:59.738948 28812 raft_consensus.cc:2955] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:59.745626 28631 catalog_manager.cc:5654] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:16:59.920447 29594 ts_tablet_manager.cc:933] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:16:59.933987 29596 ts_tablet_manager.cc:933] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:16:59.940194 29594 tablet_copy_client.cc:323] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.66:41611
I20260203 09:16:59.943404 28823 tablet_copy_service.cc:140] P be3b58b70fd74625a8ae8dfd7db7f6ee: Received BeginTabletCopySession request for tablet a0b96e8815b1443c99aaa50410b2c6d1 from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:50256)
I20260203 09:16:59.944015 28823 tablet_copy_service.cc:161] P be3b58b70fd74625a8ae8dfd7db7f6ee: Beginning new tablet copy session on tablet a0b96e8815b1443c99aaa50410b2c6d1 from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:50256: session id = cf00f643e7da4a98a0a11ea92869c24a-a0b96e8815b1443c99aaa50410b2c6d1
I20260203 09:16:59.952389 28823 tablet_copy_source_session.cc:215] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:16:59.954447 29596 tablet_copy_client.cc:323] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.67:42899
I20260203 09:16:59.959316 28899 tablet_copy_service.cc:140] P 77541303e1934638ba82f0f43f707adc: Received BeginTabletCopySession request for tablet 3f2a68daf4384c47ba2a6a46ac297f00 from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:59280)
I20260203 09:16:59.959939 28899 tablet_copy_service.cc:161] P 77541303e1934638ba82f0f43f707adc: Beginning new tablet copy session on tablet 3f2a68daf4384c47ba2a6a46ac297f00 from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:59280: session id = cf00f643e7da4a98a0a11ea92869c24a-3f2a68daf4384c47ba2a6a46ac297f00
I20260203 09:16:59.968952 29594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0b96e8815b1443c99aaa50410b2c6d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:59.971063 28899 tablet_copy_source_session.cc:215] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:16:59.974814 29596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f2a68daf4384c47ba2a6a46ac297f00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:16:59.996985 29596 tablet_copy_client.cc:806] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:16:59.997778 29596 tablet_copy_client.cc:670] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:00.001318 29594 tablet_copy_client.cc:806] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:00.005668 29596 tablet_copy_client.cc:538] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:00.005734 29594 tablet_copy_client.cc:670] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:00.015667 29594 tablet_copy_client.cc:538] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:00.018077 29596 tablet_bootstrap.cc:492] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:00.042831 29594 tablet_bootstrap.cc:492] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:00.069871 29598 ts_tablet_manager.cc:933] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:00.080453 29598 tablet_copy_client.cc:323] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.67:42899
I20260203 09:17:00.084136 28899 tablet_copy_service.cc:140] P 77541303e1934638ba82f0f43f707adc: Received BeginTabletCopySession request for tablet bf838e5b1f6141bfb1cd1bc26a8b0006 from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:59280)
I20260203 09:17:00.084895 28899 tablet_copy_service.cc:161] P 77541303e1934638ba82f0f43f707adc: Beginning new tablet copy session on tablet bf838e5b1f6141bfb1cd1bc26a8b0006 from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:59280: session id = cf00f643e7da4a98a0a11ea92869c24a-bf838e5b1f6141bfb1cd1bc26a8b0006
I20260203 09:17:00.095438 28899 tablet_copy_source_session.cc:215] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:00.099002 29598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf838e5b1f6141bfb1cd1bc26a8b0006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:00.119131 29598 tablet_copy_client.cc:806] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:00.119853 29598 tablet_copy_client.cc:670] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:00.122323 29596 tablet_bootstrap.cc:492] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:00.123942 29598 tablet_copy_client.cc:538] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:00.128841 29596 tablet_bootstrap.cc:492] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:00.131892 29594 tablet_bootstrap.cc:492] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:00.132959 29594 tablet_bootstrap.cc:492] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:00.132869 29596 ts_tablet_manager.cc:1403] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.115s user 0.022s sys 0.006s
I20260203 09:17:00.135517 29594 ts_tablet_manager.cc:1403] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.093s user 0.035s sys 0.014s
I20260203 09:17:00.140461 29594 raft_consensus.cc:359] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:00.141431 29594 raft_consensus.cc:740] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:00.142140 29594 consensus_queue.cc:260] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:00.140244 29596 raft_consensus.cc:359] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:00.148342 29596 raft_consensus.cc:740] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:00.150146 29596 consensus_queue.cc:260] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:00.185568 29598 tablet_bootstrap.cc:492] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:00.199409 29594 ts_tablet_manager.cc:1434] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.063s user 0.002s sys 0.022s
I20260203 09:17:00.202575 28823 tablet_copy_service.cc:342] P be3b58b70fd74625a8ae8dfd7db7f6ee: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-a0b96e8815b1443c99aaa50410b2c6d1 received from {username='slave'} at 127.0.0.1:50256
I20260203 09:17:00.203065 28823 tablet_copy_service.cc:434] P be3b58b70fd74625a8ae8dfd7db7f6ee: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-a0b96e8815b1443c99aaa50410b2c6d1 on tablet a0b96e8815b1443c99aaa50410b2c6d1 with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:00.214380 29596 ts_tablet_manager.cc:1434] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.080s user 0.027s sys 0.021s
I20260203 09:17:00.216990 29605 ts_tablet_manager.cc:933] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967)
I20260203 09:17:00.217617 28899 tablet_copy_service.cc:342] P 77541303e1934638ba82f0f43f707adc: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-3f2a68daf4384c47ba2a6a46ac297f00 received from {username='slave'} at 127.0.0.1:59280
I20260203 09:17:00.218047 28899 tablet_copy_service.cc:434] P 77541303e1934638ba82f0f43f707adc: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-3f2a68daf4384c47ba2a6a46ac297f00 on tablet 3f2a68daf4384c47ba2a6a46ac297f00 with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:00.244809 29605 tablet_copy_client.cc:323] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.65:37967
I20260203 09:17:00.278100 28748 tablet_copy_service.cc:140] P 847a7af9f0e2497cbb9025cc2c62557e: Received BeginTabletCopySession request for tablet fabfb779b8894cf0b22204fe12768dc3 from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:45044)
I20260203 09:17:00.278764 28748 tablet_copy_service.cc:161] P 847a7af9f0e2497cbb9025cc2c62557e: Beginning new tablet copy session on tablet fabfb779b8894cf0b22204fe12768dc3 from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:45044: session id = cf00f643e7da4a98a0a11ea92869c24a-fabfb779b8894cf0b22204fe12768dc3
I20260203 09:17:00.287035 28748 tablet_copy_source_session.cc:215] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:00.292424 29598 tablet_bootstrap.cc:492] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:00.295164 29598 tablet_bootstrap.cc:492] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:00.295796 29605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fabfb779b8894cf0b22204fe12768dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:00.296803 29598 ts_tablet_manager.cc:1403] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.112s user 0.024s sys 0.008s
I20260203 09:17:00.299906 29598 raft_consensus.cc:359] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:00.300801 29598 raft_consensus.cc:740] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:00.301496 29598 consensus_queue.cc:260] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:00.307610 29598 ts_tablet_manager.cc:1434] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20260203 09:17:00.309705 28899 tablet_copy_service.cc:342] P 77541303e1934638ba82f0f43f707adc: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-bf838e5b1f6141bfb1cd1bc26a8b0006 received from {username='slave'} at 127.0.0.1:59280
I20260203 09:17:00.310170 28899 tablet_copy_service.cc:434] P 77541303e1934638ba82f0f43f707adc: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-bf838e5b1f6141bfb1cd1bc26a8b0006 on tablet bf838e5b1f6141bfb1cd1bc26a8b0006 with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:00.334753 29605 tablet_copy_client.cc:806] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:00.336423 29605 tablet_copy_client.cc:670] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:00.340803 29605 tablet_copy_client.cc:538] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:00.351125 29464 raft_consensus.cc:1217] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:17:00.359843 29605 tablet_bootstrap.cc:492] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:00.411104 29605 tablet_bootstrap.cc:492] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:00.412249 29605 tablet_bootstrap.cc:492] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:00.413411 29605 ts_tablet_manager.cc:1403] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.054s user 0.016s sys 0.015s
I20260203 09:17:00.427217 29605 raft_consensus.cc:359] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:00.431375 29605 raft_consensus.cc:740] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:00.432292 29605 consensus_queue.cc:260] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:00.454902 29605 ts_tablet_manager.cc:1434] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.036s user 0.004s sys 0.005s
W20260203 09:17:00.455822 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 54548.6us
I20260203 09:17:00.459944 28748 tablet_copy_service.cc:342] P 847a7af9f0e2497cbb9025cc2c62557e: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-fabfb779b8894cf0b22204fe12768dc3 received from {username='slave'} at 127.0.0.1:45044
I20260203 09:17:00.460721 28748 tablet_copy_service.cc:434] P 847a7af9f0e2497cbb9025cc2c62557e: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-fabfb779b8894cf0b22204fe12768dc3 on tablet fabfb779b8894cf0b22204fe12768dc3 with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:00.491094 29464 raft_consensus.cc:1217] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:17:00.580819 29464 raft_consensus.cc:1217] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20260203 09:17:00.768481 29464 raft_consensus.cc:1217] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:17:00.966888 29613 raft_consensus.cc:1064] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:00.976323 29550 raft_consensus.cc:1064] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:00.975718 29613 consensus_queue.cc:237] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:00.980198 29550 consensus_queue.cc:237] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:01.004576 29464 raft_consensus.cc:1275] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:01.011786 29464 raft_consensus.cc:1275] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:01.013567 29573 consensus_queue.cc:1048] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:17:01.014108 28731 raft_consensus.cc:1275] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:01.019773 29573 consensus_queue.cc:1048] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:01.030583 28885 raft_consensus.cc:1275] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:01.019826 29616 consensus_queue.cc:1048] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260203 09:17:01.067319 28738 raft_consensus.cc:1275] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:01.081670 29613 consensus_queue.cc:1048] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:01.102885 29582 consensus_queue.cc:1048] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:17:01.108691 28807 raft_consensus.cc:1275] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:01.112315 29611 raft_consensus.cc:2955] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:01.117348 28730 raft_consensus.cc:2955] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:01.127265 29612 raft_consensus.cc:1064] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:01.130709 29612 consensus_queue.cc:237] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:01.138547 29576 consensus_queue.cc:1048] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:17:01.142087 29464 raft_consensus.cc:2955] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:01.172626 28635 catalog_manager.cc:5654] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:01.189495 28730 raft_consensus.cc:1275] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260203 09:17:01.190397 29463 raft_consensus.cc:1275] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEARNER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260203 09:17:01.196606 29560 raft_consensus.cc:1064] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:01.202487 29573 consensus_queue.cc:1048] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:17:01.206447 29560 consensus_queue.cc:237] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:01.207891 29576 consensus_queue.cc:1048] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:01.206784 29530 raft_consensus.cc:2955] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:01.219030 28812 raft_consensus.cc:1275] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260203 09:17:01.242802 28885 raft_consensus.cc:2955] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:01.254709 29463 raft_consensus.cc:2955] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:01.240190 29611 consensus_queue.cc:1048] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260203 09:17:01.229236 28807 raft_consensus.cc:2955] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:01.273892 28732 raft_consensus.cc:2955] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:01.284498 29465 raft_consensus.cc:1275] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:01.291247 28886 raft_consensus.cc:1275] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:01.293277 29614 consensus_queue.cc:1048] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:17:01.294643 28812 raft_consensus.cc:1275] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:01.302922 29626 raft_consensus.cc:2955] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:01.306203 29465 raft_consensus.cc:2955] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:01.314885 29614 consensus_queue.cc:1048] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:17:01.338393 29560 consensus_queue.cc:1048] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260203 09:17:01.361522 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 47366.7us
W20260203 09:17:01.657307 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 81111.6us
I20260203 09:17:01.692013 29614 raft_consensus.cc:2955] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:02.055575 28635 catalog_manager.cc:5654] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:02.065002 28635 catalog_manager.cc:5654] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: config changed from index 3 to 4, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:02.114231 28806 raft_consensus.cc:2955] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:02.123575 28810 raft_consensus.cc:2955] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:02.139467 29464 raft_consensus.cc:2955] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:02.195149 28737 raft_consensus.cc:2955] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:02.258555 28634 catalog_manager.cc:5654] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:02.273394 28885 consensus_queue.cc:237] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:02.293262 28810 consensus_queue.cc:237] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:02.312505 28738 raft_consensus.cc:1275] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:02.315017 29576 consensus_queue.cc:1048] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:02.319690 29465 raft_consensus.cc:1275] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:02.321238 29648 consensus_queue.cc:1048] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:17:02.326359 29576 raft_consensus.cc:2955] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:02.338658 28738 raft_consensus.cc:2955] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:02.341789 28619 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 3f2a68daf4384c47ba2a6a46ac297f00 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:02.345768 29464 raft_consensus.cc:1275] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:02.354889 29465 raft_consensus.cc:2955] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:02.357210 28882 consensus_queue.cc:237] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:02.359006 29616 consensus_queue.cc:1048] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:02.370041 29464 raft_consensus.cc:1275] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:02.371737 29626 consensus_queue.cc:1048] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:02.372632 28631 catalog_manager.cc:5654] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:02.383399 28810 raft_consensus.cc:1275] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:02.389039 28802 tablet_service.cc:1552] Processing DeleteTablet for tablet 3f2a68daf4384c47ba2a6a46ac297f00 with delete_type TABLET_DATA_TOMBSTONED (TS be3b58b70fd74625a8ae8dfd7db7f6ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36384
I20260203 09:17:02.389942 29648 consensus_queue.cc:1048] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:02.399217 29576 raft_consensus.cc:2955] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:02.397473 29465 raft_consensus.cc:2955] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:02.414486 28810 raft_consensus.cc:2955] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:02.422750 28882 raft_consensus.cc:2955] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:02.424638 28738 raft_consensus.cc:1275] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:02.479924 28738 consensus_queue.cc:237] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:02.495528 28631 catalog_manager.cc:5654] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: config changed from index 4 to 5, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New cstate: current_term: 2 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:02.472456 29665 tablet_replica.cc:333] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:02.489881 29582 consensus_queue.cc:1048] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:02.493166 28619 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet bf838e5b1f6141bfb1cd1bc26a8b0006 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:02.499075 29665 raft_consensus.cc:2243] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:02.500702 29665 raft_consensus.cc:2272] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:02.504982 29530 raft_consensus.cc:2955] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:02.514426 29465 raft_consensus.cc:1275] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:02.518030 29651 consensus_queue.cc:1048] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:17:02.528616 28882 raft_consensus.cc:1275] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:02.531100 28618 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet a0b96e8815b1443c99aaa50410b2c6d1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:02.534974 29665 ts_tablet_manager.cc:1916] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:02.540737 29635 raft_consensus.cc:2955] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:02.545950 28721 tablet_service.cc:1552] Processing DeleteTablet for tablet bf838e5b1f6141bfb1cd1bc26a8b0006 with delete_type TABLET_DATA_TOMBSTONED (TS 847a7af9f0e2497cbb9025cc2c62557e not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:43606
I20260203 09:17:02.552862 29465 raft_consensus.cc:2955] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:02.559691 29463 raft_consensus.cc:2955] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:02.565860 29560 consensus_queue.cc:1048] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:02.559092 28619 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet fabfb779b8894cf0b22204fe12768dc3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:02.574774 29667 tablet_replica.cc:333] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:02.582759 29667 raft_consensus.cc:2243] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:02.584175 29667 raft_consensus.cc:2272] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:02.583303 28634 catalog_manager.cc:5654] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:02.574023 28635 catalog_manager.cc:5654] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:02.595033 29665 ts_tablet_manager.cc:1929] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:17:02.595767 29665 log.cc:1199] T 3f2a68daf4384c47ba2a6a46ac297f00 P be3b58b70fd74625a8ae8dfd7db7f6ee: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-1-root/wals/3f2a68daf4384c47ba2a6a46ac297f00
I20260203 09:17:02.596441 29667 ts_tablet_manager.cc:1916] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:02.598049 28618 catalog_manager.cc:4985] TS be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): tablet 3f2a68daf4384c47ba2a6a46ac297f00 (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
W20260203 09:17:02.602937 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 77515.7us
I20260203 09:17:02.614998 28802 tablet_service.cc:1552] Processing DeleteTablet for tablet fabfb779b8894cf0b22204fe12768dc3 with delete_type TABLET_DATA_TOMBSTONED (TS be3b58b70fd74625a8ae8dfd7db7f6ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36384
I20260203 09:17:02.624295 28730 raft_consensus.cc:2955] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:02.629280 29665 tablet_replica.cc:333] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:02.642031 29665 raft_consensus.cc:2243] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:02.642886 29665 raft_consensus.cc:2272] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:02.635610 29667 ts_tablet_manager.cc:1929] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260203 09:17:02.647320 29665 ts_tablet_manager.cc:1916] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:02.651885 28872 tablet_service.cc:1552] Processing DeleteTablet for tablet a0b96e8815b1443c99aaa50410b2c6d1 with delete_type TABLET_DATA_TOMBSTONED (TS 77541303e1934638ba82f0f43f707adc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40930
I20260203 09:17:02.643798 28888 raft_consensus.cc:2955] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:02.651969 29667 log.cc:1199] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 847a7af9f0e2497cbb9025cc2c62557e: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-0-root/wals/bf838e5b1f6141bfb1cd1bc26a8b0006
I20260203 09:17:02.660820 28619 catalog_manager.cc:4985] TS 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): tablet bf838e5b1f6141bfb1cd1bc26a8b0006 (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:17:02.683939 29669 tablet_replica.cc:333] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:02.685212 29669 raft_consensus.cc:2243] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:02.686105 29669 raft_consensus.cc:2272] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:02.702292 29669 ts_tablet_manager.cc:1916] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:02.717701 29665 ts_tablet_manager.cc:1929] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:17:02.718209 29665 log.cc:1199] T fabfb779b8894cf0b22204fe12768dc3 P be3b58b70fd74625a8ae8dfd7db7f6ee: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-1-root/wals/fabfb779b8894cf0b22204fe12768dc3
I20260203 09:17:02.719782 28618 catalog_manager.cc:4985] TS be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): tablet fabfb779b8894cf0b22204fe12768dc3 (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:17:02.740983 29669 ts_tablet_manager.cc:1929] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:17:02.741495 29669 log.cc:1199] T a0b96e8815b1443c99aaa50410b2c6d1 P 77541303e1934638ba82f0f43f707adc: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-2-root/wals/a0b96e8815b1443c99aaa50410b2c6d1
I20260203 09:17:02.743570 28619 catalog_manager.cc:4985] TS 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): tablet a0b96e8815b1443c99aaa50410b2c6d1 (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
W20260203 09:17:02.765336 28666 debug-util.cc:398] Leaking SignalData structure 0x7b080023c7e0 after lost signal to thread 27556
W20260203 09:17:02.766436 28666 debug-util.cc:398] Leaking SignalData structure 0x7b08001f39c0 after lost signal to thread 28669
W20260203 09:17:02.767519 28666 debug-util.cc:398] Leaking SignalData structure 0x7b0800091ee0 after lost signal to thread 28762
W20260203 09:17:02.768481 28666 debug-util.cc:398] Leaking SignalData structure 0x7b0800239be0 after lost signal to thread 28838
W20260203 09:17:02.769488 28666 debug-util.cc:398] Leaking SignalData structure 0x7b08001f3380 after lost signal to thread 28913
W20260203 09:17:02.770466 28666 debug-util.cc:398] Leaking SignalData structure 0x7b08002c27a0 after lost signal to thread 29491
W20260203 09:17:02.770979 28666 debug-util.cc:398] Leaking SignalData structure 0x7b0800282340 after lost signal to thread 29625
I20260203 09:17:03.651590 28812 consensus_queue.cc:237] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
W20260203 09:17:03.658897 28776 consensus_peers.cc:597] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f4da79410aa74f5abca9517bbae98420. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:03.660373 28882 raft_consensus.cc:1275] T f4da79410aa74f5abca9517bbae98420 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:03.660913 28738 raft_consensus.cc:1275] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:03.663170 29671 consensus_queue.cc:1048] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:03.664911 29616 consensus_queue.cc:1048] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:17:03.691431 29616 raft_consensus.cc:2955] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:03.709709 28889 raft_consensus.cc:2955] T f4da79410aa74f5abca9517bbae98420 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:03.729185 28633 catalog_manager.cc:5654] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:03.730108 28738 raft_consensus.cc:2955] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:03.722990 28806 consensus_queue.cc:237] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
W20260203 09:17:03.820593 28776 consensus_peers.cc:597] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b149dd40ec15465299cdb910e5385206. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:03.829532 28738 raft_consensus.cc:1275] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:03.830804 28882 raft_consensus.cc:1275] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:03.845232 29616 consensus_queue.cc:1048] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:17:03.866046 29616 consensus_queue.cc:1048] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:17:03.891391 29582 raft_consensus.cc:2955] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:03.906807 28882 raft_consensus.cc:2955] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:03.920267 28888 consensus_queue.cc:237] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:03.920941 28738 raft_consensus.cc:2955] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:03.915827 28635 catalog_manager.cc:5654] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:03.953835 28738 raft_consensus.cc:1275] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:03.954208 28812 raft_consensus.cc:1275] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:03.955358 29648 consensus_queue.cc:1048] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260203 09:17:03.957700 28851 consensus_peers.cc:597] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9fcb41fb74694d87acc7c8963bdf4bcf. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:03.959095 29648 consensus_queue.cc:1048] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:03.970634 29612 raft_consensus.cc:2955] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:03.972793 28812 raft_consensus.cc:2955] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:03.983177 28730 raft_consensus.cc:2955] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:04.027793 28635 catalog_manager.cc:5654] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:04.032698 28738 consensus_queue.cc:237] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
W20260203 09:17:04.048199 28700 consensus_peers.cc:597] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fba8b1b8685b431e8328cdb7df4ad1d0. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:04.055719 28812 raft_consensus.cc:1275] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:04.057454 29682 consensus_queue.cc:1048] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:04.088443 28882 raft_consensus.cc:1275] T fba8b1b8685b431e8328cdb7df4ad1d0 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:04.093820 29682 consensus_queue.cc:1048] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260203 09:17:04.105316 29656 raft_consensus.cc:2955] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:04.109925 28812 raft_consensus.cc:2955] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:04.124302 28882 raft_consensus.cc:2955] T fba8b1b8685b431e8328cdb7df4ad1d0 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:04.133533 28635 catalog_manager.cc:5654] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:04.149685 29694 ts_tablet_manager.cc:933] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:04.165673 29694 tablet_copy_client.cc:323] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.66:41611
I20260203 09:17:04.167647 28823 tablet_copy_service.cc:140] P be3b58b70fd74625a8ae8dfd7db7f6ee: Received BeginTabletCopySession request for tablet f4da79410aa74f5abca9517bbae98420 from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:50256)
I20260203 09:17:04.168236 28823 tablet_copy_service.cc:161] P be3b58b70fd74625a8ae8dfd7db7f6ee: Beginning new tablet copy session on tablet f4da79410aa74f5abca9517bbae98420 from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:50256: session id = cf00f643e7da4a98a0a11ea92869c24a-f4da79410aa74f5abca9517bbae98420
I20260203 09:17:04.176265 28823 tablet_copy_source_session.cc:215] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:04.188153 29694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4da79410aa74f5abca9517bbae98420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:04.211730 29694 tablet_copy_client.cc:806] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:04.212483 29694 tablet_copy_client.cc:670] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:04.216800 29694 tablet_copy_client.cc:538] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:04.227092 29694 tablet_bootstrap.cc:492] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:04.263911 29694 tablet_bootstrap.cc:492] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:04.264703 29694 tablet_bootstrap.cc:492] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:04.265419 29694 ts_tablet_manager.cc:1403] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.039s user 0.023s sys 0.012s
I20260203 09:17:04.267894 29694 raft_consensus.cc:359] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:04.268859 29694 raft_consensus.cc:740] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:04.269634 29694 consensus_queue.cc:260] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:04.279906 29694 ts_tablet_manager.cc:1434] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.014s user 0.004s sys 0.008s
I20260203 09:17:04.284509 28823 tablet_copy_service.cc:342] P be3b58b70fd74625a8ae8dfd7db7f6ee: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-f4da79410aa74f5abca9517bbae98420 received from {username='slave'} at 127.0.0.1:50256
I20260203 09:17:04.285049 28823 tablet_copy_service.cc:434] P be3b58b70fd74625a8ae8dfd7db7f6ee: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-f4da79410aa74f5abca9517bbae98420 on tablet f4da79410aa74f5abca9517bbae98420 with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:04.328928 29694 ts_tablet_manager.cc:933] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:04.330792 29694 tablet_copy_client.cc:323] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.67:42899
I20260203 09:17:04.332485 28899 tablet_copy_service.cc:140] P 77541303e1934638ba82f0f43f707adc: Received BeginTabletCopySession request for tablet 9fcb41fb74694d87acc7c8963bdf4bcf from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:59280)
I20260203 09:17:04.332983 28899 tablet_copy_service.cc:161] P 77541303e1934638ba82f0f43f707adc: Beginning new tablet copy session on tablet 9fcb41fb74694d87acc7c8963bdf4bcf from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:59280: session id = cf00f643e7da4a98a0a11ea92869c24a-9fcb41fb74694d87acc7c8963bdf4bcf
I20260203 09:17:04.341353 28899 tablet_copy_source_session.cc:215] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:04.344067 29694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fcb41fb74694d87acc7c8963bdf4bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:04.382663 29699 ts_tablet_manager.cc:933] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:04.385774 29699 tablet_copy_client.cc:323] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.66:41611
I20260203 09:17:04.387049 28823 tablet_copy_service.cc:140] P be3b58b70fd74625a8ae8dfd7db7f6ee: Received BeginTabletCopySession request for tablet b149dd40ec15465299cdb910e5385206 from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:50256)
I20260203 09:17:04.387476 28823 tablet_copy_service.cc:161] P be3b58b70fd74625a8ae8dfd7db7f6ee: Beginning new tablet copy session on tablet b149dd40ec15465299cdb910e5385206 from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:50256: session id = cf00f643e7da4a98a0a11ea92869c24a-b149dd40ec15465299cdb910e5385206
I20260203 09:17:04.394829 28823 tablet_copy_source_session.cc:215] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:04.397986 29694 tablet_copy_client.cc:806] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:04.403143 29694 tablet_copy_client.cc:670] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:04.402150 29699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b149dd40ec15465299cdb910e5385206. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:04.409835 29694 tablet_copy_client.cc:538] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:04.423770 29694 tablet_bootstrap.cc:492] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:04.438602 29699 tablet_copy_client.cc:806] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:04.439261 29699 tablet_copy_client.cc:670] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:04.456146 29694 tablet_bootstrap.cc:492] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:04.456528 29699 tablet_copy_client.cc:538] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:04.457089 29694 tablet_bootstrap.cc:492] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:04.457988 29694 ts_tablet_manager.cc:1403] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.034s user 0.021s sys 0.012s
I20260203 09:17:04.460958 29694 raft_consensus.cc:359] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:04.461798 29694 raft_consensus.cc:740] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:04.462430 29694 consensus_queue.cc:260] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:04.472828 29694 ts_tablet_manager.cc:1434] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.015s user 0.005s sys 0.001s
I20260203 09:17:04.477120 28899 tablet_copy_service.cc:342] P 77541303e1934638ba82f0f43f707adc: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-9fcb41fb74694d87acc7c8963bdf4bcf received from {username='slave'} at 127.0.0.1:59280
I20260203 09:17:04.477579 28899 tablet_copy_service.cc:434] P 77541303e1934638ba82f0f43f707adc: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-9fcb41fb74694d87acc7c8963bdf4bcf on tablet 9fcb41fb74694d87acc7c8963bdf4bcf with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:04.496109 29699 tablet_bootstrap.cc:492] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:04.503764 29694 ts_tablet_manager.cc:933] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967)
I20260203 09:17:04.532495 29694 tablet_copy_client.cc:323] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.65:37967
I20260203 09:17:04.534387 28748 tablet_copy_service.cc:140] P 847a7af9f0e2497cbb9025cc2c62557e: Received BeginTabletCopySession request for tablet fba8b1b8685b431e8328cdb7df4ad1d0 from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:45044)
I20260203 09:17:04.534971 28748 tablet_copy_service.cc:161] P 847a7af9f0e2497cbb9025cc2c62557e: Beginning new tablet copy session on tablet fba8b1b8685b431e8328cdb7df4ad1d0 from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:45044: session id = cf00f643e7da4a98a0a11ea92869c24a-fba8b1b8685b431e8328cdb7df4ad1d0
I20260203 09:17:04.538653 29699 tablet_bootstrap.cc:492] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:04.539763 29699 tablet_bootstrap.cc:492] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:04.540413 29699 ts_tablet_manager.cc:1403] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.045s user 0.015s sys 0.014s
I20260203 09:17:04.543370 29699 raft_consensus.cc:359] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:04.544160 29699 raft_consensus.cc:740] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:04.544963 29699 consensus_queue.cc:260] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:04.547406 29699 ts_tablet_manager.cc:1434] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260203 09:17:04.549111 28748 tablet_copy_source_session.cc:215] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:04.549889 28823 tablet_copy_service.cc:342] P be3b58b70fd74625a8ae8dfd7db7f6ee: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-b149dd40ec15465299cdb910e5385206 received from {username='slave'} at 127.0.0.1:50256
I20260203 09:17:04.550376 28823 tablet_copy_service.cc:434] P be3b58b70fd74625a8ae8dfd7db7f6ee: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-b149dd40ec15465299cdb910e5385206 on tablet b149dd40ec15465299cdb910e5385206 with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:04.553349 29694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fba8b1b8685b431e8328cdb7df4ad1d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:04.575556 29694 tablet_copy_client.cc:806] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:04.576113 29694 tablet_copy_client.cc:670] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:04.588776 29694 tablet_copy_client.cc:538] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:04.599442 29694 tablet_bootstrap.cc:492] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:04.618216 29694 tablet_bootstrap.cc:492] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:04.619230 29694 tablet_bootstrap.cc:492] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:04.619859 29694 ts_tablet_manager.cc:1403] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.021s user 0.015s sys 0.002s
I20260203 09:17:04.622282 29694 raft_consensus.cc:359] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:04.623039 29694 raft_consensus.cc:740] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:04.623620 29694 consensus_queue.cc:260] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:04.625797 29694 ts_tablet_manager.cc:1434] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260203 09:17:04.627430 28748 tablet_copy_service.cc:342] P 847a7af9f0e2497cbb9025cc2c62557e: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-fba8b1b8685b431e8328cdb7df4ad1d0 received from {username='slave'} at 127.0.0.1:45044
I20260203 09:17:04.627878 28748 tablet_copy_service.cc:434] P 847a7af9f0e2497cbb9025cc2c62557e: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-fba8b1b8685b431e8328cdb7df4ad1d0 on tablet fba8b1b8685b431e8328cdb7df4ad1d0 with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:04.733641 29463 raft_consensus.cc:1217] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:17:04.797933 29463 raft_consensus.cc:1217] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:17:04.886555 29463 raft_consensus.cc:1217] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:17:05.114225 29463 raft_consensus.cc:1217] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:17:05.125231 29674 raft_consensus.cc:1064] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:05.127641 29674 consensus_queue.cc:237] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:05.135718 28889 raft_consensus.cc:1275] T f4da79410aa74f5abca9517bbae98420 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:05.135735 28738 raft_consensus.cc:1275] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:05.135814 29463 raft_consensus.cc:1275] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:05.137658 29674 consensus_queue.cc:1048] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:05.138607 29671 consensus_queue.cc:1048] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:05.139477 29582 consensus_queue.cc:1048] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:05.158049 29582 raft_consensus.cc:2955] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.161455 28738 raft_consensus.cc:2955] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.161988 29463 raft_consensus.cc:2955] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.182384 28882 raft_consensus.cc:2955] T f4da79410aa74f5abca9517bbae98420 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.183147 28633 catalog_manager.cc:5654] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:05.228099 28812 consensus_queue.cc:237] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:05.236464 29463 raft_consensus.cc:1275] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:05.236992 28738 raft_consensus.cc:1275] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:05.238904 29710 consensus_queue.cc:1048] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:05.242761 29706 consensus_queue.cc:1048] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:05.246253 29582 raft_consensus.cc:2955] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.250766 29463 raft_consensus.cc:2955] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.252103 28730 raft_consensus.cc:2955] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.259750 28618 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet f4da79410aa74f5abca9517bbae98420 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:05.270879 28631 catalog_manager.cc:5654] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:05.288151 28872 tablet_service.cc:1552] Processing DeleteTablet for tablet f4da79410aa74f5abca9517bbae98420 with delete_type TABLET_DATA_TOMBSTONED (TS 77541303e1934638ba82f0f43f707adc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40930
I20260203 09:17:05.306825 29715 tablet_replica.cc:333] T f4da79410aa74f5abca9517bbae98420 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:05.308050 29690 raft_consensus.cc:1064] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:05.310305 29690 consensus_queue.cc:237] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:05.319087 29715 raft_consensus.cc:2243] T f4da79410aa74f5abca9517bbae98420 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:05.318614 29463 raft_consensus.cc:1275] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:05.321566 29648 consensus_queue.cc:1048] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:05.322507 29715 raft_consensus.cc:2272] T f4da79410aa74f5abca9517bbae98420 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:05.326454 28812 raft_consensus.cc:1275] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:05.327821 28730 raft_consensus.cc:1275] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:05.328284 29690 consensus_queue.cc:1048] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:17:05.329775 29648 consensus_queue.cc:1048] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:05.331688 29715 ts_tablet_manager.cc:1916] T f4da79410aa74f5abca9517bbae98420 P 77541303e1934638ba82f0f43f707adc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:05.365235 29715 ts_tablet_manager.cc:1929] T f4da79410aa74f5abca9517bbae98420 P 77541303e1934638ba82f0f43f707adc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:17:05.365900 29715 log.cc:1199] T f4da79410aa74f5abca9517bbae98420 P 77541303e1934638ba82f0f43f707adc: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-2-root/wals/f4da79410aa74f5abca9517bbae98420
I20260203 09:17:05.368099 28619 catalog_manager.cc:4985] TS 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): tablet f4da79410aa74f5abca9517bbae98420 (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:17:05.369879 29674 raft_consensus.cc:1064] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:05.366848 29648 raft_consensus.cc:2955] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.372637 29674 consensus_queue.cc:237] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:05.378420 28738 raft_consensus.cc:2955] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.380220 28812 raft_consensus.cc:2955] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.384047 29463 raft_consensus.cc:2955] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.397773 28634 catalog_manager.cc:5654] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.401214 29465 raft_consensus.cc:1275] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:05.405267 29582 consensus_queue.cc:1048] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:05.409109 28738 raft_consensus.cc:1275] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:05.409770 28889 raft_consensus.cc:1275] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:05.419713 29582 consensus_queue.cc:1048] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:05.421057 29671 consensus_queue.cc:1048] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260203 09:17:05.470793 28889 consensus_queue.cc:237] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:05.473052 29674 raft_consensus.cc:2955] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.494105 29463 raft_consensus.cc:1275] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:05.496001 29648 consensus_queue.cc:1048] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:05.498448 28737 raft_consensus.cc:1275] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:05.499500 28738 raft_consensus.cc:2955] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.499972 28635 catalog_manager.cc:5654] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:05.506973 29648 raft_consensus.cc:2955] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.508720 29721 consensus_queue.cc:1048] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:17:05.514986 28730 raft_consensus.cc:2955] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.516034 29463 raft_consensus.cc:2955] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.507728 29465 raft_consensus.cc:2955] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.520695 29679 raft_consensus.cc:1064] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:05.523440 29679 consensus_queue.cc:237] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:05.538774 28883 raft_consensus.cc:2955] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.547598 28812 consensus_queue.cc:237] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:05.555346 29465 raft_consensus.cc:1275] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:05.555658 28634 catalog_manager.cc:5654] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.558195 29464 raft_consensus.cc:1275] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:05.559734 29725 consensus_queue.cc:1048] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:17:05.560925 29656 consensus_queue.cc:1048] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:05.569314 28885 raft_consensus.cc:1275] T fba8b1b8685b431e8328cdb7df4ad1d0 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:05.571628 29682 consensus_queue.cc:1048] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:05.571753 29674 raft_consensus.cc:2955] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.579766 28888 raft_consensus.cc:1275] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:05.579131 29464 raft_consensus.cc:2955] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.585021 28619 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 9fcb41fb74694d87acc7c8963bdf4bcf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:05.586081 28812 raft_consensus.cc:1275] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:05.598948 29679 consensus_queue.cc:1048] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:17:05.606736 28802 tablet_service.cc:1552] Processing DeleteTablet for tablet 9fcb41fb74694d87acc7c8963bdf4bcf with delete_type TABLET_DATA_TOMBSTONED (TS be3b58b70fd74625a8ae8dfd7db7f6ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36384
I20260203 09:17:05.606933 29725 consensus_queue.cc:1048] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:05.613504 28618 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet b149dd40ec15465299cdb910e5385206 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:05.637142 28635 catalog_manager.cc:5654] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:05.639803 29656 raft_consensus.cc:2955] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.643363 29463 raft_consensus.cc:2955] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.647217 28883 raft_consensus.cc:2955] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.652351 29732 tablet_replica.cc:333] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:05.652861 28810 raft_consensus.cc:2955] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.654685 29732 raft_consensus.cc:2243] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:05.656287 29732 raft_consensus.cc:2272] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:05.662043 29732 ts_tablet_manager.cc:1916] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:05.674430 28721 tablet_service.cc:1552] Processing DeleteTablet for tablet b149dd40ec15465299cdb910e5385206 with delete_type TABLET_DATA_TOMBSTONED (TS 847a7af9f0e2497cbb9025cc2c62557e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43606
I20260203 09:17:05.684973 28635 catalog_manager.cc:5654] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.680446 28889 raft_consensus.cc:2955] T fba8b1b8685b431e8328cdb7df4ad1d0 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.735426 29735 tablet_replica.cc:333] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:05.737846 29735 raft_consensus.cc:2243] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:05.738739 29735 raft_consensus.cc:2272] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:05.735401 29732 ts_tablet_manager.cc:1929] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:17:05.739663 29732 log.cc:1199] T 9fcb41fb74694d87acc7c8963bdf4bcf P be3b58b70fd74625a8ae8dfd7db7f6ee: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-1-root/wals/9fcb41fb74694d87acc7c8963bdf4bcf
I20260203 09:17:05.753145 28618 catalog_manager.cc:4985] TS be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): tablet 9fcb41fb74694d87acc7c8963bdf4bcf (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:17:05.763832 29735 ts_tablet_manager.cc:1916] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:05.783939 29735 ts_tablet_manager.cc:1929] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:17:05.784551 29735 log.cc:1199] T b149dd40ec15465299cdb910e5385206 P 847a7af9f0e2497cbb9025cc2c62557e: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-0-root/wals/b149dd40ec15465299cdb910e5385206
I20260203 09:17:05.793054 28619 catalog_manager.cc:4985] TS 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): tablet b149dd40ec15465299cdb910e5385206 (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:17:05.795943 28730 consensus_queue.cc:237] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:05.800890 29463 raft_consensus.cc:1275] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:05.802115 28812 raft_consensus.cc:1275] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:05.802398 29679 consensus_queue.cc:1048] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:05.803547 29656 consensus_queue.cc:1048] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:05.810808 29463 raft_consensus.cc:2955] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.811650 28812 raft_consensus.cc:2955] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.808965 29679 raft_consensus.cc:2955] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.827344 28635 catalog_manager.cc:5654] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:05.836567 28619 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet fba8b1b8685b431e8328cdb7df4ad1d0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:05.839555 28872 tablet_service.cc:1552] Processing DeleteTablet for tablet fba8b1b8685b431e8328cdb7df4ad1d0 with delete_type TABLET_DATA_TOMBSTONED (TS 77541303e1934638ba82f0f43f707adc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40930
I20260203 09:17:05.840350 29715 tablet_replica.cc:333] T fba8b1b8685b431e8328cdb7df4ad1d0 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:05.842489 29715 raft_consensus.cc:2243] T fba8b1b8685b431e8328cdb7df4ad1d0 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:05.843216 29715 raft_consensus.cc:2272] T fba8b1b8685b431e8328cdb7df4ad1d0 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:05.850226 29715 ts_tablet_manager.cc:1916] T fba8b1b8685b431e8328cdb7df4ad1d0 P 77541303e1934638ba82f0f43f707adc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:05.870723 29715 ts_tablet_manager.cc:1929] T fba8b1b8685b431e8328cdb7df4ad1d0 P 77541303e1934638ba82f0f43f707adc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:17:05.871044 29715 log.cc:1199] T fba8b1b8685b431e8328cdb7df4ad1d0 P 77541303e1934638ba82f0f43f707adc: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-2-root/wals/fba8b1b8685b431e8328cdb7df4ad1d0
I20260203 09:17:05.872253 28619 catalog_manager.cc:4985] TS 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): tablet fba8b1b8685b431e8328cdb7df4ad1d0 (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:17:06.931531 28810 consensus_queue.cc:237] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:06.937424 28737 raft_consensus.cc:1275] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:06.937650 28889 raft_consensus.cc:1275] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260203 09:17:06.937707 28776 consensus_peers.cc:597] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eac7b86aa8d340e3a4d61a5c982b1f2e. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:06.938779 29737 consensus_queue.cc:1048] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:06.939468 29710 consensus_queue.cc:1048] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:06.946717 29706 raft_consensus.cc:2955] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:06.949627 28737 raft_consensus.cc:2955] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:06.948840 28889 raft_consensus.cc:2955] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:06.962482 28883 consensus_queue.cc:237] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:06.969720 28635 catalog_manager.cc:5654] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:06.986618 28810 raft_consensus.cc:1275] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260203 09:17:06.987197 28851 consensus_peers.cc:597] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 438ed0267e3148da951c6dc25761c745. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:06.987486 28737 raft_consensus.cc:1275] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:06.988941 29738 consensus_queue.cc:1048] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:06.990672 29722 consensus_queue.cc:1048] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:07.003042 29738 raft_consensus.cc:2955] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:07.004859 28810 raft_consensus.cc:2955] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:07.007722 28732 raft_consensus.cc:2955] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:07.026333 28634 catalog_manager.cc:5654] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:07.037681 28883 consensus_queue.cc:237] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
W20260203 09:17:07.055464 28851 consensus_peers.cc:597] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c13ab397c8524e6ca30e36e5fca2ff35. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:07.058086 28737 raft_consensus.cc:1275] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:07.058086 28810 raft_consensus.cc:1275] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:07.059427 29751 consensus_queue.cc:1048] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:07.060310 29750 consensus_queue.cc:1048] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:07.069540 29721 raft_consensus.cc:2955] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:07.076200 28812 raft_consensus.cc:2955] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:07.079943 28737 raft_consensus.cc:2955] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:07.094338 28634 catalog_manager.cc:5654] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:07.095928 28812 consensus_queue.cc:237] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
W20260203 09:17:07.108961 28776 consensus_peers.cc:597] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 428e0a1fef8d467da4a30ece11cc6e5c. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:07.109879 28737 raft_consensus.cc:1275] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:07.111959 29737 consensus_queue.cc:1048] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:07.114615 28883 raft_consensus.cc:1275] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:07.121088 29737 consensus_queue.cc:1048] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:17:07.143142 29706 raft_consensus.cc:2955] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:07.144992 28737 raft_consensus.cc:2955] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:07.152278 28888 raft_consensus.cc:2955] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:07.167294 28635 catalog_manager.cc:5654] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:07.411298 29758 ts_tablet_manager.cc:933] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:07.413524 29758 tablet_copy_client.cc:323] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.66:41611
I20260203 09:17:07.415206 28823 tablet_copy_service.cc:140] P be3b58b70fd74625a8ae8dfd7db7f6ee: Received BeginTabletCopySession request for tablet eac7b86aa8d340e3a4d61a5c982b1f2e from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:50256)
I20260203 09:17:07.415784 28823 tablet_copy_service.cc:161] P be3b58b70fd74625a8ae8dfd7db7f6ee: Beginning new tablet copy session on tablet eac7b86aa8d340e3a4d61a5c982b1f2e from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:50256: session id = cf00f643e7da4a98a0a11ea92869c24a-eac7b86aa8d340e3a4d61a5c982b1f2e
I20260203 09:17:07.422430 28823 tablet_copy_source_session.cc:215] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:07.425380 29758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac7b86aa8d340e3a4d61a5c982b1f2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:07.441062 29758 tablet_copy_client.cc:806] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:07.441812 29758 tablet_copy_client.cc:670] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:07.445263 29758 tablet_copy_client.cc:538] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:07.518296 29760 ts_tablet_manager.cc:933] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:07.527021 29758 tablet_bootstrap.cc:492] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:07.537089 29760 tablet_copy_client.cc:323] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.67:42899
I20260203 09:17:07.538869 28899 tablet_copy_service.cc:140] P 77541303e1934638ba82f0f43f707adc: Received BeginTabletCopySession request for tablet 438ed0267e3148da951c6dc25761c745 from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:59280)
I20260203 09:17:07.539424 28899 tablet_copy_service.cc:161] P 77541303e1934638ba82f0f43f707adc: Beginning new tablet copy session on tablet 438ed0267e3148da951c6dc25761c745 from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:59280: session id = cf00f643e7da4a98a0a11ea92869c24a-438ed0267e3148da951c6dc25761c745
I20260203 09:17:07.548074 28899 tablet_copy_source_session.cc:215] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:07.553205 29760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 438ed0267e3148da951c6dc25761c745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:07.593341 29764 ts_tablet_manager.cc:933] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:07.594933 29766 ts_tablet_manager.cc:933] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:07.598537 29760 tablet_copy_client.cc:806] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:07.599223 29760 tablet_copy_client.cc:670] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:07.601663 29766 tablet_copy_client.cc:323] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.66:41611
I20260203 09:17:07.603613 28823 tablet_copy_service.cc:140] P be3b58b70fd74625a8ae8dfd7db7f6ee: Received BeginTabletCopySession request for tablet 428e0a1fef8d467da4a30ece11cc6e5c from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:50256)
I20260203 09:17:07.603749 29764 tablet_copy_client.cc:323] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.67:42899
I20260203 09:17:07.604176 28823 tablet_copy_service.cc:161] P be3b58b70fd74625a8ae8dfd7db7f6ee: Beginning new tablet copy session on tablet 428e0a1fef8d467da4a30ece11cc6e5c from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:50256: session id = cf00f643e7da4a98a0a11ea92869c24a-428e0a1fef8d467da4a30ece11cc6e5c
I20260203 09:17:07.605218 28899 tablet_copy_service.cc:140] P 77541303e1934638ba82f0f43f707adc: Received BeginTabletCopySession request for tablet c13ab397c8524e6ca30e36e5fca2ff35 from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:59280)
I20260203 09:17:07.605453 29758 tablet_bootstrap.cc:492] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:07.605778 28899 tablet_copy_service.cc:161] P 77541303e1934638ba82f0f43f707adc: Beginning new tablet copy session on tablet c13ab397c8524e6ca30e36e5fca2ff35 from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:59280: session id = cf00f643e7da4a98a0a11ea92869c24a-c13ab397c8524e6ca30e36e5fca2ff35
I20260203 09:17:07.606346 29758 tablet_bootstrap.cc:492] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:07.607056 29758 ts_tablet_manager.cc:1403] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.080s user 0.015s sys 0.023s
I20260203 09:17:07.607394 29760 tablet_copy_client.cc:538] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:07.610628 29758 raft_consensus.cc:359] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:07.611624 29758 raft_consensus.cc:740] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:07.643181 29758 consensus_queue.cc:260] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:07.644358 28823 tablet_copy_source_session.cc:215] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:07.650692 29760 tablet_bootstrap.cc:492] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:07.655743 29766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 428e0a1fef8d467da4a30ece11cc6e5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:07.688756 28899 tablet_copy_source_session.cc:215] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:07.700511 29764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c13ab397c8524e6ca30e36e5fca2ff35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:07.710726 29758 ts_tablet_manager.cc:1434] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.103s user 0.023s sys 0.045s
I20260203 09:17:07.711463 29766 tablet_copy_client.cc:806] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:07.712092 29766 tablet_copy_client.cc:670] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:07.746447 28823 tablet_copy_service.cc:342] P be3b58b70fd74625a8ae8dfd7db7f6ee: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-eac7b86aa8d340e3a4d61a5c982b1f2e received from {username='slave'} at 127.0.0.1:50256
I20260203 09:17:07.746912 28823 tablet_copy_service.cc:434] P be3b58b70fd74625a8ae8dfd7db7f6ee: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-eac7b86aa8d340e3a4d61a5c982b1f2e on tablet eac7b86aa8d340e3a4d61a5c982b1f2e with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:07.750180 29766 tablet_copy_client.cc:538] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:07.758285 29764 tablet_copy_client.cc:806] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:07.758806 29764 tablet_copy_client.cc:670] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:07.762121 29764 tablet_copy_client.cc:538] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:07.771416 29760 tablet_bootstrap.cc:492] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:07.771878 29764 tablet_bootstrap.cc:492] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:07.772495 29760 tablet_bootstrap.cc:492] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:07.773305 29760 ts_tablet_manager.cc:1403] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.123s user 0.024s sys 0.004s
I20260203 09:17:07.777508 29760 raft_consensus.cc:359] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:07.778656 29760 raft_consensus.cc:740] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:07.779357 29760 consensus_queue.cc:260] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:07.782385 29760 ts_tablet_manager.cc:1434] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260203 09:17:07.784539 28899 tablet_copy_service.cc:342] P 77541303e1934638ba82f0f43f707adc: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-438ed0267e3148da951c6dc25761c745 received from {username='slave'} at 127.0.0.1:59280
I20260203 09:17:07.785006 28899 tablet_copy_service.cc:434] P 77541303e1934638ba82f0f43f707adc: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-438ed0267e3148da951c6dc25761c745 on tablet 438ed0267e3148da951c6dc25761c745 with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:07.788089 29766 tablet_bootstrap.cc:492] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:07.802551 29764 tablet_bootstrap.cc:492] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:07.803603 29764 tablet_bootstrap.cc:492] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:07.804374 29764 ts_tablet_manager.cc:1403] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.033s user 0.031s sys 0.000s
I20260203 09:17:07.807288 29764 raft_consensus.cc:359] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:07.808235 29764 raft_consensus.cc:740] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:07.809000 29764 consensus_queue.cc:260] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:07.812875 29764 ts_tablet_manager.cc:1434] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260203 09:17:07.814369 28899 tablet_copy_service.cc:342] P 77541303e1934638ba82f0f43f707adc: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-c13ab397c8524e6ca30e36e5fca2ff35 received from {username='slave'} at 127.0.0.1:59280
I20260203 09:17:07.815058 28899 tablet_copy_service.cc:434] P 77541303e1934638ba82f0f43f707adc: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-c13ab397c8524e6ca30e36e5fca2ff35 on tablet c13ab397c8524e6ca30e36e5fca2ff35 with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:07.821894 29766 tablet_bootstrap.cc:492] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:07.822901 29766 tablet_bootstrap.cc:492] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:07.823705 29766 ts_tablet_manager.cc:1403] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.036s user 0.022s sys 0.004s
I20260203 09:17:07.826683 29766 raft_consensus.cc:359] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:07.827553 29766 raft_consensus.cc:740] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:07.828223 29766 consensus_queue.cc:260] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:07.830955 29766 ts_tablet_manager.cc:1434] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260203 09:17:07.833164 28823 tablet_copy_service.cc:342] P be3b58b70fd74625a8ae8dfd7db7f6ee: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-428e0a1fef8d467da4a30ece11cc6e5c received from {username='slave'} at 127.0.0.1:50256
I20260203 09:17:07.833624 28823 tablet_copy_service.cc:434] P be3b58b70fd74625a8ae8dfd7db7f6ee: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-428e0a1fef8d467da4a30ece11cc6e5c on tablet 428e0a1fef8d467da4a30ece11cc6e5c with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:07.892014 29464 raft_consensus.cc:1217] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:17:08.000233 29464 raft_consensus.cc:1217] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:17:08.025799 29464 raft_consensus.cc:1217] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:17:08.065958 29464 raft_consensus.cc:1217] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:17:08.473765 29706 raft_consensus.cc:1064] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:08.483745 29706 consensus_queue.cc:237] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:08.497193 29772 raft_consensus.cc:1064] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:08.504123 29464 raft_consensus.cc:1275] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:08.505298 29706 consensus_queue.cc:1048] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:08.510555 29772 consensus_queue.cc:237] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:08.516031 28889 raft_consensus.cc:1275] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:08.519412 28737 raft_consensus.cc:1275] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:08.520246 28732 raft_consensus.cc:1275] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:08.520246 29464 raft_consensus.cc:1275] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:08.522009 29738 consensus_queue.cc:1048] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:08.523397 28812 raft_consensus.cc:1275] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:08.524070 29738 consensus_queue.cc:1048] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:08.525270 29710 consensus_queue.cc:1048] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:17:08.528609 29779 consensus_queue.cc:1048] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:08.530315 29721 consensus_queue.cc:1048] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:08.551841 29771 raft_consensus.cc:2955] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.554706 28730 raft_consensus.cc:2955] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.596128 28635 catalog_manager.cc:5654] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.617700 29464 raft_consensus.cc:2955] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.625756 29706 raft_consensus.cc:2955] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.632506 28737 raft_consensus.cc:2955] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.633400 28810 raft_consensus.cc:2955] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.636482 29738 raft_consensus.cc:1064] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:08.640609 28889 raft_consensus.cc:2955] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.641700 29738 consensus_queue.cc:237] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:08.648155 29463 raft_consensus.cc:2955] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.666518 28631 catalog_manager.cc:5654] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:08.676285 29464 raft_consensus.cc:1275] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:08.680771 29706 raft_consensus.cc:1064] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:08.683844 28737 raft_consensus.cc:1275] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:08.683439 29706 consensus_queue.cc:237] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:08.685034 29771 consensus_queue.cc:1048] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:08.685469 28812 raft_consensus.cc:1275] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:08.689591 29738 consensus_queue.cc:1048] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:08.691938 29787 consensus_queue.cc:1048] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:08.719743 29463 raft_consensus.cc:1275] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:08.722340 29779 consensus_queue.cc:1048] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:08.722730 28810 consensus_queue.cc:237] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:08.728610 28889 raft_consensus.cc:1275] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:08.728955 28738 raft_consensus.cc:1275] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:08.732409 29464 raft_consensus.cc:1275] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:08.734032 29779 consensus_queue.cc:1048] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:08.735064 29774 consensus_queue.cc:1048] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:08.736110 29710 consensus_queue.cc:1048] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:08.741282 28738 raft_consensus.cc:1275] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:08.741961 29710 raft_consensus.cc:2955] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.746310 29789 raft_consensus.cc:2955] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.762451 28730 raft_consensus.cc:2955] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.764899 29464 raft_consensus.cc:2955] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.770169 28883 consensus_queue.cc:237] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:08.780997 29465 raft_consensus.cc:1275] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:08.789614 29787 consensus_queue.cc:1048] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:17:08.792443 28631 catalog_manager.cc:5654] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.800228 28806 raft_consensus.cc:1275] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:08.803613 28635 catalog_manager.cc:5654] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.805186 28618 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet eac7b86aa8d340e3a4d61a5c982b1f2e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:08.804798 28806 raft_consensus.cc:2955] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.810969 28872 tablet_service.cc:1552] Processing DeleteTablet for tablet eac7b86aa8d340e3a4d61a5c982b1f2e with delete_type TABLET_DATA_TOMBSTONED (TS 77541303e1934638ba82f0f43f707adc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40930
I20260203 09:17:08.820741 29774 raft_consensus.cc:2955] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.826650 29772 consensus_queue.cc:1048] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:17:08.829107 29788 raft_consensus.cc:2955] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.819391 29710 consensus_queue.cc:1048] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:17:08.847185 28737 raft_consensus.cc:2955] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.850090 28619 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 438ed0267e3148da951c6dc25761c745 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:08.847625 28730 raft_consensus.cc:2955] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.853037 29465 raft_consensus.cc:2955] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.855659 28883 raft_consensus.cc:2955] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
W20260203 09:17:08.880201 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 55811.7us
I20260203 09:17:08.881803 28633 catalog_manager.cc:5654] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.884809 29805 tablet_replica.cc:333] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:08.884068 29463 raft_consensus.cc:2955] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.887496 29805 raft_consensus.cc:2243] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:08.888489 29805 raft_consensus.cc:2272] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:08.887668 29464 raft_consensus.cc:2955] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.897097 29805 ts_tablet_manager.cc:1916] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:08.913283 28633 catalog_manager.cc:5654] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.916167 29805 ts_tablet_manager.cc:1929] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:17:08.916772 29805 log.cc:1199] T eac7b86aa8d340e3a4d61a5c982b1f2e P 77541303e1934638ba82f0f43f707adc: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-2-root/wals/eac7b86aa8d340e3a4d61a5c982b1f2e
I20260203 09:17:08.917793 28806 raft_consensus.cc:2955] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.920552 28619 catalog_manager.cc:4985] TS 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): tablet eac7b86aa8d340e3a4d61a5c982b1f2e (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:17:08.944885 28721 tablet_service.cc:1552] Processing DeleteTablet for tablet 438ed0267e3148da951c6dc25761c745 with delete_type TABLET_DATA_TOMBSTONED (TS 847a7af9f0e2497cbb9025cc2c62557e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43606
I20260203 09:17:08.951192 28888 consensus_queue.cc:237] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:08.957319 29464 raft_consensus.cc:1275] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:08.959105 28737 raft_consensus.cc:1275] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:08.961011 29807 consensus_queue.cc:1048] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:08.966075 29806 consensus_queue.cc:1048] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:17:08.970355 29789 raft_consensus.cc:2955] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.972309 28806 consensus_queue.cc:237] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:08.978360 29463 raft_consensus.cc:1275] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:08.980134 29779 consensus_queue.cc:1048] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:08.980386 29464 raft_consensus.cc:2955] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.987084 28738 raft_consensus.cc:2955] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:08.988339 29774 raft_consensus.cc:2955] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:09.000362 28888 raft_consensus.cc:1275] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:09.001983 29808 tablet_replica.cc:333] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:09.003160 29808 raft_consensus.cc:2243] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:09.003952 29808 raft_consensus.cc:2272] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:09.005236 29464 raft_consensus.cc:2955] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:09.010087 28619 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet c13ab397c8524e6ca30e36e5fca2ff35 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:08.995906 28631 catalog_manager.cc:5654] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:09.012524 29710 consensus_queue.cc:1048] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:09.013465 28618 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 428e0a1fef8d467da4a30ece11cc6e5c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:09.020293 29808 ts_tablet_manager.cc:1916] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:09.026461 28635 catalog_manager.cc:5654] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:09.027289 28802 tablet_service.cc:1552] Processing DeleteTablet for tablet c13ab397c8524e6ca30e36e5fca2ff35 with delete_type TABLET_DATA_TOMBSTONED (TS be3b58b70fd74625a8ae8dfd7db7f6ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36384
I20260203 09:17:09.041556 28721 tablet_service.cc:1552] Processing DeleteTablet for tablet 428e0a1fef8d467da4a30ece11cc6e5c with delete_type TABLET_DATA_TOMBSTONED (TS 847a7af9f0e2497cbb9025cc2c62557e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43606
I20260203 09:17:09.052037 29809 tablet_replica.cc:333] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:09.053383 29809 raft_consensus.cc:2243] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:09.056090 29808 ts_tablet_manager.cc:1929] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:17:09.056267 29809 raft_consensus.cc:2272] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:09.056535 29808 log.cc:1199] T 438ed0267e3148da951c6dc25761c745 P 847a7af9f0e2497cbb9025cc2c62557e: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-0-root/wals/438ed0267e3148da951c6dc25761c745
I20260203 09:17:09.058416 28619 catalog_manager.cc:4985] TS 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): tablet 438ed0267e3148da951c6dc25761c745 (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:17:09.058885 29808 tablet_replica.cc:333] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:09.060534 29808 raft_consensus.cc:2243] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:09.061710 29808 raft_consensus.cc:2272] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:09.060200 28888 raft_consensus.cc:2955] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:09.065644 29808 ts_tablet_manager.cc:1916] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:09.068176 29809 ts_tablet_manager.cc:1916] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:09.086715 29808 ts_tablet_manager.cc:1929] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:17:09.087263 29808 log.cc:1199] T 428e0a1fef8d467da4a30ece11cc6e5c P 847a7af9f0e2497cbb9025cc2c62557e: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-0-root/wals/428e0a1fef8d467da4a30ece11cc6e5c
I20260203 09:17:09.088217 29809 ts_tablet_manager.cc:1929] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:17:09.088725 29809 log.cc:1199] T c13ab397c8524e6ca30e36e5fca2ff35 P be3b58b70fd74625a8ae8dfd7db7f6ee: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-1-root/wals/c13ab397c8524e6ca30e36e5fca2ff35
I20260203 09:17:09.088721 28619 catalog_manager.cc:4985] TS 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): tablet 428e0a1fef8d467da4a30ece11cc6e5c (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:17:09.090395 28618 catalog_manager.cc:4985] TS be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): tablet c13ab397c8524e6ca30e36e5fca2ff35 (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:17:10.114945 28806 consensus_queue.cc:237] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:10.120954 28883 raft_consensus.cc:1275] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:10.122393 28737 raft_consensus.cc:1275] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260203 09:17:10.121282 28776 consensus_peers.cc:597] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b6c0f69b8ce94c9b9b4e64882eb25a2c. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:10.124361 29812 consensus_queue.cc:1048] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:10.125280 29710 consensus_queue.cc:1048] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:10.132220 29812 raft_consensus.cc:2955] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:10.133829 28737 raft_consensus.cc:2955] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:10.134454 28883 raft_consensus.cc:2955] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:10.152513 28737 consensus_queue.cc:237] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:10.153048 28635 catalog_manager.cc:5654] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:10.178714 28883 raft_consensus.cc:1275] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:10.179823 28806 raft_consensus.cc:1275] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:10.180527 29818 consensus_queue.cc:1048] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260203 09:17:10.184182 28700 consensus_peers.cc:597] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 09f2301096ce4f4689e1e7f24f013e52. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:10.185211 29818 consensus_queue.cc:1048] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:10.202665 29818 raft_consensus.cc:2955] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:10.211728 28883 raft_consensus.cc:2955] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:10.206085 28810 raft_consensus.cc:2955] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:10.232528 28806 consensus_queue.cc:237] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:10.238297 28633 catalog_manager.cc:5654] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:10.248768 28889 raft_consensus.cc:1275] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260203 09:17:10.251036 28737 raft_consensus.cc:1275] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260203 09:17:10.252554 28776 consensus_peers.cc:597] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 31afe6e1e9d24b89b4ac6d2e837fca22. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:10.255963 29812 consensus_queue.cc:1048] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:10.260106 29779 consensus_queue.cc:1048] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:10.277240 29710 raft_consensus.cc:2955] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:10.279165 28889 raft_consensus.cc:2955] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:10.279012 28737 raft_consensus.cc:2955] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:10.289877 28738 consensus_queue.cc:237] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:10.291888 28635 catalog_manager.cc:5654] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index -1 to 3, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 2 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260203 09:17:10.297704 28700 consensus_peers.cc:597] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c49cb7ba1af14dfcbe637cf12fbe669c. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:10.300769 28883 raft_consensus.cc:1275] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:10.302482 29818 consensus_queue.cc:1048] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:10.305377 28810 raft_consensus.cc:1275] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:10.312739 29818 consensus_queue.cc:1048] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:10.318198 29818 raft_consensus.cc:2955] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:10.319413 28889 raft_consensus.cc:2955] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:10.334194 28810 raft_consensus.cc:2955] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:10.337708 28633 catalog_manager.cc:5654] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:10.570065 29832 ts_tablet_manager.cc:933] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:10.572041 29832 tablet_copy_client.cc:323] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.66:41611
I20260203 09:17:10.573549 28823 tablet_copy_service.cc:140] P be3b58b70fd74625a8ae8dfd7db7f6ee: Received BeginTabletCopySession request for tablet b6c0f69b8ce94c9b9b4e64882eb25a2c from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:50256)
I20260203 09:17:10.574074 28823 tablet_copy_service.cc:161] P be3b58b70fd74625a8ae8dfd7db7f6ee: Beginning new tablet copy session on tablet b6c0f69b8ce94c9b9b4e64882eb25a2c from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:50256: session id = cf00f643e7da4a98a0a11ea92869c24a-b6c0f69b8ce94c9b9b4e64882eb25a2c
I20260203 09:17:10.581547 28823 tablet_copy_source_session.cc:215] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:10.585886 29832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c0f69b8ce94c9b9b4e64882eb25a2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:10.603055 29832 tablet_copy_client.cc:806] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:10.603871 29832 tablet_copy_client.cc:670] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:10.608013 29832 tablet_copy_client.cc:538] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:10.616971 29832 tablet_bootstrap.cc:492] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:10.635286 29832 tablet_bootstrap.cc:492] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:10.636184 29832 tablet_bootstrap.cc:492] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:10.636816 29832 ts_tablet_manager.cc:1403] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.020s user 0.014s sys 0.005s
I20260203 09:17:10.639305 29832 raft_consensus.cc:359] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:10.640086 29832 raft_consensus.cc:740] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:10.640775 29832 consensus_queue.cc:260] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:10.644032 29832 ts_tablet_manager.cc:1434] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260203 09:17:10.650334 28823 tablet_copy_service.cc:342] P be3b58b70fd74625a8ae8dfd7db7f6ee: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-b6c0f69b8ce94c9b9b4e64882eb25a2c received from {username='slave'} at 127.0.0.1:50256
I20260203 09:17:10.650797 28823 tablet_copy_service.cc:434] P be3b58b70fd74625a8ae8dfd7db7f6ee: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-b6c0f69b8ce94c9b9b4e64882eb25a2c on tablet b6c0f69b8ce94c9b9b4e64882eb25a2c with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:10.653764 29832 ts_tablet_manager.cc:933] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967)
I20260203 09:17:10.657802 29832 tablet_copy_client.cc:323] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.65:37967
I20260203 09:17:10.659220 28748 tablet_copy_service.cc:140] P 847a7af9f0e2497cbb9025cc2c62557e: Received BeginTabletCopySession request for tablet 09f2301096ce4f4689e1e7f24f013e52 from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:45044)
I20260203 09:17:10.659698 28748 tablet_copy_service.cc:161] P 847a7af9f0e2497cbb9025cc2c62557e: Beginning new tablet copy session on tablet 09f2301096ce4f4689e1e7f24f013e52 from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:45044: session id = cf00f643e7da4a98a0a11ea92869c24a-09f2301096ce4f4689e1e7f24f013e52
I20260203 09:17:10.670125 28748 tablet_copy_source_session.cc:215] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:10.673357 29832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f2301096ce4f4689e1e7f24f013e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:10.692914 29832 tablet_copy_client.cc:806] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:10.693660 29836 ts_tablet_manager.cc:933] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967)
I20260203 09:17:10.695818 29832 tablet_copy_client.cc:670] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:10.721060 29832 tablet_copy_client.cc:538] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:10.730526 29832 tablet_bootstrap.cc:492] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:10.741060 29836 tablet_copy_client.cc:323] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.65:37967
I20260203 09:17:10.742594 28748 tablet_copy_service.cc:140] P 847a7af9f0e2497cbb9025cc2c62557e: Received BeginTabletCopySession request for tablet c49cb7ba1af14dfcbe637cf12fbe669c from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:45044)
I20260203 09:17:10.743033 28748 tablet_copy_service.cc:161] P 847a7af9f0e2497cbb9025cc2c62557e: Beginning new tablet copy session on tablet c49cb7ba1af14dfcbe637cf12fbe669c from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:45044: session id = cf00f643e7da4a98a0a11ea92869c24a-c49cb7ba1af14dfcbe637cf12fbe669c
I20260203 09:17:10.748812 28748 tablet_copy_source_session.cc:215] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:10.752173 29836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c49cb7ba1af14dfcbe637cf12fbe669c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:10.756923 29832 tablet_bootstrap.cc:492] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:10.758002 29832 tablet_bootstrap.cc:492] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:10.758718 29832 ts_tablet_manager.cc:1403] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.028s user 0.018s sys 0.008s
I20260203 09:17:10.761804 29832 raft_consensus.cc:359] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:10.762701 29832 raft_consensus.cc:740] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:10.763365 29832 consensus_queue.cc:260] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:10.765919 29832 ts_tablet_manager.cc:1434] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20260203 09:17:10.767524 28748 tablet_copy_service.cc:342] P 847a7af9f0e2497cbb9025cc2c62557e: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-09f2301096ce4f4689e1e7f24f013e52 received from {username='slave'} at 127.0.0.1:45044
I20260203 09:17:10.767918 28748 tablet_copy_service.cc:434] P 847a7af9f0e2497cbb9025cc2c62557e: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-09f2301096ce4f4689e1e7f24f013e52 on tablet 09f2301096ce4f4689e1e7f24f013e52 with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:10.776222 29836 tablet_copy_client.cc:806] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:10.776852 29836 tablet_copy_client.cc:670] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:10.780364 29836 tablet_copy_client.cc:538] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:10.790897 29836 tablet_bootstrap.cc:492] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:10.797562 29832 ts_tablet_manager.cc:933] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:10.799998 29832 tablet_copy_client.cc:323] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.66:41611
I20260203 09:17:10.801525 28823 tablet_copy_service.cc:140] P be3b58b70fd74625a8ae8dfd7db7f6ee: Received BeginTabletCopySession request for tablet 31afe6e1e9d24b89b4ac6d2e837fca22 from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:50256)
I20260203 09:17:10.802085 28823 tablet_copy_service.cc:161] P be3b58b70fd74625a8ae8dfd7db7f6ee: Beginning new tablet copy session on tablet 31afe6e1e9d24b89b4ac6d2e837fca22 from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:50256: session id = cf00f643e7da4a98a0a11ea92869c24a-31afe6e1e9d24b89b4ac6d2e837fca22
I20260203 09:17:10.810716 29836 tablet_bootstrap.cc:492] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:10.811659 29836 tablet_bootstrap.cc:492] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:10.812486 29836 ts_tablet_manager.cc:1403] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.022s user 0.011s sys 0.011s
I20260203 09:17:10.815919 28823 tablet_copy_source_session.cc:215] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:10.819509 29836 raft_consensus.cc:359] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:10.820433 29836 raft_consensus.cc:740] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:10.821080 29836 consensus_queue.cc:260] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:10.822796 29832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31afe6e1e9d24b89b4ac6d2e837fca22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:10.823546 29836 ts_tablet_manager.cc:1434] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20260203 09:17:10.825358 28748 tablet_copy_service.cc:342] P 847a7af9f0e2497cbb9025cc2c62557e: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-c49cb7ba1af14dfcbe637cf12fbe669c received from {username='slave'} at 127.0.0.1:45044
I20260203 09:17:10.825747 28748 tablet_copy_service.cc:434] P 847a7af9f0e2497cbb9025cc2c62557e: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-c49cb7ba1af14dfcbe637cf12fbe669c on tablet c49cb7ba1af14dfcbe637cf12fbe669c with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:10.840101 29832 tablet_copy_client.cc:806] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:10.841074 29832 tablet_copy_client.cc:670] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:10.845834 29832 tablet_copy_client.cc:538] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:10.853428 29832 tablet_bootstrap.cc:492] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:10.870301 29832 tablet_bootstrap.cc:492] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:10.871230 29832 tablet_bootstrap.cc:492] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:10.871795 29832 ts_tablet_manager.cc:1403] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.019s user 0.016s sys 0.001s
I20260203 09:17:10.874110 29832 raft_consensus.cc:359] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:10.874855 29832 raft_consensus.cc:740] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:10.875483 29832 consensus_queue.cc:260] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:10.877269 29832 ts_tablet_manager.cc:1434] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260203 09:17:10.878742 28823 tablet_copy_service.cc:342] P be3b58b70fd74625a8ae8dfd7db7f6ee: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-31afe6e1e9d24b89b4ac6d2e837fca22 received from {username='slave'} at 127.0.0.1:50256
I20260203 09:17:10.879086 28823 tablet_copy_service.cc:434] P be3b58b70fd74625a8ae8dfd7db7f6ee: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-31afe6e1e9d24b89b4ac6d2e837fca22 on tablet 31afe6e1e9d24b89b4ac6d2e837fca22 with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:11.030380 29464 raft_consensus.cc:1217] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:17:11.238924 29464 raft_consensus.cc:1217] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:17:11.261595 29464 raft_consensus.cc:1217] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:17:11.319974 29463 raft_consensus.cc:1217] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20260203 09:17:11.628712 29710 raft_consensus.cc:1064] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:11.631649 29710 consensus_queue.cc:237] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:11.651571 28883 raft_consensus.cc:1275] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:11.654882 28737 raft_consensus.cc:1275] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:11.657554 29710 consensus_queue.cc:1048] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:11.659379 29710 consensus_queue.cc:1048] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:11.674178 29463 raft_consensus.cc:1275] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:11.680274 29710 consensus_queue.cc:1048] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:11.687011 29847 raft_consensus.cc:2955] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:11.696108 28737 raft_consensus.cc:2955] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:11.706530 29463 raft_consensus.cc:2955] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:11.711696 28633 catalog_manager.cc:5654] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:11.704991 28883 raft_consensus.cc:2955] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:11.743863 29844 raft_consensus.cc:1064] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:11.747085 29844 consensus_queue.cc:237] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:11.755873 28883 raft_consensus.cc:1275] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:11.756234 29463 raft_consensus.cc:1275] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:11.758251 29844 consensus_queue.cc:1048] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:11.758857 28806 raft_consensus.cc:1275] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:11.760099 29818 consensus_queue.cc:1048] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:17:11.764505 29762 consensus_queue.cc:1048] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:17:11.789628 28806 consensus_queue.cc:237] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:11.798631 29762 raft_consensus.cc:2955] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:11.800415 28883 raft_consensus.cc:2955] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:11.803870 28810 raft_consensus.cc:2955] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:11.812687 29464 raft_consensus.cc:1275] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:11.814564 29779 consensus_queue.cc:1048] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:17:11.815569 29844 raft_consensus.cc:1064] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:11.828784 29847 raft_consensus.cc:2955] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:11.831660 29844 consensus_queue.cc:237] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:11.824216 28634 catalog_manager.cc:5654] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:11.840631 29464 raft_consensus.cc:2955] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:11.842672 29463 raft_consensus.cc:2955] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:11.849442 28737 raft_consensus.cc:1275] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:11.852169 29710 raft_consensus.cc:1064] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:11.854758 29710 consensus_queue.cc:237] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:11.873880 29779 consensus_queue.cc:1048] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:17:11.878540 28883 raft_consensus.cc:1275] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:11.882561 28810 raft_consensus.cc:1275] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:11.885018 28737 raft_consensus.cc:2955] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:11.885401 29856 consensus_queue.cc:1048] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:17:11.887631 29856 consensus_queue.cc:1048] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:17:11.903203 29464 raft_consensus.cc:1275] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:11.909070 29863 consensus_queue.cc:1048] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:17:11.923238 29463 raft_consensus.cc:1275] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEARNER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260203 09:17:11.924813 29779 consensus_queue.cc:1048] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:11.934580 28888 raft_consensus.cc:1275] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260203 09:17:11.943006 28618 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet b6c0f69b8ce94c9b9b4e64882eb25a2c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:11.940724 28737 raft_consensus.cc:1275] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260203 09:17:11.951611 29845 consensus_queue.cc:1048] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:17:11.955724 28737 consensus_queue.cc:237] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:11.959154 29845 consensus_queue.cc:1048] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:17:11.955948 28631 catalog_manager.cc:5654] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:11.969071 29463 raft_consensus.cc:1275] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:11.971179 29856 consensus_queue.cc:1048] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:17:11.974573 29762 raft_consensus.cc:2955] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:11.979895 29856 raft_consensus.cc:2955] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:11.981824 28889 raft_consensus.cc:2955] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:11.987531 29464 raft_consensus.cc:2955] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:11.993468 28883 raft_consensus.cc:1275] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:11.994773 28812 raft_consensus.cc:2955] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:12.007207 28872 tablet_service.cc:1552] Processing DeleteTablet for tablet b6c0f69b8ce94c9b9b4e64882eb25a2c with delete_type TABLET_DATA_TOMBSTONED (TS 77541303e1934638ba82f0f43f707adc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40930
I20260203 09:17:12.009276 29844 consensus_queue.cc:1048] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:17:12.009550 28635 catalog_manager.cc:5654] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:12.022143 29710 raft_consensus.cc:2955] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:12.024367 28732 raft_consensus.cc:2955] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:12.025104 29463 raft_consensus.cc:2955] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:12.031356 28889 raft_consensus.cc:2955] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:12.057476 29465 raft_consensus.cc:2955] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:12.068802 28631 catalog_manager.cc:5654] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc reported cstate change: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:12.081322 28889 raft_consensus.cc:2955] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:12.084262 29872 tablet_replica.cc:333] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:12.088330 28619 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 09f2301096ce4f4689e1e7f24f013e52 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:12.090693 29872 raft_consensus.cc:2243] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:12.091555 29872 raft_consensus.cc:2272] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:12.092665 28802 tablet_service.cc:1552] Processing DeleteTablet for tablet 09f2301096ce4f4689e1e7f24f013e52 with delete_type TABLET_DATA_TOMBSTONED (TS be3b58b70fd74625a8ae8dfd7db7f6ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36384
I20260203 09:17:12.097337 29874 tablet_replica.cc:333] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:12.099146 29874 raft_consensus.cc:2243] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:12.100088 29874 raft_consensus.cc:2272] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:12.101320 29872 ts_tablet_manager.cc:1916] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:12.103832 29874 ts_tablet_manager.cc:1916] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:12.104194 28730 consensus_queue.cc:237] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:12.107728 28635 catalog_manager.cc:5654] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: config changed from index 3 to 4, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:12.123358 29874 ts_tablet_manager.cc:1929] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:17:12.124032 29874 log.cc:1199] T 09f2301096ce4f4689e1e7f24f013e52 P be3b58b70fd74625a8ae8dfd7db7f6ee: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-1-root/wals/09f2301096ce4f4689e1e7f24f013e52
I20260203 09:17:12.127483 28618 catalog_manager.cc:4985] TS be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): tablet 09f2301096ce4f4689e1e7f24f013e52 (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:17:12.129154 29872 ts_tablet_manager.cc:1929] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:17:12.129623 29872 log.cc:1199] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 77541303e1934638ba82f0f43f707adc: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-2-root/wals/b6c0f69b8ce94c9b9b4e64882eb25a2c
I20260203 09:17:12.134621 28619 catalog_manager.cc:4985] TS 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): tablet b6c0f69b8ce94c9b9b4e64882eb25a2c (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:17:12.134878 28885 raft_consensus.cc:1275] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:12.136281 29463 raft_consensus.cc:1275] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:12.136879 29762 consensus_queue.cc:1048] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:17:12.139904 29762 consensus_queue.cc:1048] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:12.146883 29818 raft_consensus.cc:2955] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:12.156185 28812 consensus_queue.cc:237] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:12.159487 29463 raft_consensus.cc:2955] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:12.164870 29465 raft_consensus.cc:1275] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:12.166066 28885 raft_consensus.cc:1275] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:12.165199 28889 raft_consensus.cc:2955] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:12.166582 29710 consensus_queue.cc:1048] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:12.170748 29847 consensus_queue.cc:1048] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:12.176736 28633 catalog_manager.cc:5654] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:12.182202 28619 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet c49cb7ba1af14dfcbe637cf12fbe669c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:12.190608 29463 raft_consensus.cc:2955] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:12.193039 28885 raft_consensus.cc:2955] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:12.177341 29847 raft_consensus.cc:2955] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:12.204370 28618 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 31afe6e1e9d24b89b4ac6d2e837fca22 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:12.211061 28802 tablet_service.cc:1552] Processing DeleteTablet for tablet c49cb7ba1af14dfcbe637cf12fbe669c with delete_type TABLET_DATA_TOMBSTONED (TS be3b58b70fd74625a8ae8dfd7db7f6ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36384
I20260203 09:17:12.212060 29874 tablet_replica.cc:333] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:12.213629 28633 catalog_manager.cc:5654] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index 4 to 5, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New cstate: current_term: 2 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:12.219877 29874 raft_consensus.cc:2243] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:12.220633 29874 raft_consensus.cc:2272] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:12.225821 29874 ts_tablet_manager.cc:1916] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:12.229450 28721 tablet_service.cc:1552] Processing DeleteTablet for tablet 31afe6e1e9d24b89b4ac6d2e837fca22 with delete_type TABLET_DATA_TOMBSTONED (TS 847a7af9f0e2497cbb9025cc2c62557e not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:43606
I20260203 09:17:12.231886 29875 tablet_replica.cc:333] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:12.233122 29875 raft_consensus.cc:2243] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:12.233793 29875 raft_consensus.cc:2272] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:12.273685 29874 ts_tablet_manager.cc:1929] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:17:12.274201 29874 log.cc:1199] T c49cb7ba1af14dfcbe637cf12fbe669c P be3b58b70fd74625a8ae8dfd7db7f6ee: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-1-root/wals/c49cb7ba1af14dfcbe637cf12fbe669c
I20260203 09:17:12.274919 29875 ts_tablet_manager.cc:1916] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:12.275908 28618 catalog_manager.cc:4985] TS be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): tablet c49cb7ba1af14dfcbe637cf12fbe669c (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:17:12.291236 29875 ts_tablet_manager.cc:1929] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260203 09:17:12.291637 29875 log.cc:1199] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 847a7af9f0e2497cbb9025cc2c62557e: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-0-root/wals/31afe6e1e9d24b89b4ac6d2e837fca22
I20260203 09:17:12.293016 28619 catalog_manager.cc:4985] TS 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): tablet 31afe6e1e9d24b89b4ac6d2e837fca22 (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:17:13.293241 28810 consensus_queue.cc:237] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:13.300508 28889 raft_consensus.cc:1275] T 6063a063fced4ff38761f892acbdfa76 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260203 09:17:13.301182 28776 consensus_peers.cc:597] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6063a063fced4ff38761f892acbdfa76. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:13.303056 29847 consensus_queue.cc:1048] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:13.306232 28738 raft_consensus.cc:1275] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:13.307718 29847 consensus_queue.cc:1048] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:13.316316 29877 raft_consensus.cc:2955] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:13.318779 28889 raft_consensus.cc:2955] T 6063a063fced4ff38761f892acbdfa76 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:13.319939 28738 raft_consensus.cc:2955] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:13.338606 28633 catalog_manager.cc:5654] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:13.343202 28810 consensus_queue.cc:237] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:13.350788 28889 raft_consensus.cc:1275] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260203 09:17:13.350793 28776 consensus_peers.cc:597] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a10f51ea1a844376bb4dce51f655be6b. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:13.352299 29845 consensus_queue.cc:1048] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:13.352018 28738 raft_consensus.cc:1275] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:13.354777 29877 consensus_queue.cc:1048] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:17:13.363037 29847 raft_consensus.cc:2955] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:13.366453 28889 raft_consensus.cc:2955] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:13.374115 28738 raft_consensus.cc:2955] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:13.380039 28889 consensus_queue.cc:237] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:13.394655 28635 catalog_manager.cc:5654] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260203 09:17:13.403298 28851 consensus_peers.cc:597] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 797be23efb5c447da7f2d0ba9af2e84d. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:13.404866 28810 raft_consensus.cc:1275] T 797be23efb5c447da7f2d0ba9af2e84d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:13.407748 28738 raft_consensus.cc:1275] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:13.410236 29876 consensus_queue.cc:1048] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:17:13.412845 29806 consensus_queue.cc:1048] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:17:13.424304 29876 raft_consensus.cc:2955] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:13.425681 28812 raft_consensus.cc:2955] T 797be23efb5c447da7f2d0ba9af2e84d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:13.429847 28738 raft_consensus.cc:2955] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:13.438855 28730 consensus_queue.cc:237] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:13.444850 28633 catalog_manager.cc:5654] T 797be23efb5c447da7f2d0ba9af2e84d P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
W20260203 09:17:13.457420 28700 consensus_peers.cc:597] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6bf3d38eba3b4894b7f18f2d5733f63e. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:13.460122 28812 raft_consensus.cc:1275] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:13.461246 28885 raft_consensus.cc:1275] T 6bf3d38eba3b4894b7f18f2d5733f63e P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:13.462435 29863 consensus_queue.cc:1048] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:13.464114 29863 consensus_queue.cc:1048] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:13.474002 29818 raft_consensus.cc:2955] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:13.476014 28812 raft_consensus.cc:2955] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:13.478377 28885 raft_consensus.cc:2955] T 6bf3d38eba3b4894b7f18f2d5733f63e P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:13.505415 28631 catalog_manager.cc:5654] T 6bf3d38eba3b4894b7f18f2d5733f63e P 77541303e1934638ba82f0f43f707adc reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:13.688812 29899 ts_tablet_manager.cc:933] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:13.690737 29899 tablet_copy_client.cc:323] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.66:41611
I20260203 09:17:13.692404 28823 tablet_copy_service.cc:140] P be3b58b70fd74625a8ae8dfd7db7f6ee: Received BeginTabletCopySession request for tablet 6063a063fced4ff38761f892acbdfa76 from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:50256)
I20260203 09:17:13.692997 28823 tablet_copy_service.cc:161] P be3b58b70fd74625a8ae8dfd7db7f6ee: Beginning new tablet copy session on tablet 6063a063fced4ff38761f892acbdfa76 from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:50256: session id = cf00f643e7da4a98a0a11ea92869c24a-6063a063fced4ff38761f892acbdfa76
I20260203 09:17:13.702078 28823 tablet_copy_source_session.cc:215] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:13.705173 29899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6063a063fced4ff38761f892acbdfa76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:13.721685 29899 tablet_copy_client.cc:806] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:13.722325 29899 tablet_copy_client.cc:670] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:13.730633 29899 tablet_copy_client.cc:538] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:13.739722 29899 tablet_bootstrap.cc:492] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:13.760934 29899 tablet_bootstrap.cc:492] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:13.761735 29899 tablet_bootstrap.cc:492] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:13.762270 29899 ts_tablet_manager.cc:1403] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.023s user 0.022s sys 0.000s
I20260203 09:17:13.765095 29899 raft_consensus.cc:359] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:13.765895 29899 raft_consensus.cc:740] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:13.766605 29899 consensus_queue.cc:260] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:13.770956 29899 ts_tablet_manager.cc:1434] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.008s user 0.007s sys 0.002s
I20260203 09:17:13.774005 28823 tablet_copy_service.cc:342] P be3b58b70fd74625a8ae8dfd7db7f6ee: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-6063a063fced4ff38761f892acbdfa76 received from {username='slave'} at 127.0.0.1:50256
I20260203 09:17:13.774494 28823 tablet_copy_service.cc:434] P be3b58b70fd74625a8ae8dfd7db7f6ee: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-6063a063fced4ff38761f892acbdfa76 on tablet 6063a063fced4ff38761f892acbdfa76 with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:13.797394 29899 ts_tablet_manager.cc:933] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:13.801371 29899 tablet_copy_client.cc:323] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.67:42899
I20260203 09:17:13.803418 28899 tablet_copy_service.cc:140] P 77541303e1934638ba82f0f43f707adc: Received BeginTabletCopySession request for tablet 797be23efb5c447da7f2d0ba9af2e84d from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:59280)
I20260203 09:17:13.803994 28899 tablet_copy_service.cc:161] P 77541303e1934638ba82f0f43f707adc: Beginning new tablet copy session on tablet 797be23efb5c447da7f2d0ba9af2e84d from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:59280: session id = cf00f643e7da4a98a0a11ea92869c24a-797be23efb5c447da7f2d0ba9af2e84d
I20260203 09:17:13.811959 28899 tablet_copy_source_session.cc:215] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:13.815407 29899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 797be23efb5c447da7f2d0ba9af2e84d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:13.829886 29899 tablet_copy_client.cc:806] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:13.830507 29899 tablet_copy_client.cc:670] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:13.834673 29899 tablet_copy_client.cc:538] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:13.843168 29899 tablet_bootstrap.cc:492] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:13.863054 29899 tablet_bootstrap.cc:492] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:13.865515 29899 tablet_bootstrap.cc:492] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:13.866259 29899 ts_tablet_manager.cc:1403] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.023s user 0.018s sys 0.004s
I20260203 09:17:13.869091 29899 raft_consensus.cc:359] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:13.869933 29899 raft_consensus.cc:740] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:13.870608 29899 consensus_queue.cc:260] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:13.876863 29899 ts_tablet_manager.cc:1434] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260203 09:17:13.878495 28899 tablet_copy_service.cc:342] P 77541303e1934638ba82f0f43f707adc: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-797be23efb5c447da7f2d0ba9af2e84d received from {username='slave'} at 127.0.0.1:59280
I20260203 09:17:13.878996 28899 tablet_copy_service.cc:434] P 77541303e1934638ba82f0f43f707adc: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-797be23efb5c447da7f2d0ba9af2e84d on tablet 797be23efb5c447da7f2d0ba9af2e84d with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:13.879381 29905 ts_tablet_manager.cc:933] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967)
I20260203 09:17:13.890859 29905 tablet_copy_client.cc:323] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.65:37967
I20260203 09:17:13.892513 28748 tablet_copy_service.cc:140] P 847a7af9f0e2497cbb9025cc2c62557e: Received BeginTabletCopySession request for tablet 6bf3d38eba3b4894b7f18f2d5733f63e from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:45044)
I20260203 09:17:13.893126 28748 tablet_copy_service.cc:161] P 847a7af9f0e2497cbb9025cc2c62557e: Beginning new tablet copy session on tablet 6bf3d38eba3b4894b7f18f2d5733f63e from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:45044: session id = cf00f643e7da4a98a0a11ea92869c24a-6bf3d38eba3b4894b7f18f2d5733f63e
I20260203 09:17:13.901211 28748 tablet_copy_source_session.cc:215] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:13.904254 29905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bf3d38eba3b4894b7f18f2d5733f63e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:13.918184 29905 tablet_copy_client.cc:806] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:13.918780 29905 tablet_copy_client.cc:670] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:13.919349 29899 ts_tablet_manager.cc:933] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:13.924466 29905 tablet_copy_client.cc:538] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:13.931147 29899 tablet_copy_client.cc:323] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.66:41611
I20260203 09:17:13.933665 29905 tablet_bootstrap.cc:492] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:13.934098 28823 tablet_copy_service.cc:140] P be3b58b70fd74625a8ae8dfd7db7f6ee: Received BeginTabletCopySession request for tablet a10f51ea1a844376bb4dce51f655be6b from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:50256)
I20260203 09:17:13.934645 28823 tablet_copy_service.cc:161] P be3b58b70fd74625a8ae8dfd7db7f6ee: Beginning new tablet copy session on tablet a10f51ea1a844376bb4dce51f655be6b from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:50256: session id = cf00f643e7da4a98a0a11ea92869c24a-a10f51ea1a844376bb4dce51f655be6b
I20260203 09:17:13.942399 28823 tablet_copy_source_session.cc:215] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:13.945520 29899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10f51ea1a844376bb4dce51f655be6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:13.956605 29905 tablet_bootstrap.cc:492] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:13.957584 29905 tablet_bootstrap.cc:492] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:13.958237 29905 ts_tablet_manager.cc:1403] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.025s user 0.012s sys 0.011s
I20260203 09:17:13.961148 29905 raft_consensus.cc:359] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:13.961969 29905 raft_consensus.cc:740] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:13.962193 29899 tablet_copy_client.cc:806] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:13.962762 29899 tablet_copy_client.cc:670] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:13.963043 29905 consensus_queue.cc:260] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:13.965588 29905 ts_tablet_manager.cc:1434] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260203 09:17:13.966634 29899 tablet_copy_client.cc:538] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:13.967355 28748 tablet_copy_service.cc:342] P 847a7af9f0e2497cbb9025cc2c62557e: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-6bf3d38eba3b4894b7f18f2d5733f63e received from {username='slave'} at 127.0.0.1:45044
I20260203 09:17:13.967803 28748 tablet_copy_service.cc:434] P 847a7af9f0e2497cbb9025cc2c62557e: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-6bf3d38eba3b4894b7f18f2d5733f63e on tablet 6bf3d38eba3b4894b7f18f2d5733f63e with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:13.975591 29899 tablet_bootstrap.cc:492] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:13.997293 29899 tablet_bootstrap.cc:492] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:13.998026 29899 tablet_bootstrap.cc:492] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:13.998549 29899 ts_tablet_manager.cc:1403] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.023s user 0.023s sys 0.000s
I20260203 09:17:14.000869 29899 raft_consensus.cc:359] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:14.001654 29899 raft_consensus.cc:740] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:14.002252 29899 consensus_queue.cc:260] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:14.004866 29899 ts_tablet_manager.cc:1434] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260203 09:17:14.007397 28823 tablet_copy_service.cc:342] P be3b58b70fd74625a8ae8dfd7db7f6ee: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-a10f51ea1a844376bb4dce51f655be6b received from {username='slave'} at 127.0.0.1:50256
I20260203 09:17:14.007895 28823 tablet_copy_service.cc:434] P be3b58b70fd74625a8ae8dfd7db7f6ee: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-a10f51ea1a844376bb4dce51f655be6b on tablet a10f51ea1a844376bb4dce51f655be6b with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:14.094969 29463 raft_consensus.cc:1217] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:17:14.251995 29463 raft_consensus.cc:1217] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:17:14.405906 29463 raft_consensus.cc:1217] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:17:14.497202 29463 raft_consensus.cc:1217] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:17:14.542878 29845 raft_consensus.cc:1064] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:14.544848 29845 consensus_queue.cc:237] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:14.551865 29463 raft_consensus.cc:1275] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:14.551893 28885 raft_consensus.cc:1275] T 6063a063fced4ff38761f892acbdfa76 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:14.553345 28738 raft_consensus.cc:1275] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:14.553610 29847 consensus_queue.cc:1048] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:14.554745 29910 consensus_queue.cc:1048] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:14.555774 29845 consensus_queue.cc:1048] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:14.586720 29914 raft_consensus.cc:2955] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:14.591204 28885 raft_consensus.cc:2955] T 6063a063fced4ff38761f892acbdfa76 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:14.602918 28738 raft_consensus.cc:2955] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:14.622526 29463 raft_consensus.cc:2955] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:14.637843 28631 catalog_manager.cc:5654] T 6063a063fced4ff38761f892acbdfa76 P 77541303e1934638ba82f0f43f707adc reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:14.679456 28812 consensus_queue.cc:237] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:14.684885 29465 raft_consensus.cc:1275] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:14.686317 29847 consensus_queue.cc:1048] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:14.690354 28738 raft_consensus.cc:1275] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:14.692030 29876 raft_consensus.cc:1064] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:14.694249 29876 consensus_queue.cc:237] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:14.698781 29847 consensus_queue.cc:1048] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:14.703668 29910 raft_consensus.cc:2955] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:14.705906 29465 raft_consensus.cc:2955] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:14.706898 28738 raft_consensus.cc:2955] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:14.714854 28618 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 6063a063fced4ff38761f892acbdfa76 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:14.721946 28634 catalog_manager.cc:5654] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:14.728011 28812 raft_consensus.cc:1275] T 797be23efb5c447da7f2d0ba9af2e84d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:14.728269 29465 raft_consensus.cc:1275] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:14.730163 29889 consensus_queue.cc:1048] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:14.731369 28738 raft_consensus.cc:1275] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:14.732547 29889 consensus_queue.cc:1048] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:14.738466 29889 consensus_queue.cc:1048] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:14.788465 28872 tablet_service.cc:1552] Processing DeleteTablet for tablet 6063a063fced4ff38761f892acbdfa76 with delete_type TABLET_DATA_TOMBSTONED (TS 77541303e1934638ba82f0f43f707adc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40930
I20260203 09:17:14.791623 29918 raft_consensus.cc:2955] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:14.795444 28805 raft_consensus.cc:2955] T 797be23efb5c447da7f2d0ba9af2e84d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:14.797904 29463 raft_consensus.cc:2955] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:14.813287 29927 tablet_replica.cc:333] T 6063a063fced4ff38761f892acbdfa76 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:14.814363 28634 catalog_manager.cc:5654] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:14.814567 29927 raft_consensus.cc:2243] T 6063a063fced4ff38761f892acbdfa76 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:14.819834 29927 raft_consensus.cc:2272] T 6063a063fced4ff38761f892acbdfa76 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:14.820688 28738 raft_consensus.cc:2955] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:14.826687 29927 ts_tablet_manager.cc:1916] T 6063a063fced4ff38761f892acbdfa76 P 77541303e1934638ba82f0f43f707adc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:14.843055 29927 ts_tablet_manager.cc:1929] T 6063a063fced4ff38761f892acbdfa76 P 77541303e1934638ba82f0f43f707adc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:17:14.843542 29927 log.cc:1199] T 6063a063fced4ff38761f892acbdfa76 P 77541303e1934638ba82f0f43f707adc: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-2-root/wals/6063a063fced4ff38761f892acbdfa76
I20260203 09:17:14.849112 28619 catalog_manager.cc:4985] TS 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): tablet 6063a063fced4ff38761f892acbdfa76 (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:17:14.852941 28888 consensus_queue.cc:237] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:14.857226 29465 raft_consensus.cc:1275] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:14.857640 28730 raft_consensus.cc:1275] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:14.858534 29890 consensus_queue.cc:1048] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:14.861186 29890 consensus_queue.cc:1048] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:14.866118 29889 raft_consensus.cc:2955] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:14.868533 29465 raft_consensus.cc:2955] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:14.872211 28738 raft_consensus.cc:2955] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:14.883737 28619 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 797be23efb5c447da7f2d0ba9af2e84d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:14.891106 28634 catalog_manager.cc:5654] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:14.904135 28802 tablet_service.cc:1552] Processing DeleteTablet for tablet 797be23efb5c447da7f2d0ba9af2e84d with delete_type TABLET_DATA_TOMBSTONED (TS be3b58b70fd74625a8ae8dfd7db7f6ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36384
I20260203 09:17:14.919931 29928 tablet_replica.cc:333] T 797be23efb5c447da7f2d0ba9af2e84d P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:14.921059 29928 raft_consensus.cc:2243] T 797be23efb5c447da7f2d0ba9af2e84d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:14.921833 29928 raft_consensus.cc:2272] T 797be23efb5c447da7f2d0ba9af2e84d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:14.927467 29928 ts_tablet_manager.cc:1916] T 797be23efb5c447da7f2d0ba9af2e84d P be3b58b70fd74625a8ae8dfd7db7f6ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:14.942524 29928 ts_tablet_manager.cc:1929] T 797be23efb5c447da7f2d0ba9af2e84d P be3b58b70fd74625a8ae8dfd7db7f6ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:17:14.942855 29928 log.cc:1199] T 797be23efb5c447da7f2d0ba9af2e84d P be3b58b70fd74625a8ae8dfd7db7f6ee: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-1-root/wals/797be23efb5c447da7f2d0ba9af2e84d
I20260203 09:17:14.944206 28618 catalog_manager.cc:4985] TS be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): tablet 797be23efb5c447da7f2d0ba9af2e84d (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:17:14.963606 29910 raft_consensus.cc:1064] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:14.966048 29910 consensus_queue.cc:237] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:14.971540 28889 raft_consensus.cc:1275] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:14.971532 29465 raft_consensus.cc:1275] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:14.972174 28738 raft_consensus.cc:1275] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:14.973227 29847 consensus_queue.cc:1048] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:14.973934 29910 consensus_queue.cc:1048] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:14.974586 29914 consensus_queue.cc:1048] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:15.002952 29847 raft_consensus.cc:2955] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:15.006016 28738 raft_consensus.cc:2955] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:15.006290 28889 raft_consensus.cc:2955] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:15.011816 29912 raft_consensus.cc:1064] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:15.014446 29912 consensus_queue.cc:237] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:15.016083 29465 raft_consensus.cc:2955] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:15.025491 29464 raft_consensus.cc:1275] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:15.025900 28812 raft_consensus.cc:1275] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:15.027196 28888 raft_consensus.cc:1275] T 6bf3d38eba3b4894b7f18f2d5733f63e P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:15.029458 29912 consensus_queue.cc:1048] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260203 09:17:15.032687 29912 consensus_queue.cc:1048] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:15.040057 29818 consensus_queue.cc:1048] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:15.043670 28633 catalog_manager.cc:5654] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:15.058853 29896 raft_consensus.cc:2955] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:15.060853 28812 raft_consensus.cc:2955] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:15.077348 28806 consensus_queue.cc:237] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:15.080097 28885 raft_consensus.cc:2955] T 6bf3d38eba3b4894b7f18f2d5733f63e P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:15.081298 29464 raft_consensus.cc:2955] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:15.086124 29465 raft_consensus.cc:1275] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:15.088122 29910 consensus_queue.cc:1048] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:17:15.089246 28634 catalog_manager.cc:5654] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:15.098976 29847 raft_consensus.cc:2955] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:15.100018 28888 raft_consensus.cc:1275] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:15.105454 29845 consensus_queue.cc:1048] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:15.110229 28888 raft_consensus.cc:2955] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:15.115123 28618 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet a10f51ea1a844376bb4dce51f655be6b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:15.117969 29464 raft_consensus.cc:2955] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:15.161569 28732 consensus_queue.cc:237] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:15.164983 28633 catalog_manager.cc:5654] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New cstate: current_term: 1 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:15.174670 29462 raft_consensus.cc:1275] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:15.176776 28721 tablet_service.cc:1552] Processing DeleteTablet for tablet a10f51ea1a844376bb4dce51f655be6b with delete_type TABLET_DATA_TOMBSTONED (TS 847a7af9f0e2497cbb9025cc2c62557e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43606
I20260203 09:17:15.177736 28812 raft_consensus.cc:1275] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:15.179723 29937 consensus_queue.cc:1048] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:17:15.180876 29912 consensus_queue.cc:1048] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:15.189412 29939 tablet_replica.cc:333] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:15.192983 29818 raft_consensus.cc:2955] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:15.199483 28812 raft_consensus.cc:2955] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:15.204188 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:17:15.208377 29462 raft_consensus.cc:2955] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:15.223975 28619 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 6bf3d38eba3b4894b7f18f2d5733f63e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:15.224612 29939 raft_consensus.cc:2243] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:15.225415 29939 raft_consensus.cc:2272] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:15.228613 29939 ts_tablet_manager.cc:1916] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:15.242051 28634 catalog_manager.cc:5654] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:15.253276 28872 tablet_service.cc:1552] Processing DeleteTablet for tablet 6bf3d38eba3b4894b7f18f2d5733f63e with delete_type TABLET_DATA_TOMBSTONED (TS 77541303e1934638ba82f0f43f707adc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40930
I20260203 09:17:15.254209 29927 tablet_replica.cc:333] T 6bf3d38eba3b4894b7f18f2d5733f63e P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:15.255180 29927 raft_consensus.cc:2243] T 6bf3d38eba3b4894b7f18f2d5733f63e P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:15.255980 29927 raft_consensus.cc:2272] T 6bf3d38eba3b4894b7f18f2d5733f63e P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:15.259356 29927 ts_tablet_manager.cc:1916] T 6bf3d38eba3b4894b7f18f2d5733f63e P 77541303e1934638ba82f0f43f707adc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:15.268898 29939 ts_tablet_manager.cc:1929] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:17:15.269450 29939 log.cc:1199] T a10f51ea1a844376bb4dce51f655be6b P 847a7af9f0e2497cbb9025cc2c62557e: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-0-root/wals/a10f51ea1a844376bb4dce51f655be6b
I20260203 09:17:15.271303 28619 catalog_manager.cc:4985] TS 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): tablet a10f51ea1a844376bb4dce51f655be6b (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:17:15.280325 29927 ts_tablet_manager.cc:1929] T 6bf3d38eba3b4894b7f18f2d5733f63e P 77541303e1934638ba82f0f43f707adc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:17:15.280890 29927 log.cc:1199] T 6bf3d38eba3b4894b7f18f2d5733f63e P 77541303e1934638ba82f0f43f707adc: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-2-root/wals/6bf3d38eba3b4894b7f18f2d5733f63e
I20260203 09:17:15.282505 28619 catalog_manager.cc:4985] TS 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): tablet 6bf3d38eba3b4894b7f18f2d5733f63e (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:17:15.312677 28888 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259"
dest_uuid: "77541303e1934638ba82f0f43f707adc"
mode: GRACEFUL
new_leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
from {username='slave'} at 127.0.0.1:57870
I20260203 09:17:15.313247 28888 raft_consensus.cc:606] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Received request to transfer leadership to TS 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:15.323988 28812 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c"
dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
mode: GRACEFUL
new_leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
from {username='slave'} at 127.0.0.1:60448
I20260203 09:17:15.324461 28812 raft_consensus.cc:606] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Received request to transfer leadership to TS cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:15.326716 28888 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667"
dest_uuid: "77541303e1934638ba82f0f43f707adc"
mode: GRACEFUL
new_leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
from {username='slave'} at 127.0.0.1:57870
I20260203 09:17:15.327252 28888 raft_consensus.cc:606] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Received request to transfer leadership to TS cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:15.330862 28888 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d"
dest_uuid: "77541303e1934638ba82f0f43f707adc"
mode: GRACEFUL
new_leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
from {username='slave'} at 127.0.0.1:57870
I20260203 09:17:15.331430 28888 raft_consensus.cc:606] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Received request to transfer leadership to TS 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:15.334161 28885 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b"
dest_uuid: "77541303e1934638ba82f0f43f707adc"
mode: GRACEFUL
new_leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
from {username='slave'} at 127.0.0.1:57870
I20260203 09:17:15.334688 28885 raft_consensus.cc:606] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Received request to transfer leadership to TS 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:15.336620 28885 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f40d17692ce0424589f3962011b49824"
dest_uuid: "77541303e1934638ba82f0f43f707adc"
mode: GRACEFUL
new_leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
from {username='slave'} at 127.0.0.1:57870
I20260203 09:17:15.337065 28885 raft_consensus.cc:606] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Received request to transfer leadership to TS 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:15.338105 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260203 09:17:15.339227 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:17:15.339915 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:17:15.379343 29890 raft_consensus.cc:993] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc: : Instructing follower 847a7af9f0e2497cbb9025cc2c62557e to start an election
I20260203 09:17:15.379848 29889 raft_consensus.cc:1081] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Signalling peer 847a7af9f0e2497cbb9025cc2c62557e to start an election
I20260203 09:17:15.381229 28738 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b"
dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
from {username='slave'} at 127.0.0.1:43612
I20260203 09:17:15.381726 28738 raft_consensus.cc:493] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:15.382022 28738 raft_consensus.cc:3060] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:15.386700 28738 raft_consensus.cc:515] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:15.388137 28738 leader_election.cc:290] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:15.389060 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:15.389618 28885 raft_consensus.cc:3055] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:15.389672 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:15.389885 28885 raft_consensus.cc:740] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:15.390174 28812 raft_consensus.cc:3060] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:15.390540 28885 consensus_queue.cc:260] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:15.391521 28885 raft_consensus.cc:3060] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:15.395009 28812 raft_consensus.cc:2468] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:15.396162 28700 leader_election.cc:304] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:15.396315 28885 raft_consensus.cc:2468] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:15.396845 29818 raft_consensus.cc:2804] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:15.397339 29818 raft_consensus.cc:697] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:15.398092 29818 consensus_queue.cc:237] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:15.408129 28633 catalog_manager.cc:5654] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 1 to 2, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 2 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:15.542657 29890 raft_consensus.cc:993] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc: : Instructing follower 847a7af9f0e2497cbb9025cc2c62557e to start an election
I20260203 09:17:15.543196 29876 raft_consensus.cc:1081] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Signalling peer 847a7af9f0e2497cbb9025cc2c62557e to start an election
I20260203 09:17:15.545266 28738 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d"
dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
from {username='slave'} at 127.0.0.1:43612
I20260203 09:17:15.545812 28738 raft_consensus.cc:493] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:15.546139 28738 raft_consensus.cc:3060] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:15.551757 28738 raft_consensus.cc:515] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:15.553211 28738 leader_election.cc:290] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:15.554116 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:15.554060 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:15.554772 28885 raft_consensus.cc:3055] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:15.554821 28805 raft_consensus.cc:3060] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:15.555177 28885 raft_consensus.cc:740] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:15.555945 28885 consensus_queue.cc:260] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:15.557117 28885 raft_consensus.cc:3060] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:15.561919 28805 raft_consensus.cc:2468] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:15.562932 28700 leader_election.cc:304] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:15.563758 29896 raft_consensus.cc:2804] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:15.564126 28885 raft_consensus.cc:2468] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:15.564772 29896 raft_consensus.cc:697] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:15.565812 29896 consensus_queue.cc:237] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:15.583029 28633 catalog_manager.cc:5654] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 1 to 2, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 2 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:15.610134 29847 raft_consensus.cc:993] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee: : Instructing follower cf00f643e7da4a98a0a11ea92869c24a to start an election
I20260203 09:17:15.610598 29910 raft_consensus.cc:1081] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Signalling peer cf00f643e7da4a98a0a11ea92869c24a to start an election
I20260203 09:17:15.612011 29464 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c"
dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
from {username='slave'} at 127.0.0.1:53310
I20260203 09:17:15.612403 29464 raft_consensus.cc:493] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:15.612663 29464 raft_consensus.cc:3060] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:15.618018 29464 raft_consensus.cc:515] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:15.620241 29464 leader_election.cc:290] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:15.621150 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:15.621328 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:15.621735 28812 raft_consensus.cc:3055] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:15.621898 28885 raft_consensus.cc:3060] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:15.622527 28812 raft_consensus.cc:740] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:15.623261 28812 consensus_queue.cc:260] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:15.624971 28812 raft_consensus.cc:3060] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:15.629247 28885 raft_consensus.cc:2468] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:15.630326 29426 leader_election.cc:304] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:15.630651 28812 raft_consensus.cc:2468] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:15.631065 29902 raft_consensus.cc:2804] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:15.632181 29902 raft_consensus.cc:697] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:15.633078 29902 consensus_queue.cc:237] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:15.641014 28633 catalog_manager.cc:5654] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 1 to 2, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68). New cstate: current_term: 2 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:15.718878 29889 raft_consensus.cc:993] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc: : Instructing follower cf00f643e7da4a98a0a11ea92869c24a to start an election
I20260203 09:17:15.719322 29876 raft_consensus.cc:1081] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Signalling peer cf00f643e7da4a98a0a11ea92869c24a to start an election
I20260203 09:17:15.721019 29464 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667"
dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
from {username='slave'} at 127.0.0.1:53326
I20260203 09:17:15.721570 29464 raft_consensus.cc:493] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:15.721903 29464 raft_consensus.cc:3060] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:15.728945 29464 raft_consensus.cc:515] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:15.731071 29464 leader_election.cc:290] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:15.731822 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:15.731958 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:15.732456 28738 raft_consensus.cc:3060] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:15.732527 28888 raft_consensus.cc:3055] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:15.732923 28888 raft_consensus.cc:740] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:15.733632 28888 consensus_queue.cc:260] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:15.734755 28888 raft_consensus.cc:3060] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:15.740414 28738 raft_consensus.cc:2468] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:15.743062 29426 leader_election.cc:304] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:15.744390 29902 raft_consensus.cc:2804] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:15.745035 29902 raft_consensus.cc:697] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:15.745870 29902 consensus_queue.cc:237] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:15.741281 28888 raft_consensus.cc:2468] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:15.762270 28633 catalog_manager.cc:5654] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 1 to 2, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68). New cstate: current_term: 2 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:15.851694 29890 raft_consensus.cc:993] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc: : Instructing follower 847a7af9f0e2497cbb9025cc2c62557e to start an election
I20260203 09:17:15.852141 29890 raft_consensus.cc:1081] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Signalling peer 847a7af9f0e2497cbb9025cc2c62557e to start an election
I20260203 09:17:15.853525 28730 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f40d17692ce0424589f3962011b49824"
dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
from {username='slave'} at 127.0.0.1:43612
I20260203 09:17:15.854035 28730 raft_consensus.cc:493] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:15.854370 28730 raft_consensus.cc:3060] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:15.859205 28730 raft_consensus.cc:515] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:15.860577 28730 leader_election.cc:290] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:15.861328 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:15.861501 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:15.861935 28812 raft_consensus.cc:3060] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:15.862010 28888 raft_consensus.cc:3055] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:15.862421 28888 raft_consensus.cc:740] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:15.863131 28888 consensus_queue.cc:260] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:15.864251 28888 raft_consensus.cc:3060] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:15.868084 28812 raft_consensus.cc:2468] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:15.868978 28700 leader_election.cc:304] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:15.869575 29896 raft_consensus.cc:2804] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:15.869858 28888 raft_consensus.cc:2468] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:15.869987 29896 raft_consensus.cc:697] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:15.870920 29896 consensus_queue.cc:237] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:15.881062 29889 raft_consensus.cc:993] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc: : Instructing follower 847a7af9f0e2497cbb9025cc2c62557e to start an election
I20260203 09:17:15.881553 29890 raft_consensus.cc:1081] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Signalling peer 847a7af9f0e2497cbb9025cc2c62557e to start an election
I20260203 09:17:15.882000 28633 catalog_manager.cc:5654] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 1 to 2, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 2 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:15.883000 28730 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259"
dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
from {username='slave'} at 127.0.0.1:43612
I20260203 09:17:15.883471 28730 raft_consensus.cc:493] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:15.883805 28730 raft_consensus.cc:3060] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:15.889997 28730 raft_consensus.cc:515] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:15.892876 28730 leader_election.cc:290] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:15.893421 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:15.893946 28812 raft_consensus.cc:3060] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:15.894533 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:15.894966 28888 raft_consensus.cc:3055] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:15.895205 28888 raft_consensus.cc:740] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:15.895776 28888 consensus_queue.cc:260] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:15.896611 28888 raft_consensus.cc:3060] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:15.898679 28812 raft_consensus.cc:2468] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:15.899603 28700 leader_election.cc:304] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:15.900358 29896 raft_consensus.cc:2804] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:15.900851 29896 raft_consensus.cc:697] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:15.903280 28888 raft_consensus.cc:2468] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:15.901628 29896 consensus_queue.cc:237] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:15.914244 28633 catalog_manager.cc:5654] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 1 to 2, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 2 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:15.948045 28812 raft_consensus.cc:1275] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:15.949494 29896 consensus_queue.cc:1048] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:15.950363 28888 raft_consensus.cc:1275] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:15.951414 29896 consensus_queue.cc:1048] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:15.961781 28805 raft_consensus.cc:1275] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:15.966893 29818 consensus_queue.cc:1048] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:15.991158 28888 raft_consensus.cc:1275] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:15.998797 29818 consensus_queue.cc:1048] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:16.030961 28812 raft_consensus.cc:1275] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:16.032514 29945 consensus_queue.cc:1048] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:16.052237 28889 raft_consensus.cc:1275] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:16.057538 29902 consensus_queue.cc:1048] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:16.263147 28889 raft_consensus.cc:1275] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:16.264706 29902 consensus_queue.cc:1048] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:16.304132 28730 raft_consensus.cc:1275] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:16.305794 28888 raft_consensus.cc:1275] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:16.315116 29957 consensus_queue.cc:1048] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:16.319387 28889 consensus_queue.cc:237] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:16.320511 29962 consensus_queue.cc:1048] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260203 09:17:16.344894 28812 raft_consensus.cc:1275] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:16.347877 28730 raft_consensus.cc:1275] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260203 09:17:16.348409 28851 consensus_peers.cc:597] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c4b4d20256154aa1a7644698755531fd. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:16.349459 29889 consensus_queue.cc:1048] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:16.352439 29890 consensus_queue.cc:1048] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:16.359539 28812 raft_consensus.cc:1275] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:16.361423 29896 consensus_queue.cc:1048] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:16.374615 29876 raft_consensus.cc:2955] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:16.377261 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:17:16.382490 28730 raft_consensus.cc:2955] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:16.381253 28812 raft_consensus.cc:2955] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:16.397053 28732 consensus_queue.cc:237] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:16.411001 28633 catalog_manager.cc:5654] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 2 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:16.446513 28888 raft_consensus.cc:1275] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260203 09:17:16.447245 28700 consensus_peers.cc:597] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0d2d0debbeba46b086bb9d7344d2181b. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:16.448112 29954 consensus_queue.cc:1048] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:16.457942 28812 raft_consensus.cc:1275] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:16.461156 29954 consensus_queue.cc:1048] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:17:16.464727 29818 raft_consensus.cc:2955] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:16.466758 28889 raft_consensus.cc:2955] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:16.475708 28806 raft_consensus.cc:1275] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:16.477164 29954 consensus_queue.cc:1048] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:16.487964 28732 consensus_queue.cc:237] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:16.491999 28633 catalog_manager.cc:5654] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:16.516000 28888 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e"
dest_uuid: "77541303e1934638ba82f0f43f707adc"
mode: GRACEFUL
new_leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
from {username='slave'} at 127.0.0.1:57870
I20260203 09:17:16.516626 28888 raft_consensus.cc:606] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Received request to transfer leadership to TS cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:16.518719 28889 raft_consensus.cc:1275] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:16.517459 28806 raft_consensus.cc:2955] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:16.520092 28888 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "113a394f120048c58168ad22915e0187"
dest_uuid: "77541303e1934638ba82f0f43f707adc"
mode: GRACEFUL
new_leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
from {username='slave'} at 127.0.0.1:57870
I20260203 09:17:16.520728 28888 raft_consensus.cc:606] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Received request to transfer leadership to TS be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:16.521080 29896 consensus_queue.cc:1048] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:16.530380 28885 raft_consensus.cc:1275] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260203 09:17:16.530871 28700 consensus_peers.cc:597] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f652d76b6054b738b66531829291e55. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:16.531634 29818 consensus_queue.cc:1048] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:16.535393 28889 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00"
dest_uuid: "77541303e1934638ba82f0f43f707adc"
mode: GRACEFUL
new_leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
from {username='slave'} at 127.0.0.1:57870
I20260203 09:17:16.536976 28889 raft_consensus.cc:606] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Received request to transfer leadership to TS cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:16.540982 28889 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "438ed0267e3148da951c6dc25761c745"
dest_uuid: "77541303e1934638ba82f0f43f707adc"
mode: GRACEFUL
new_leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
from {username='slave'} at 127.0.0.1:57870
I20260203 09:17:16.541726 28889 raft_consensus.cc:606] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Received request to transfer leadership to TS cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:16.548311 28883 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f"
dest_uuid: "77541303e1934638ba82f0f43f707adc"
mode: GRACEFUL
new_leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
from {username='slave'} at 127.0.0.1:57870
I20260203 09:17:16.549063 28883 raft_consensus.cc:606] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Received request to transfer leadership to TS 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:16.551788 28812 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b"
dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
mode: GRACEFUL
new_leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
from {username='slave'} at 127.0.0.1:60448
I20260203 09:17:16.552699 28812 raft_consensus.cc:606] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Received request to transfer leadership to TS cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:16.553081 28806 raft_consensus.cc:1275] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:16.554533 29896 consensus_queue.cc:1048] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:16.571332 29957 raft_consensus.cc:2955] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:16.574429 28806 raft_consensus.cc:2955] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:16.575517 28885 raft_consensus.cc:2955] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:16.594452 28633 catalog_manager.cc:5654] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:16.631887 28885 consensus_queue.cc:237] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:16.637589 28732 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "f40d17692ce0424589f3962011b49824"
dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
mode: GRACEFUL
new_leader_uuid: "77541303e1934638ba82f0f43f707adc"
from {username='slave'} at 127.0.0.1:33896
I20260203 09:17:16.638213 28732 raft_consensus.cc:606] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Received request to transfer leadership to TS 77541303e1934638ba82f0f43f707adc
I20260203 09:17:16.639341 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260203 09:17:16.640482 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:17:16.641283 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:17:16.643297 28732 raft_consensus.cc:1275] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:16.643297 28812 raft_consensus.cc:1275] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260203 09:17:16.644109 28851 consensus_peers.cc:597] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5ccabd714ab40bab140c7a90667ddd6. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:16.644775 29876 consensus_queue.cc:1048] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:16.645584 29890 consensus_queue.cc:1048] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:16.658046 29876 raft_consensus.cc:2955] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:16.660010 28806 raft_consensus.cc:2955] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:16.679021 28633 catalog_manager.cc:5654] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:16.692528 28738 raft_consensus.cc:2955] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:16.844734 29889 raft_consensus.cc:993] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc: : Instructing follower cf00f643e7da4a98a0a11ea92869c24a to start an election
I20260203 09:17:16.845165 29889 raft_consensus.cc:1081] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Signalling peer cf00f643e7da4a98a0a11ea92869c24a to start an election
I20260203 09:17:16.846709 29462 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "438ed0267e3148da951c6dc25761c745"
dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
from {username='slave'} at 127.0.0.1:53326
I20260203 09:17:16.847158 29462 raft_consensus.cc:493] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:16.847441 29462 raft_consensus.cc:3060] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:16.854208 29462 raft_consensus.cc:515] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:16.857182 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:16.857744 28806 raft_consensus.cc:3060] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:16.857895 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:16.858517 28885 raft_consensus.cc:3055] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:16.858973 28885 raft_consensus.cc:740] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:16.859757 28885 consensus_queue.cc:260] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:16.860986 28885 raft_consensus.cc:3060] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:16.869453 28885 raft_consensus.cc:2468] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:16.871699 29426 leader_election.cc:304] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:16.872766 29902 raft_consensus.cc:2804] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:16.857709 29462 leader_election.cc:290] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:16.873558 29902 raft_consensus.cc:697] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:16.873085 28806 raft_consensus.cc:2468] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:16.874452 29902 consensus_queue.cc:237] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:16.891288 28633 catalog_manager.cc:5654] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 1 to 2, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68). New cstate: current_term: 2 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:16.905061 29974 raft_consensus.cc:993] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc: : Instructing follower cf00f643e7da4a98a0a11ea92869c24a to start an election
I20260203 09:17:16.905558 29974 raft_consensus.cc:1081] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Signalling peer cf00f643e7da4a98a0a11ea92869c24a to start an election
I20260203 09:17:16.908349 29462 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e"
dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
from {username='slave'} at 127.0.0.1:53326
I20260203 09:17:16.908998 29462 raft_consensus.cc:493] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:16.909421 29462 raft_consensus.cc:3060] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:16.916476 29462 raft_consensus.cc:515] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:16.919100 29462 leader_election.cc:290] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:16.919248 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:16.919279 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:16.919996 28883 raft_consensus.cc:3055] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:16.920082 28806 raft_consensus.cc:3060] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:16.920333 28883 raft_consensus.cc:740] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:16.921144 28883 consensus_queue.cc:260] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:16.922189 28883 raft_consensus.cc:3060] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:16.925153 28806 raft_consensus.cc:2468] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:16.926282 29425 leader_election.cc:304] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:16.927172 29902 raft_consensus.cc:2804] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:16.927670 29902 raft_consensus.cc:697] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:16.927886 28883 raft_consensus.cc:2468] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:16.928797 29902 consensus_queue.cc:237] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:16.931995 29818 raft_consensus.cc:993] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e: : Instructing follower 77541303e1934638ba82f0f43f707adc to start an election
I20260203 09:17:16.932471 29954 raft_consensus.cc:1081] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Signalling peer 77541303e1934638ba82f0f43f707adc to start an election
I20260203 09:17:16.936590 28883 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "f40d17692ce0424589f3962011b49824"
dest_uuid: "77541303e1934638ba82f0f43f707adc"
from {username='slave'} at 127.0.0.1:40946
I20260203 09:17:16.937173 28883 raft_consensus.cc:493] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:16.937556 28883 raft_consensus.cc:3060] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:16.938748 28633 catalog_manager.cc:5654] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 1 to 2, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68). New cstate: current_term: 2 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:16.943643 28883 raft_consensus.cc:515] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:16.946066 29974 raft_consensus.cc:993] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc: : Instructing follower cf00f643e7da4a98a0a11ea92869c24a to start an election
I20260203 09:17:16.946374 28883 leader_election.cc:290] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:16.946557 29974 raft_consensus.cc:1081] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Signalling peer cf00f643e7da4a98a0a11ea92869c24a to start an election
I20260203 09:17:16.948832 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:16.949290 28806 raft_consensus.cc:3060] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:16.949456 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:16.949997 28738 raft_consensus.cc:3055] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:16.950259 28738 raft_consensus.cc:740] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:16.950915 28738 consensus_queue.cc:260] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:16.952075 28738 raft_consensus.cc:3060] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:16.953982 29464 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00"
dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
from {username='slave'} at 127.0.0.1:53326
I20260203 09:17:16.954609 29464 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:16.955068 29464 raft_consensus.cc:3060] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:16.956451 28806 raft_consensus.cc:2468] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:16.959408 28851 leader_election.cc:304] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:16.960393 29876 raft_consensus.cc:993] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc: : Instructing follower be3b58b70fd74625a8ae8dfd7db7f6ee to start an election
I20260203 09:17:16.960987 29974 raft_consensus.cc:2804] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:16.961414 29890 raft_consensus.cc:1081] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Signalling peer be3b58b70fd74625a8ae8dfd7db7f6ee to start an election
I20260203 09:17:16.961625 29974 raft_consensus.cc:697] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 3 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:16.962481 29974 consensus_queue.cc:237] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:16.963007 29464 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:16.963867 28806 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "113a394f120048c58168ad22915e0187"
dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
from {username='slave'} at 127.0.0.1:36388
I20260203 09:17:16.964731 29464 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:16.964464 28806 raft_consensus.cc:493] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:16.965358 28806 raft_consensus.cc:3060] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:16.966368 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:16.966490 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:16.967058 28883 raft_consensus.cc:3055] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:16.967092 28730 raft_consensus.cc:3060] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:16.967473 28883 raft_consensus.cc:740] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:16.968776 28883 consensus_queue.cc:260] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:16.969803 28883 raft_consensus.cc:3060] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:16.975909 28806 raft_consensus.cc:515] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:16.978041 29992 ts_tablet_manager.cc:933] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:16.978917 28883 raft_consensus.cc:2468] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:16.978781 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:16.979573 28732 raft_consensus.cc:3060] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:16.980777 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:16.981391 28885 raft_consensus.cc:3055] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:16.981686 28885 raft_consensus.cc:740] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:16.982429 28885 consensus_queue.cc:260] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:16.983117 28730 raft_consensus.cc:2468] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:16.983544 28885 raft_consensus.cc:3060] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:16.984181 29991 ts_tablet_manager.cc:933] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967)
I20260203 09:17:16.984321 29426 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:16.985719 29962 raft_consensus.cc:2804] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:16.986161 29962 raft_consensus.cc:697] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:16.987008 29962 consensus_queue.cc:237] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:16.988296 28732 raft_consensus.cc:2468] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:16.989571 28777 leader_election.cc:304] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:16.990592 29947 raft_consensus.cc:2804] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:16.991056 29947 raft_consensus.cc:697] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:16.991853 29947 consensus_queue.cc:237] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:16.988721 28738 raft_consensus.cc:2468] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:16.996752 28806 leader_election.cc:290] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:16.998694 29992 tablet_copy_client.cc:323] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.67:42899
I20260203 09:17:17.003314 28899 tablet_copy_service.cc:140] P 77541303e1934638ba82f0f43f707adc: Received BeginTabletCopySession request for tablet c4b4d20256154aa1a7644698755531fd from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:59280)
I20260203 09:17:17.003856 28899 tablet_copy_service.cc:161] P 77541303e1934638ba82f0f43f707adc: Beginning new tablet copy session on tablet c4b4d20256154aa1a7644698755531fd from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:59280: session id = cf00f643e7da4a98a0a11ea92869c24a-c4b4d20256154aa1a7644698755531fd
I20260203 09:17:17.004469 28885 raft_consensus.cc:2468] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:17.011649 28633 catalog_manager.cc:5654] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 1 to 2, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68). New cstate: current_term: 2 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:17.030483 28635 catalog_manager.cc:5654] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 2 to 3, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 3 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:17:17.035516 28633 catalog_manager.cc:5654] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 1 to 2, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 2 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:17.037284 28899 tablet_copy_source_session.cc:215] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:17.043407 29968 raft_consensus.cc:993] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee: : Instructing follower cf00f643e7da4a98a0a11ea92869c24a to start an election
I20260203 09:17:17.043881 29968 raft_consensus.cc:1081] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Signalling peer cf00f643e7da4a98a0a11ea92869c24a to start an election
I20260203 09:17:17.044334 29992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b4d20256154aa1a7644698755531fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:17.046449 29462 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b"
dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
from {username='slave'} at 127.0.0.1:53310
I20260203 09:17:17.047799 29462 raft_consensus.cc:493] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:17.048211 29462 raft_consensus.cc:3060] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:17.057056 29991 tablet_copy_client.cc:323] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.65:37967
I20260203 09:17:17.058674 28748 tablet_copy_service.cc:140] P 847a7af9f0e2497cbb9025cc2c62557e: Received BeginTabletCopySession request for tablet 0d2d0debbeba46b086bb9d7344d2181b from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:45044)
I20260203 09:17:17.059194 28748 tablet_copy_service.cc:161] P 847a7af9f0e2497cbb9025cc2c62557e: Beginning new tablet copy session on tablet 0d2d0debbeba46b086bb9d7344d2181b from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:45044: session id = cf00f643e7da4a98a0a11ea92869c24a-0d2d0debbeba46b086bb9d7344d2181b
I20260203 09:17:17.061806 29992 tablet_copy_client.cc:806] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:17.062440 29992 tablet_copy_client.cc:670] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:17.070533 28748 tablet_copy_source_session.cc:215] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:17.079035 29991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d2d0debbeba46b086bb9d7344d2181b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:17.075753 29462 raft_consensus.cc:515] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:17.082748 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:17.083314 28805 raft_consensus.cc:3055] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:17.083585 28805 raft_consensus.cc:740] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:17.083845 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:17.084367 28883 raft_consensus.cc:3060] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:17.084275 28805 consensus_queue.cc:260] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:17.085376 28805 raft_consensus.cc:3060] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:17.086053 29992 tablet_copy_client.cc:538] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:17.093858 28883 raft_consensus.cc:2468] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:17.094952 29426 leader_election.cc:304] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:17.095827 29962 raft_consensus.cc:2804] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:17.096303 29962 raft_consensus.cc:697] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:17.097503 28805 raft_consensus.cc:2468] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:17.097157 29962 consensus_queue.cc:237] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:17.098963 29462 leader_election.cc:290] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:17.098121 29997 ts_tablet_manager.cc:933] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:17.107738 29992 tablet_bootstrap.cc:492] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:17.113607 29991 tablet_copy_client.cc:806] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:17.115718 29991 tablet_copy_client.cc:670] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:17.124720 29991 tablet_copy_client.cc:538] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:17.134866 28635 catalog_manager.cc:5654] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 1 to 2, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68). New cstate: current_term: 2 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:17.147820 29991 tablet_bootstrap.cc:492] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:17.157582 29990 raft_consensus.cc:993] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc: : Instructing follower 847a7af9f0e2497cbb9025cc2c62557e to start an election
I20260203 09:17:17.158209 29889 raft_consensus.cc:1081] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Signalling peer 847a7af9f0e2497cbb9025cc2c62557e to start an election
I20260203 09:17:17.160183 28732 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f"
dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
from {username='slave'} at 127.0.0.1:43612
I20260203 09:17:17.170871 28732 raft_consensus.cc:493] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:17.175905 28732 raft_consensus.cc:3060] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:17.193260 29992 tablet_bootstrap.cc:492] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:17.194072 30001 ts_tablet_manager.cc:933] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967)
I20260203 09:17:17.194602 29992 tablet_bootstrap.cc:492] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:17.206084 29992 ts_tablet_manager.cc:1403] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.099s user 0.015s sys 0.016s
I20260203 09:17:17.199584 28732 raft_consensus.cc:515] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:17.209596 28732 leader_election.cc:290] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:17.205009 29997 tablet_copy_client.cc:323] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.67:42899
I20260203 09:17:17.210204 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:17.209152 29992 raft_consensus.cc:359] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:17.210945 29992 raft_consensus.cc:740] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:17.210816 28806 raft_consensus.cc:3060] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:17.211984 29992 consensus_queue.cc:260] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:17.212453 28899 tablet_copy_service.cc:140] P 77541303e1934638ba82f0f43f707adc: Received BeginTabletCopySession request for tablet b5ccabd714ab40bab140c7a90667ddd6 from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:59280)
I20260203 09:17:17.213076 28899 tablet_copy_service.cc:161] P 77541303e1934638ba82f0f43f707adc: Beginning new tablet copy session on tablet b5ccabd714ab40bab140c7a90667ddd6 from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:59280: session id = cf00f643e7da4a98a0a11ea92869c24a-b5ccabd714ab40bab140c7a90667ddd6
I20260203 09:17:17.215600 29992 ts_tablet_manager.cc:1434] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260203 09:17:17.218562 29991 tablet_bootstrap.cc:492] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:17.219033 28898 tablet_copy_service.cc:342] P 77541303e1934638ba82f0f43f707adc: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-c4b4d20256154aa1a7644698755531fd received from {username='slave'} at 127.0.0.1:59280
I20260203 09:17:17.222265 28898 tablet_copy_service.cc:434] P 77541303e1934638ba82f0f43f707adc: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-c4b4d20256154aa1a7644698755531fd on tablet c4b4d20256154aa1a7644698755531fd with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:17.222750 29991 tablet_bootstrap.cc:492] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:17.223520 29991 ts_tablet_manager.cc:1403] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.076s user 0.019s sys 0.005s
I20260203 09:17:17.218595 28806 raft_consensus.cc:2468] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:17.210251 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:17.238209 28700 leader_election.cc:304] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:17.238435 28883 raft_consensus.cc:3055] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:17.239418 28883 raft_consensus.cc:740] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:17.241019 28883 consensus_queue.cc:260] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:17.242326 29957 raft_consensus.cc:2804] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:17.244493 29957 raft_consensus.cc:697] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:17.245584 29957 consensus_queue.cc:237] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:17.226359 29991 raft_consensus.cc:359] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:17.247085 29991 raft_consensus.cc:740] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:17.247813 29991 consensus_queue.cc:260] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:17.243177 28899 tablet_copy_source_session.cc:215] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:17.249732 28883 raft_consensus.cc:3060] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:17.257184 29991 ts_tablet_manager.cc:1434] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.033s user 0.007s sys 0.001s
I20260203 09:17:17.258996 28748 tablet_copy_service.cc:342] P 847a7af9f0e2497cbb9025cc2c62557e: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-0d2d0debbeba46b086bb9d7344d2181b received from {username='slave'} at 127.0.0.1:45044
I20260203 09:17:17.259456 28748 tablet_copy_service.cc:434] P 847a7af9f0e2497cbb9025cc2c62557e: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-0d2d0debbeba46b086bb9d7344d2181b on tablet 0d2d0debbeba46b086bb9d7344d2181b with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:17.272928 29997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ccabd714ab40bab140c7a90667ddd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:17.289086 30001 tablet_copy_client.cc:323] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.65:37967
I20260203 09:17:17.290649 28748 tablet_copy_service.cc:140] P 847a7af9f0e2497cbb9025cc2c62557e: Received BeginTabletCopySession request for tablet 2f652d76b6054b738b66531829291e55 from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:45044)
I20260203 09:17:17.291277 28748 tablet_copy_service.cc:161] P 847a7af9f0e2497cbb9025cc2c62557e: Beginning new tablet copy session on tablet 2f652d76b6054b738b66531829291e55 from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:45044: session id = cf00f643e7da4a98a0a11ea92869c24a-2f652d76b6054b738b66531829291e55
I20260203 09:17:17.291407 28883 raft_consensus.cc:2468] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:17.290932 28634 catalog_manager.cc:5654] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 1 to 2, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 2 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:17.299562 28748 tablet_copy_source_session.cc:215] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:17.303190 30001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f652d76b6054b738b66531829291e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:17.304006 29997 tablet_copy_client.cc:806] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:17.304603 29997 tablet_copy_client.cc:670] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:17.308286 29997 tablet_copy_client.cc:538] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:17.318406 30001 tablet_copy_client.cc:806] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:17.319089 30001 tablet_copy_client.cc:670] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:17.318729 29997 tablet_bootstrap.cc:492] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:17.325718 28806 raft_consensus.cc:1275] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:17.327287 30001 tablet_copy_client.cc:538] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:17.327579 29962 consensus_queue.cc:1048] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:17.402673 30001 tablet_bootstrap.cc:492] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:17.432329 28731 raft_consensus.cc:1275] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:17:17.434250 29876 consensus_queue.cc:1048] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:17.440627 28888 raft_consensus.cc:1275] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:17.444254 29965 consensus_queue.cc:1048] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:17:17.451614 29997 tablet_bootstrap.cc:492] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:17.452785 29997 tablet_bootstrap.cc:492] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:17.453601 29997 ts_tablet_manager.cc:1403] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.135s user 0.047s sys 0.034s
I20260203 09:17:17.457154 28883 raft_consensus.cc:1275] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:17.458573 29962 consensus_queue.cc:1048] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:17.471050 29997 raft_consensus.cc:359] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:17.472582 29997 raft_consensus.cc:740] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:17.473567 29997 consensus_queue.cc:260] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:17.477012 29997 ts_tablet_manager.cc:1434] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.023s user 0.006s sys 0.007s
I20260203 09:17:17.478909 28899 tablet_copy_service.cc:342] P 77541303e1934638ba82f0f43f707adc: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-b5ccabd714ab40bab140c7a90667ddd6 received from {username='slave'} at 127.0.0.1:59280
I20260203 09:17:17.479385 28899 tablet_copy_service.cc:434] P 77541303e1934638ba82f0f43f707adc: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-b5ccabd714ab40bab140c7a90667ddd6 on tablet b5ccabd714ab40bab140c7a90667ddd6 with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:17.480603 28812 raft_consensus.cc:1275] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:17:17.482605 29876 consensus_queue.cc:1048] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:17.497628 28738 raft_consensus.cc:1275] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:17.503259 29947 consensus_queue.cc:1048] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:17.514961 29464 raft_consensus.cc:1217] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:17:17.523367 28806 raft_consensus.cc:1275] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:17.527820 28885 raft_consensus.cc:1275] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:17.528501 30007 consensus_queue.cc:1048] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260203 09:17:17.533177 28883 raft_consensus.cc:1275] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:17.535465 29462 raft_consensus.cc:1217] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2] Dedup: 2.2->[]
I20260203 09:17:17.535435 29962 consensus_queue.cc:1048] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260203 09:17:17.535921 30007 consensus_queue.cc:1048] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260203 09:17:17.563338 28738 raft_consensus.cc:1275] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:17.571898 30007 consensus_queue.cc:1048] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:17.603150 28888 raft_consensus.cc:1275] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:17.604839 29962 consensus_queue.cc:1048] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260203 09:17:17.605598 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 53192.5us
I20260203 09:17:17.609965 29462 raft_consensus.cc:1217] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:17:17.620571 28810 raft_consensus.cc:1275] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:17.623060 29962 consensus_queue.cc:1048] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260203 09:17:17.651208 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 70169.5us
I20260203 09:17:17.674896 28885 raft_consensus.cc:1275] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:17.681890 30001 tablet_bootstrap.cc:492] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:17.690287 29954 consensus_queue.cc:1048] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:17.716267 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:17:17.720180 28805 raft_consensus.cc:1275] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:17.723120 29818 consensus_queue.cc:1048] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:17.741488 30001 tablet_bootstrap.cc:492] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:17.743909 30001 ts_tablet_manager.cc:1403] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.341s user 0.013s sys 0.022s
I20260203 09:17:17.757179 30001 raft_consensus.cc:359] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:17.757980 30001 raft_consensus.cc:740] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:17.758533 30001 consensus_queue.cc:260] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:17.794179 30001 ts_tablet_manager.cc:1434] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.049s user 0.006s sys 0.000s
I20260203 09:17:17.802103 28748 tablet_copy_service.cc:342] P 847a7af9f0e2497cbb9025cc2c62557e: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-2f652d76b6054b738b66531829291e55 received from {username='slave'} at 127.0.0.1:45044
I20260203 09:17:17.802631 28748 tablet_copy_service.cc:434] P 847a7af9f0e2497cbb9025cc2c62557e: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-2f652d76b6054b738b66531829291e55 on tablet 2f652d76b6054b738b66531829291e55 with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:17.823896 28738 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "021e904a783c4cbc96e5aa625a34a2d8"
dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
mode: GRACEFUL
new_leader_uuid: "77541303e1934638ba82f0f43f707adc"
from {username='slave'} at 127.0.0.1:33896
I20260203 09:17:17.825136 28738 raft_consensus.cc:606] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Received request to transfer leadership to TS 77541303e1934638ba82f0f43f707adc
I20260203 09:17:17.827891 28738 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52"
dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
mode: GRACEFUL
new_leader_uuid: "77541303e1934638ba82f0f43f707adc"
from {username='slave'} at 127.0.0.1:33896
I20260203 09:17:17.828500 28738 raft_consensus.cc:606] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Received request to transfer leadership to TS 77541303e1934638ba82f0f43f707adc
I20260203 09:17:17.830653 28805 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec"
dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
mode: GRACEFUL
new_leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
from {username='slave'} at 127.0.0.1:60448
I20260203 09:17:17.831107 28805 raft_consensus.cc:606] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Received request to transfer leadership to TS 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:17.833563 28885 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "574d0205e57547c6938037563109a6d2"
dest_uuid: "77541303e1934638ba82f0f43f707adc"
mode: GRACEFUL
new_leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
from {username='slave'} at 127.0.0.1:57870
I20260203 09:17:17.834038 28885 raft_consensus.cc:606] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Received request to transfer leadership to TS cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:17.836086 28731 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "fabfb779b8894cf0b22204fe12768dc3"
dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
mode: GRACEFUL
new_leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
from {username='slave'} at 127.0.0.1:33896
I20260203 09:17:17.836616 28731 raft_consensus.cc:606] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Received request to transfer leadership to TS cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:17.839154 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260203 09:17:17.840521 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:17:17.841163 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:17:17.914150 29990 raft_consensus.cc:1064] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:17.916538 29990 consensus_queue.cc:237] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:17.922477 28805 raft_consensus.cc:1275] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260203 09:17:17.922827 29462 raft_consensus.cc:1275] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEARNER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260203 09:17:17.923815 28738 raft_consensus.cc:1275] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260203 09:17:17.923827 29990 consensus_queue.cc:1048] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:17:17.925186 29876 consensus_queue.cc:1048] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:17.925927 30020 consensus_queue.cc:1048] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:17.936637 29876 raft_consensus.cc:2955] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:17.938494 28738 raft_consensus.cc:2955] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:17.942389 28805 raft_consensus.cc:2955] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:17.946359 29462 raft_consensus.cc:2955] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:17.956094 28635 catalog_manager.cc:5654] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:17.984638 28889 consensus_queue.cc:237] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:18.010028 29957 raft_consensus.cc:993] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e: : Instructing follower cf00f643e7da4a98a0a11ea92869c24a to start an election
I20260203 09:17:18.010918 29954 raft_consensus.cc:1081] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Signalling peer cf00f643e7da4a98a0a11ea92869c24a to start an election
I20260203 09:17:18.013309 29462 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "fabfb779b8894cf0b22204fe12768dc3"
dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
from {username='slave'} at 127.0.0.1:53340
I20260203 09:17:18.014741 29462 raft_consensus.cc:493] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:18.015170 29462 raft_consensus.cc:3060] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:18.015583 29464 raft_consensus.cc:1275] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260203 09:17:18.018234 30020 consensus_queue.cc:1048] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:17:18.025457 28810 raft_consensus.cc:1275] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260203 09:17:18.027043 30019 consensus_queue.cc:1048] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:18.028445 29462 raft_consensus.cc:515] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:18.030572 29462 leader_election.cc:290] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:18.033713 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fabfb779b8894cf0b22204fe12768dc3" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:18.033107 30020 raft_consensus.cc:2955] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.034288 28889 raft_consensus.cc:3060] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:18.036501 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fabfb779b8894cf0b22204fe12768dc3" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:18.037101 28730 raft_consensus.cc:3055] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:18.037441 28730 raft_consensus.cc:740] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:18.037163 29464 raft_consensus.cc:2955] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.038118 28730 consensus_queue.cc:260] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:18.039306 28730 raft_consensus.cc:3060] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:18.042737 28889 raft_consensus.cc:2468] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:18.043980 29426 leader_election.cc:304] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:18.045472 29962 raft_consensus.cc:2804] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:18.045945 29962 raft_consensus.cc:697] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:18.046725 29962 consensus_queue.cc:237] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:18.050834 28810 raft_consensus.cc:2955] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.055487 28730 raft_consensus.cc:2468] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:18.055545 28619 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet c4b4d20256154aa1a7644698755531fd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:18.059495 30039 raft_consensus.cc:1064] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:18.058997 28634 catalog_manager.cc:5654] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New cstate: current_term: 2 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.062193 30039 consensus_queue.cc:237] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:18.067597 29464 raft_consensus.cc:1217] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:17:18.079906 28721 tablet_service.cc:1552] Processing DeleteTablet for tablet c4b4d20256154aa1a7644698755531fd with delete_type TABLET_DATA_TOMBSTONED (TS 847a7af9f0e2497cbb9025cc2c62557e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43606
I20260203 09:17:18.089763 28631 catalog_manager.cc:5654] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 1 to 2, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68). New cstate: current_term: 2 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:18.095561 30042 tablet_replica.cc:333] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:18.118811 29464 raft_consensus.cc:1275] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:18.118810 28889 raft_consensus.cc:1275] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:18.119374 28810 raft_consensus.cc:1275] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:18.120708 30039 consensus_queue.cc:1048] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:17:18.121469 29954 consensus_queue.cc:1048] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:18.123817 29954 consensus_queue.cc:1048] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:18.131637 29876 raft_consensus.cc:1064] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:18.134404 29876 consensus_queue.cc:237] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:18.140162 29947 raft_consensus.cc:993] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee: : Instructing follower 847a7af9f0e2497cbb9025cc2c62557e to start an election
I20260203 09:17:18.140753 29947 raft_consensus.cc:1081] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Signalling peer 847a7af9f0e2497cbb9025cc2c62557e to start an election
I20260203 09:17:18.143873 28738 raft_consensus.cc:1275] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:18.145171 29464 raft_consensus.cc:1275] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:18.145375 30020 consensus_queue.cc:1048] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:18.149019 30042 raft_consensus.cc:2243] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:18.149844 30020 consensus_queue.cc:1048] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:18.154084 30042 raft_consensus.cc:2272] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:18.157228 29954 raft_consensus.cc:2955] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.165011 28730 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec"
dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
from {username='slave'} at 127.0.0.1:43626
I20260203 09:17:18.165758 28885 raft_consensus.cc:2955] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.179998 30042 ts_tablet_manager.cc:1916] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:18.183444 29464 raft_consensus.cc:2955] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.186673 28730 raft_consensus.cc:493] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:18.187157 28730 raft_consensus.cc:3060] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:18.196055 28806 raft_consensus.cc:2955] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.212788 28631 catalog_manager.cc:5654] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:18.221045 30042 ts_tablet_manager.cc:1929] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260203 09:17:18.221638 30042 log.cc:1199] T c4b4d20256154aa1a7644698755531fd P 847a7af9f0e2497cbb9025cc2c62557e: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-0-root/wals/c4b4d20256154aa1a7644698755531fd
W20260203 09:17:18.227106 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 64450.2us
I20260203 09:17:18.231178 28806 raft_consensus.cc:1275] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:18.234122 28738 consensus_queue.cc:237] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:18.236145 29876 consensus_queue.cc:1048] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:18.231567 28619 catalog_manager.cc:4985] TS 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): tablet c4b4d20256154aa1a7644698755531fd (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:17:18.259891 29462 raft_consensus.cc:1275] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:18.261441 28730 raft_consensus.cc:515] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:18.268114 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:18.268832 28806 raft_consensus.cc:3055] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:18.269232 28806 raft_consensus.cc:740] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:18.268461 29464 raft_consensus.cc:2955] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.270035 28806 consensus_queue.cc:260] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:18.271589 28806 raft_consensus.cc:3060] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:18.273200 28883 raft_consensus.cc:1275] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:18.262636 29954 consensus_queue.cc:1048] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:18.261169 30020 raft_consensus.cc:2955] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.273756 28730 leader_election.cc:290] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:18.279779 28806 raft_consensus.cc:2468] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:18.282120 28700 leader_election.cc:304] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:18.282800 30039 consensus_queue.cc:1048] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:18.283260 29954 raft_consensus.cc:2804] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:18.284132 29954 raft_consensus.cc:697] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:18.285090 29954 consensus_queue.cc:237] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:18.286588 28631 catalog_manager.cc:5654] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.293067 29957 raft_consensus.cc:2955] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.296482 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:18.297143 28885 raft_consensus.cc:3060] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:18.301018 29462 raft_consensus.cc:2955] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.304533 28635 catalog_manager.cc:5654] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 1 to 2, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 2 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:18.308070 28883 raft_consensus.cc:2955] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.310971 28619 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 0d2d0debbeba46b086bb9d7344d2181b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:18.321350 28812 raft_consensus.cc:2955] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.323872 28631 catalog_manager.cc:5654] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:18.341943 28730 raft_consensus.cc:2955] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.343366 28885 raft_consensus.cc:2468] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:18.368288 29954 raft_consensus.cc:993] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e: : Instructing follower 77541303e1934638ba82f0f43f707adc to start an election
I20260203 09:17:18.368489 30052 raft_consensus.cc:993] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e: : Instructing follower 77541303e1934638ba82f0f43f707adc to start an election
I20260203 09:17:18.369081 29957 raft_consensus.cc:1081] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Signalling peer 77541303e1934638ba82f0f43f707adc to start an election
I20260203 09:17:18.369355 30039 raft_consensus.cc:1081] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Signalling peer 77541303e1934638ba82f0f43f707adc to start an election
I20260203 09:17:18.370497 28888 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52"
dest_uuid: "77541303e1934638ba82f0f43f707adc"
from {username='slave'} at 127.0.0.1:40946
I20260203 09:17:18.371035 28888 raft_consensus.cc:493] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:18.371363 28888 raft_consensus.cc:3060] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:18.371693 28885 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "021e904a783c4cbc96e5aa625a34a2d8"
dest_uuid: "77541303e1934638ba82f0f43f707adc"
from {username='slave'} at 127.0.0.1:40946
I20260203 09:17:18.375645 28885 raft_consensus.cc:493] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:18.376049 28885 raft_consensus.cc:3060] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:18.378080 28802 tablet_service.cc:1552] Processing DeleteTablet for tablet 0d2d0debbeba46b086bb9d7344d2181b with delete_type TABLET_DATA_TOMBSTONED (TS be3b58b70fd74625a8ae8dfd7db7f6ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36384
I20260203 09:17:18.382128 28888 raft_consensus.cc:515] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:18.385294 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:18.385883 29462 raft_consensus.cc:3060] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:18.387356 29876 raft_consensus.cc:993] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc: : Instructing follower cf00f643e7da4a98a0a11ea92869c24a to start an election
I20260203 09:17:18.387794 29876 raft_consensus.cc:1081] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Signalling peer cf00f643e7da4a98a0a11ea92869c24a to start an election
I20260203 09:17:18.388064 28883 consensus_queue.cc:237] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:18.389389 29464 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "574d0205e57547c6938037563109a6d2"
dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
from {username='slave'} at 127.0.0.1:53326
I20260203 09:17:18.389916 29464 raft_consensus.cc:493] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:18.390269 29464 raft_consensus.cc:3060] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:18.393545 29463 raft_consensus.cc:1275] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:18.395411 29974 consensus_queue.cc:1048] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:17:18.383970 28888 leader_election.cc:290] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:18.396508 29464 raft_consensus.cc:515] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:18.398383 28812 raft_consensus.cc:1275] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:18.400466 29464 leader_election.cc:290] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:18.401767 30020 consensus_queue.cc:1048] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:18.399225 29462 raft_consensus.cc:2468] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:18.399729 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:18.402885 28806 raft_consensus.cc:3060] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:18.407804 28885 raft_consensus.cc:515] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:18.409457 28885 leader_election.cc:290] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:18.409759 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:18.410176 28806 raft_consensus.cc:2468] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:18.410341 28888 raft_consensus.cc:3055] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:18.410735 28888 raft_consensus.cc:740] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:18.411233 29425 leader_election.cc:304] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:18.411420 28888 consensus_queue.cc:260] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:18.412101 29902 raft_consensus.cc:2804] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:18.412570 29902 raft_consensus.cc:697] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:18.413818 29902 consensus_queue.cc:237] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:18.414856 30054 tablet_replica.cc:333] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:18.415946 29462 raft_consensus.cc:1240] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:18.417524 29954 consensus_queue.cc:1059] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:18.412554 28888 raft_consensus.cc:3060] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:18.418506 29954 raft_consensus.cc:3055] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:18.418861 29954 raft_consensus.cc:740] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:18.419832 28851 leader_election.cc:304] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:18.419610 29954 consensus_queue.cc:260] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:18.420578 29876 raft_consensus.cc:2804] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:18.421041 29876 raft_consensus.cc:697] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:18.421779 29876 consensus_queue.cc:237] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:18.425601 29954 raft_consensus.cc:3060] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:18.426399 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "021e904a783c4cbc96e5aa625a34a2d8" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:18.426548 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "021e904a783c4cbc96e5aa625a34a2d8" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:18.426988 28730 raft_consensus.cc:3055] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:18.427111 28806 raft_consensus.cc:3060] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:18.427343 28730 raft_consensus.cc:740] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:18.428138 28730 consensus_queue.cc:260] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:18.431236 28730 raft_consensus.cc:3060] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:18.433192 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:18.433789 28806 raft_consensus.cc:2468] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:18.436872 28888 raft_consensus.cc:2468] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:18.448770 28633 catalog_manager.cc:5654] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 1 to 2, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68). New cstate: current_term: 2 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:18.451946 28851 leader_election.cc:304] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:18.454178 30019 raft_consensus.cc:2804] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:18.454660 30019 raft_consensus.cc:697] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:18.455504 30019 consensus_queue.cc:237] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:18.450546 28732 raft_consensus.cc:2468] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:18.457895 29464 raft_consensus.cc:2955] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.459805 28730 raft_consensus.cc:2468] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:18.465992 30054 raft_consensus.cc:2243] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:18.466753 30054 raft_consensus.cc:2272] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:18.455893 30020 raft_consensus.cc:2955] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.470072 30054 ts_tablet_manager.cc:1916] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:18.470286 28806 raft_consensus.cc:2955] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.479661 28633 catalog_manager.cc:5654] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: config changed from index 3 to 4, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.481321 28635 catalog_manager.cc:5654] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 1 to 2, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 2 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:18.491447 30052 raft_consensus.cc:1064] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:18.494972 28619 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet b5ccabd714ab40bab140c7a90667ddd6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:18.497290 28883 raft_consensus.cc:1275] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:18.498934 29902 consensus_queue.cc:1048] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:18.502434 30052 consensus_queue.cc:237] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:18.524775 28721 tablet_service.cc:1552] Processing DeleteTablet for tablet b5ccabd714ab40bab140c7a90667ddd6 with delete_type TABLET_DATA_TOMBSTONED (TS 847a7af9f0e2497cbb9025cc2c62557e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43606
I20260203 09:17:18.525707 30042 tablet_replica.cc:333] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:18.526727 30042 raft_consensus.cc:2243] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:18.527379 30042 raft_consensus.cc:2272] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:18.533152 30042 ts_tablet_manager.cc:1916] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:18.533787 28732 raft_consensus.cc:1275] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:18.535084 29902 consensus_queue.cc:1048] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:18.537249 30054 ts_tablet_manager.cc:1929] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:17:18.537776 30054 log.cc:1199] T 0d2d0debbeba46b086bb9d7344d2181b P be3b58b70fd74625a8ae8dfd7db7f6ee: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-1-root/wals/0d2d0debbeba46b086bb9d7344d2181b
I20260203 09:17:18.539635 28618 catalog_manager.cc:4985] TS be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): tablet 0d2d0debbeba46b086bb9d7344d2181b (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:17:18.543186 28631 catalog_manager.cc:5654] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 1 to 2, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 2 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:17:18.557416 29464 raft_consensus.cc:1275] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:18.560195 29957 consensus_queue.cc:1048] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:17:18.571672 28888 raft_consensus.cc:1275] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:18.572312 28806 raft_consensus.cc:1275] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:18.574090 29954 consensus_queue.cc:1048] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:18.593832 30052 consensus_queue.cc:1048] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:18.594353 30042 ts_tablet_manager.cc:1929] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:17:18.594813 30042 log.cc:1199] T b5ccabd714ab40bab140c7a90667ddd6 P 847a7af9f0e2497cbb9025cc2c62557e: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-0-root/wals/b5ccabd714ab40bab140c7a90667ddd6
I20260203 09:17:18.596311 28619 catalog_manager.cc:4985] TS 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): tablet b5ccabd714ab40bab140c7a90667ddd6 (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:17:18.607758 29954 raft_consensus.cc:2955] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.611119 28883 raft_consensus.cc:2955] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.614892 28806 raft_consensus.cc:2955] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.621033 29464 raft_consensus.cc:2955] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.629889 28633 catalog_manager.cc:5654] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.656692 28730 consensus_queue.cc:237] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:18.661036 29464 raft_consensus.cc:1275] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:18.662217 28806 raft_consensus.cc:1275] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:18.662374 30052 consensus_queue.cc:1048] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:18.663727 29954 consensus_queue.cc:1048] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:18.669023 30052 raft_consensus.cc:2955] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.674816 28806 raft_consensus.cc:2955] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.674655 29462 raft_consensus.cc:2955] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:18.678622 28619 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 2f652d76b6054b738b66531829291e55 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:18.690950 28631 catalog_manager.cc:5654] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index 3 to 4, VOTER 77541303e1934638ba82f0f43f707adc (127.26.232.67) evicted. New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:18.706233 28872 tablet_service.cc:1552] Processing DeleteTablet for tablet 2f652d76b6054b738b66531829291e55 with delete_type TABLET_DATA_TOMBSTONED (TS 77541303e1934638ba82f0f43f707adc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40930
I20260203 09:17:18.707999 30068 tablet_replica.cc:333] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:18.709082 30068 raft_consensus.cc:2243] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:18.709971 30068 raft_consensus.cc:2272] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:18.713816 30068 ts_tablet_manager.cc:1916] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:18.732348 30068 ts_tablet_manager.cc:1929] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:17:18.732962 30068 log.cc:1199] T 2f652d76b6054b738b66531829291e55 P 77541303e1934638ba82f0f43f707adc: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-2-root/wals/2f652d76b6054b738b66531829291e55
I20260203 09:17:18.734658 28619 catalog_manager.cc:4985] TS 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): tablet 2f652d76b6054b738b66531829291e55 (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:17:18.819924 28888 raft_consensus.cc:1275] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:18.821602 30052 consensus_queue.cc:1048] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:18.830328 28806 raft_consensus.cc:1275] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:18.831354 30052 consensus_queue.cc:1048] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:18.888060 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:17:18.927302 28806 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad"
dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
mode: GRACEFUL
new_leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
from {username='slave'} at 127.0.0.1:60448
I20260203 09:17:18.927814 28806 raft_consensus.cc:606] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Received request to transfer leadership to TS 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:18.929863 28738 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d"
dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
mode: GRACEFUL
new_leader_uuid: "77541303e1934638ba82f0f43f707adc"
from {username='slave'} at 127.0.0.1:33896
I20260203 09:17:18.930280 28738 raft_consensus.cc:606] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Received request to transfer leadership to TS 77541303e1934638ba82f0f43f707adc
I20260203 09:17:18.932211 28888 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf"
dest_uuid: "77541303e1934638ba82f0f43f707adc"
mode: GRACEFUL
new_leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
from {username='slave'} at 127.0.0.1:57870
I20260203 09:17:18.932673 28888 raft_consensus.cc:606] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Received request to transfer leadership to TS cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:18.934736 28738 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0"
dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
mode: GRACEFUL
new_leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
from {username='slave'} at 127.0.0.1:33896
I20260203 09:17:18.935199 28738 raft_consensus.cc:606] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Received request to transfer leadership to TS cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:18.936007 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260203 09:17:18.937237 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:17:18.937872 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:17:18.941371 29462 raft_consensus.cc:1275] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:18.942479 30019 consensus_queue.cc:1048] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:18.950699 28738 raft_consensus.cc:1275] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:18.952241 29974 consensus_queue.cc:1048] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:18.966392 28888 raft_consensus.cc:1275] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:18.973295 29962 consensus_queue.cc:1048] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:18.974983 28806 raft_consensus.cc:1275] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:18.976235 30020 consensus_queue.cc:1048] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:19.003878 28812 raft_consensus.cc:1275] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:19.009784 28738 raft_consensus.cc:1275] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:19.011087 30052 raft_consensus.cc:993] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e: : Instructing follower cf00f643e7da4a98a0a11ea92869c24a to start an election
I20260203 09:17:19.014618 30052 raft_consensus.cc:1081] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Signalling peer cf00f643e7da4a98a0a11ea92869c24a to start an election
I20260203 09:17:19.016341 29462 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0"
dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
from {username='slave'} at 127.0.0.1:53340
I20260203 09:17:19.016901 29462 raft_consensus.cc:493] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:19.017204 29462 raft_consensus.cc:3060] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:19.019793 30019 consensus_queue.cc:1048] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:17:19.032565 29902 consensus_queue.cc:1048] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260203 09:17:19.040838 29462 raft_consensus.cc:515] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:19.042747 29462 leader_election.cc:290] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:19.043776 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:19.043910 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:19.044485 28810 raft_consensus.cc:3060] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:19.044379 28730 raft_consensus.cc:3055] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:19.046332 28730 raft_consensus.cc:740] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:19.047044 28730 consensus_queue.cc:260] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:19.048230 28730 raft_consensus.cc:3060] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:19.055136 28730 raft_consensus.cc:2468] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:19.056334 29426 leader_election.cc:304] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:19.057118 29902 raft_consensus.cc:2804] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:19.057571 29902 raft_consensus.cc:697] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:19.057694 28810 raft_consensus.cc:2468] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:19.058481 29902 consensus_queue.cc:237] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:19.072708 28635 catalog_manager.cc:5654] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 1 to 2, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68). New cstate: current_term: 2 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:19.106948 29954 raft_consensus.cc:993] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e: : Instructing follower 77541303e1934638ba82f0f43f707adc to start an election
I20260203 09:17:19.107388 30052 raft_consensus.cc:1081] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Signalling peer 77541303e1934638ba82f0f43f707adc to start an election
I20260203 09:17:19.108736 28888 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d"
dest_uuid: "77541303e1934638ba82f0f43f707adc"
from {username='slave'} at 127.0.0.1:40946
I20260203 09:17:19.109176 28888 raft_consensus.cc:493] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:19.109416 28888 raft_consensus.cc:3060] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:19.114291 28888 raft_consensus.cc:515] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:19.115564 28888 leader_election.cc:290] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:19.116365 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:19.116500 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:19.117036 28730 raft_consensus.cc:3055] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:19.117106 28812 raft_consensus.cc:3060] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:19.117307 28730 raft_consensus.cc:740] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:19.117895 28730 consensus_queue.cc:260] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:19.118705 28730 raft_consensus.cc:3060] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:19.122164 28812 raft_consensus.cc:2468] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:19.122969 28851 leader_election.cc:304] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:19.123649 30019 raft_consensus.cc:2804] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:19.124449 30019 raft_consensus.cc:697] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 3 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:19.125345 28730 raft_consensus.cc:2468] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:19.125322 30019 consensus_queue.cc:237] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:19.135237 28633 catalog_manager.cc:5654] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 2 to 3, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 3 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:17:19.254304 30078 raft_consensus.cc:993] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee: : Instructing follower 847a7af9f0e2497cbb9025cc2c62557e to start an election
I20260203 09:17:19.254738 30077 raft_consensus.cc:1081] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Signalling peer 847a7af9f0e2497cbb9025cc2c62557e to start an election
I20260203 09:17:19.256038 28730 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad"
dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
from {username='slave'} at 127.0.0.1:43626
I20260203 09:17:19.256570 28730 raft_consensus.cc:493] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:19.256940 28730 raft_consensus.cc:3060] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:19.263494 28730 raft_consensus.cc:515] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:19.265308 28730 leader_election.cc:290] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:19.266508 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:19.266815 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:19.267192 28812 raft_consensus.cc:3055] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:19.267364 28883 raft_consensus.cc:3060] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:19.267527 28812 raft_consensus.cc:740] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:19.268384 28812 consensus_queue.cc:260] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:19.269366 28812 raft_consensus.cc:3060] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:19.274889 28883 raft_consensus.cc:2468] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:19.276254 28701 leader_election.cc:304] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:19.277731 29957 raft_consensus.cc:2804] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:19.278808 29957 raft_consensus.cc:697] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:19.279888 29957 consensus_queue.cc:237] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:19.277439 28812 raft_consensus.cc:2468] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:19.292959 28633 catalog_manager.cc:5654] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 1 to 2, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 2 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:19.383496 29876 raft_consensus.cc:993] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc: : Instructing follower cf00f643e7da4a98a0a11ea92869c24a to start an election
I20260203 09:17:19.383956 29876 raft_consensus.cc:1081] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Signalling peer cf00f643e7da4a98a0a11ea92869c24a to start an election
I20260203 09:17:19.385264 29462 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf"
dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
from {username='slave'} at 127.0.0.1:53326
I20260203 09:17:19.385668 29462 raft_consensus.cc:493] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:19.385914 29462 raft_consensus.cc:3060] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:19.390309 29462 raft_consensus.cc:515] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:19.391772 29462 leader_election.cc:290] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:19.392519 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:19.392817 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:19.393184 28738 raft_consensus.cc:3060] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:19.393309 28888 raft_consensus.cc:3055] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:19.393643 28888 raft_consensus.cc:740] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:19.394274 28888 consensus_queue.cc:260] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:19.395660 28888 raft_consensus.cc:3060] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:19.399895 28738 raft_consensus.cc:2468] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:19.401368 29426 leader_election.cc:304] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:19.402320 28888 raft_consensus.cc:2468] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:19.402334 29962 raft_consensus.cc:2804] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:19.403316 29962 raft_consensus.cc:697] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:19.404362 29962 consensus_queue.cc:237] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:19.413293 28633 catalog_manager.cc:5654] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 1 to 2, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68). New cstate: current_term: 2 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:19.511699 28738 raft_consensus.cc:1275] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:19.513250 29962 consensus_queue.cc:1048] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:19.532585 28738 raft_consensus.cc:1275] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:17:19.537703 29876 consensus_queue.cc:1048] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:19.543184 28812 raft_consensus.cc:1275] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:19.544845 29962 consensus_queue.cc:1048] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:19.567745 28806 raft_consensus.cc:1275] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:17:19.569698 29974 consensus_queue.cc:1048] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:19.751165 28888 consensus_queue.cc:237] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
W20260203 09:17:19.757987 28851 consensus_peers.cc:597] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a09fae92b37497d8efa250f727c0fd9. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:19.758898 28738 raft_consensus.cc:1275] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:19.759467 28806 raft_consensus.cc:1275] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:19.760399 29974 consensus_queue.cc:1048] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:17:19.761523 29876 consensus_queue.cc:1048] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:19.770434 30020 raft_consensus.cc:2955] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:19.772603 28806 raft_consensus.cc:2955] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:19.772280 28738 raft_consensus.cc:2955] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:19.785921 28730 consensus_queue.cc:237] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:19.791172 28812 raft_consensus.cc:1275] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:19.792562 29954 consensus_queue.cc:1048] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:19.788933 28633 catalog_manager.cc:5654] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:19.823115 28883 raft_consensus.cc:1275] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:19.824514 29954 consensus_queue.cc:1048] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:19.849916 28883 raft_consensus.cc:1275] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260203 09:17:19.851231 30052 consensus_queue.cc:1048] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260203 09:17:19.852942 28700 consensus_peers.cc:597] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1862780e910a42d5a3414a9329cd9259. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:19.853928 28812 raft_consensus.cc:1275] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260203 09:17:19.858394 29954 consensus_queue.cc:1048] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:19.871248 29957 raft_consensus.cc:2955] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:19.873042 28812 raft_consensus.cc:2955] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:19.873696 28885 raft_consensus.cc:2955] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:19.889261 28631 catalog_manager.cc:5654] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index -1 to 3, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 2 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:19.890803 28730 consensus_queue.cc:237] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:19.897498 28885 raft_consensus.cc:1275] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:19.899202 28812 raft_consensus.cc:1275] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:19.898733 29957 consensus_queue.cc:1048] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260203 09:17:19.900449 28700 consensus_peers.cc:597] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e1bac12c6ee43d6901400e02b35d82f. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:19.901396 29954 consensus_queue.cc:1048] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:19.909628 28730 raft_consensus.cc:1275] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:19.911338 29962 consensus_queue.cc:1048] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:19.922886 29957 raft_consensus.cc:2955] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:19.928021 28812 raft_consensus.cc:2955] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:19.930070 28888 raft_consensus.cc:2955] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:19.935932 28885 raft_consensus.cc:1275] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:19.939579 29962 consensus_queue.cc:1048] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260203 09:17:19.955071 28738 consensus_queue.cc:237] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:19.971398 28635 catalog_manager.cc:5654] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260203 09:17:19.980249 28700 consensus_peers.cc:597] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 15917cb595b149fd847e4ab4424f8262. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:19.980926 28883 raft_consensus.cc:1275] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:19.983812 29954 consensus_queue.cc:1048] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:19.984558 28812 raft_consensus.cc:1275] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260203 09:17:19.986967 29954 consensus_queue.cc:1048] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:19.991039 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:17:20.020989 29957 raft_consensus.cc:2955] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:20.029279 28812 raft_consensus.cc:2955] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:20.029279 28885 raft_consensus.cc:2955] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:20.049484 28633 catalog_manager.cc:5654] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index -1 to 2, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 1 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:20.072002 28885 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "298c016813da45bdbc537b5851b5e728"
dest_uuid: "77541303e1934638ba82f0f43f707adc"
mode: GRACEFUL
new_leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
from {username='slave'} at 127.0.0.1:57870
I20260203 09:17:20.072762 28885 raft_consensus.cc:606] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Received request to transfer leadership to TS be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:20.084877 28738 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f"
dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
mode: GRACEFUL
new_leader_uuid: "77541303e1934638ba82f0f43f707adc"
from {username='slave'} at 127.0.0.1:33896
I20260203 09:17:20.085769 28738 raft_consensus.cc:606] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Received request to transfer leadership to TS 77541303e1934638ba82f0f43f707adc
I20260203 09:17:20.088088 28812 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c"
dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
mode: GRACEFUL
new_leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
from {username='slave'} at 127.0.0.1:60448
I20260203 09:17:20.088691 28812 raft_consensus.cc:606] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Received request to transfer leadership to TS 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:20.090278 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260203 09:17:20.091645 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:17:20.092263 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:17:20.212910 30077 raft_consensus.cc:993] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee: : Instructing follower 847a7af9f0e2497cbb9025cc2c62557e to start an election
I20260203 09:17:20.213379 30077 raft_consensus.cc:1081] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Signalling peer 847a7af9f0e2497cbb9025cc2c62557e to start an election
I20260203 09:17:20.214776 28738 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c"
dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
from {username='slave'} at 127.0.0.1:43626
I20260203 09:17:20.215265 28738 raft_consensus.cc:493] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:20.215574 28738 raft_consensus.cc:3060] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:20.221575 28738 raft_consensus.cc:515] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:20.223301 28738 leader_election.cc:290] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:20.223964 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:20.224207 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:20.224548 28812 raft_consensus.cc:3055] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:20.224774 29462 raft_consensus.cc:3060] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:20.225339 28812 raft_consensus.cc:740] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:20.226091 28812 consensus_queue.cc:260] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:20.227218 28812 raft_consensus.cc:3060] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:20.231400 29462 raft_consensus.cc:2468] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:20.233383 28812 raft_consensus.cc:2468] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:20.232328 28700 leader_election.cc:304] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:20.234364 29957 raft_consensus.cc:2804] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:20.235879 29957 raft_consensus.cc:697] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:20.236945 29957 consensus_queue.cc:237] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:20.248067 28633 catalog_manager.cc:5654] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 1 to 2, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 2 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:20.327950 30110 ts_tablet_manager.cc:933] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:20.329624 30110 tablet_copy_client.cc:323] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.67:42899
I20260203 09:17:20.331496 28899 tablet_copy_service.cc:140] P 77541303e1934638ba82f0f43f707adc: Received BeginTabletCopySession request for tablet 3a09fae92b37497d8efa250f727c0fd9 from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:59280)
I20260203 09:17:20.331967 28899 tablet_copy_service.cc:161] P 77541303e1934638ba82f0f43f707adc: Beginning new tablet copy session on tablet 3a09fae92b37497d8efa250f727c0fd9 from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:59280: session id = cf00f643e7da4a98a0a11ea92869c24a-3a09fae92b37497d8efa250f727c0fd9
I20260203 09:17:20.339128 28899 tablet_copy_source_session.cc:215] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:20.350679 30110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a09fae92b37497d8efa250f727c0fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:20.364320 30110 tablet_copy_client.cc:806] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:20.364959 30110 tablet_copy_client.cc:670] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:20.368184 30110 tablet_copy_client.cc:538] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:20.378130 30110 tablet_bootstrap.cc:492] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:20.426635 30110 tablet_bootstrap.cc:492] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:20.428184 30110 tablet_bootstrap.cc:492] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:20.429360 30110 ts_tablet_manager.cc:1403] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.051s user 0.017s sys 0.021s
I20260203 09:17:20.434749 30110 raft_consensus.cc:359] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:20.436616 30110 raft_consensus.cc:740] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:20.437636 30110 consensus_queue.cc:260] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:20.440626 30110 ts_tablet_manager.cc:1434] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.011s user 0.002s sys 0.005s
I20260203 09:17:21.393265 30115 raft_consensus.cc:493] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:21.394886 30115 raft_consensus.cc:515] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.400204 30115 leader_election.cc:290] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:21.442070 30119 raft_consensus.cc:493] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:21.443049 30119 raft_consensus.cc:515] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:21.457267 30119 leader_election.cc:290] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:21.468847 28759 debug-util.cc:398] Leaking SignalData structure 0x7b08000fac60 after lost signal to thread 27556
I20260203 09:17:21.476708 30115 raft_consensus.cc:493] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:21.484879 30115 raft_consensus.cc:515] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:21.481024 30114 raft_consensus.cc:493] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:21.490223 30123 raft_consensus.cc:493] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:21.506578 30114 raft_consensus.cc:515] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.507635 30117 raft_consensus.cc:493] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:21.508441 30117 raft_consensus.cc:515] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.512197 30121 raft_consensus.cc:493] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:21.516459 30123 raft_consensus.cc:515] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.513342 30117 leader_election.cc:290] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:21.520335 30123 leader_election.cc:290] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:21.522470 30115 leader_election.cc:290] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:21.529778 30121 raft_consensus.cc:515] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:21.541100 30126 raft_consensus.cc:493] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:21.512120 30114 leader_election.cc:290] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:21.537214 30119 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:21.549566 30124 raft_consensus.cc:493] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:21.542009 30126 raft_consensus.cc:515] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.556532 30007 raft_consensus.cc:493] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:21.550081 29902 raft_consensus.cc:493] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:21.565267 29902 raft_consensus.cc:515] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.565842 30077 raft_consensus.cc:493] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:21.556934 29974 raft_consensus.cc:493] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:21.566557 30077 raft_consensus.cc:515] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:21.545436 30117 raft_consensus.cc:493] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:21.556116 30116 raft_consensus.cc:493] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:21.558470 30123 raft_consensus.cc:493] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:21.557356 30007 raft_consensus.cc:515] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.579537 30124 raft_consensus.cc:515] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.566787 29974 raft_consensus.cc:515] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.596876 30116 raft_consensus.cc:515] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.603945 30117 raft_consensus.cc:515] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:21.606647 30117 leader_election.cc:290] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:21.606961 29974 leader_election.cc:290] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:21.607580 30125 raft_consensus.cc:493] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:21.609419 29902 leader_election.cc:290] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:21.598839 30118 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:21.608861 30125 raft_consensus.cc:515] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.624939 29902 raft_consensus.cc:493] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:21.626926 30119 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:21.628159 30122 raft_consensus.cc:493] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:21.620051 29974 raft_consensus.cc:493] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:21.634938 30131 raft_consensus.cc:493] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:21.617518 30123 raft_consensus.cc:515] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.635917 30124 leader_election.cc:290] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:21.621977 30126 leader_election.cc:290] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:21.619278 30117 raft_consensus.cc:493] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:21.655687 29974 raft_consensus.cc:515] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:21.638867 30121 leader_election.cc:290] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:21.641132 29902 raft_consensus.cc:515] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.649607 30128 raft_consensus.cc:493] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:21.658367 30129 raft_consensus.cc:493] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:21.654947 30135 raft_consensus.cc:493] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:21.655830 30117 raft_consensus.cc:515] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:21.654217 30134 raft_consensus.cc:493] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:21.636900 30118 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:21.671612 30120 raft_consensus.cc:493] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:21.668972 30126 raft_consensus.cc:493] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:21.673421 30121 raft_consensus.cc:493] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:21.658007 29974 leader_election.cc:290] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:21.678544 30136 raft_consensus.cc:493] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:21.679591 30117 leader_election.cc:290] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:21.681632 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:21.658376 29902 leader_election.cc:290] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:21.659032 30129 raft_consensus.cc:515] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.686246 30126 raft_consensus.cc:515] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:21.687250 30121 raft_consensus.cc:515] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:21.692953 30137 raft_consensus.cc:493] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:21.701457 30020 raft_consensus.cc:493] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:21.702220 30123 leader_election.cc:290] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:21.702087 30020 raft_consensus.cc:515] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:21.707926 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:21.707926 30125 leader_election.cc:290] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:21.697897 29974 raft_consensus.cc:493] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:21.708989 30127 raft_consensus.cc:493] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:21.709486 29974 raft_consensus.cc:515] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:21.695748 30124 raft_consensus.cc:493] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:21.700059 30132 raft_consensus.cc:493] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:21.697943 30077 leader_election.cc:290] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:21.702520 30120 raft_consensus.cc:515] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.714461 28899 tablet_copy_service.cc:342] P 77541303e1934638ba82f0f43f707adc: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-3a09fae92b37497d8efa250f727c0fd9 received from {username='slave'} at 127.0.0.1:59280
I20260203 09:17:21.692780 30131 raft_consensus.cc:515] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.714484 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:21.718713 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:21.692803 30122 raft_consensus.cc:515] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:21.705140 30117 raft_consensus.cc:493] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:21.725409 29957 raft_consensus.cc:493] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:21.720530 30007 leader_election.cc:290] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:21.719163 30118 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:21.721282 30077 raft_consensus.cc:493] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:21.732131 30133 raft_consensus.cc:493] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:21.747013 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b2c469d7255413d9f61a7cbaa4481a7" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:21.747576 30121 leader_election.cc:290] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:21.742012 30114 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:21.753829 30117 raft_consensus.cc:515] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:21.754297 30114 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.748304 30126 leader_election.cc:290] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:21.748577 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:21.749043 30116 leader_election.cc:290] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:21.700268 30128 raft_consensus.cc:515] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:21.709859 30127 raft_consensus.cc:515] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:21.750167 29957 raft_consensus.cc:515] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.722407 30136 raft_consensus.cc:515] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.758319 28806 raft_consensus.cc:2468] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:17:21.718501 30132 raft_consensus.cc:515] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.732149 30124 raft_consensus.cc:515] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.749886 28899 tablet_copy_service.cc:434] P 77541303e1934638ba82f0f43f707adc: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-3a09fae92b37497d8efa250f727c0fd9 on tablet 3a09fae92b37497d8efa250f727c0fd9 with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:21.751859 30119 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:21.710609 30134 raft_consensus.cc:515] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:21.757743 30121 raft_consensus.cc:493] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:21.759944 30118 raft_consensus.cc:493] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:21.767829 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:21.753713 30138 raft_consensus.cc:493] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:21.766396 30126 raft_consensus.cc:493] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:21.754591 30133 raft_consensus.cc:515] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:21.778921 29957 leader_election.cc:290] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:21.775487 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:21.718415 30135 raft_consensus.cc:515] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:21.784720 30129 leader_election.cc:290] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:21.777416 30134 leader_election.cc:290] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:21.792294 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:21.792857 29974 leader_election.cc:290] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:21.793256 28889 raft_consensus.cc:2468] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:21.783349 30077 raft_consensus.cc:515] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:21.719894 30137 raft_consensus.cc:515] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.796514 29957 raft_consensus.cc:493] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:21.806149 30077 leader_election.cc:290] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:21.806388 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:21.792387 30020 leader_election.cc:290] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:21.806002 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:21.823654 30120 leader_election.cc:290] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:21.821403 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:21.827857 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:21.825898 29957 raft_consensus.cc:515] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:21.804816 30127 leader_election.cc:290] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:21.794212 30118 raft_consensus.cc:515] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.839335 30141 raft_consensus.cc:493] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:21.840029 30141 raft_consensus.cc:515] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:21.821043 30117 leader_election.cc:290] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:21.818750 30077 raft_consensus.cc:493] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:21.800820 30126 raft_consensus.cc:515] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:21.817823 30125 raft_consensus.cc:493] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:21.858230 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:21.858104 28809 raft_consensus.cc:1275] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:21.829473 30134 raft_consensus.cc:493] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:21.858301 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b6f1d6e275f4a8ba99a70dbb3ea3235" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:21.829573 28813 raft_consensus.cc:2468] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 1.
I20260203 09:17:21.870729 30133 leader_election.cc:290] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:21.870363 29460 raft_consensus.cc:1217] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20260203 09:17:21.871740 30131 leader_election.cc:290] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:21.819348 30138 raft_consensus.cc:515] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.878998 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:21.879936 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b2c469d7255413d9f61a7cbaa4481a7" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:21.848073 30136 leader_election.cc:290] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:21.829851 30121 raft_consensus.cc:515] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:21.883121 29957 leader_election.cc:290] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:21.828439 30140 raft_consensus.cc:493] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:21.886221 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:21.868942 30132 leader_election.cc:290] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:21.895222 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:21.882584 30114 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:21.897259 30142 raft_consensus.cc:493] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:21.897480 30139 raft_consensus.cc:493] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:21.897092 30134 raft_consensus.cc:515] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.898141 30141 leader_election.cc:290] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:21.893507 28759 debug-util.cc:398] Leaking SignalData structure 0x7b0800120340 after lost signal to thread 28669
I20260203 09:17:21.898268 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:21.893158 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:21.883630 30133 raft_consensus.cc:493] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:21.931003 29463 raft_consensus.cc:2468] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:17:21.931077 30133 raft_consensus.cc:515] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:21.931392 30125 raft_consensus.cc:515] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:21.933231 30125 leader_election.cc:290] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:21.891048 30124 leader_election.cc:290] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:21.890901 30122 leader_election.cc:290] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:21.933166 30133 leader_election.cc:290] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:21.893537 30117 raft_consensus.cc:493] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:21.889921 30077 raft_consensus.cc:515] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:21.928238 30136 raft_consensus.cc:493] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:21.995599 29425 leader_election.cc:304] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:21.934419 30139 raft_consensus.cc:515] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:22.022250 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 87188.9us
I20260203 09:17:21.939569 30114 raft_consensus.cc:493] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:21.996222 30115 raft_consensus.cc:493] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
W20260203 09:17:21.960276 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 47190.7us
I20260203 09:17:22.046895 29463 raft_consensus.cc:1275] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:21.995720 30148 raft_consensus.cc:493] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:22.056864 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fabfb779b8894cf0b22204fe12768dc3" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:22.041906 30128 leader_election.cc:290] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.124626 29957 raft_consensus.cc:493] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:22.041281 30132 raft_consensus.cc:2804] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:21.994094 30142 raft_consensus.cc:515] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:21.990574 30140 raft_consensus.cc:515] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:22.044857 30135 leader_election.cc:290] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.019459 30136 raft_consensus.cc:515] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:22.122119 30125 raft_consensus.cc:493] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:22.127214 30118 leader_election.cc:290] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:22.143705 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.145229 30121 leader_election.cc:290] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.129835 30126 leader_election.cc:290] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.122630 30138 leader_election.cc:290] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:22.143579 30077 leader_election.cc:290] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:22.149058 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 49721.8us
I20260203 09:17:22.135788 30132 raft_consensus.cc:493] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:22.133875 30137 leader_election.cc:290] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.139760 30122 raft_consensus.cc:493] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:22.155521 29957 raft_consensus.cc:515] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:22.145433 30147 raft_consensus.cc:493] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:22.147924 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:22.129364 30115 raft_consensus.cc:515] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:22.125311 30117 raft_consensus.cc:515] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:22.146869 30128 raft_consensus.cc:493] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:22.148420 30141 raft_consensus.cc:493] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:22.158958 30132 raft_consensus.cc:3060] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:22.146693 30114 raft_consensus.cc:515] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:22.153199 30148 raft_consensus.cc:515] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:22.176735 30145 raft_consensus.cc:493] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:22.178257 29957 leader_election.cc:290] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.160328 30149 raft_consensus.cc:493] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:22.177662 30136 leader_election.cc:290] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:22.169371 30154 raft_consensus.cc:493] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:22.174716 30135 raft_consensus.cc:493] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:22.169469 30156 raft_consensus.cc:493] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:22.177377 30145 raft_consensus.cc:515] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:22.190335 30142 leader_election.cc:290] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.168977 30122 raft_consensus.cc:515] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:22.192319 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:22.192875 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 337114us
I20260203 09:17:22.194147 30122 leader_election.cc:290] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:22.187498 30140 leader_election.cc:290] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.180012 30125 raft_consensus.cc:515] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:22.199584 28777 leader_election.cc:304] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:22.175997 30141 raft_consensus.cc:515] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:22.181237 30020 raft_consensus.cc:493] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:22.200381 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.209062 30125 leader_election.cc:290] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.210211 30153 raft_consensus.cc:493] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:22.185395 30120 raft_consensus.cc:493] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:22.200906 30148 leader_election.cc:290] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:22.181656 30151 raft_consensus.cc:493] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:22.208691 30020 raft_consensus.cc:515] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:22.200423 30149 raft_consensus.cc:515] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:22.198527 29957 consensus_queue.cc:1048] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260203 09:17:22.207569 30117 leader_election.cc:290] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:22.182066 30147 raft_consensus.cc:515] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:22.213682 30136 raft_consensus.cc:2804] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260203 09:17:22.199084 28759 debug-util.cc:398] Leaking SignalData structure 0x7b080028cf60 after lost signal to thread 28762
I20260203 09:17:22.195371 30139 leader_election.cc:290] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:22.198900 30114 leader_election.cc:290] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.199862 30134 leader_election.cc:290] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:22.185171 30135 raft_consensus.cc:515] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:22.185672 30128 raft_consensus.cc:515] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:22.215422 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:22.215823 30120 raft_consensus.cc:515] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:22.210988 30153 raft_consensus.cc:515] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:22.232218 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.233389 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.231207 28851 leader_election.cc:304] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:22.211865 30156 raft_consensus.cc:515] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:22.235391 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.235523 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.236127 28885 raft_consensus.cc:2468] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:17:22.221256 30136 raft_consensus.cc:493] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:22.197244 30154 raft_consensus.cc:515] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:22.232918 28883 raft_consensus.cc:2468] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
W20260203 09:17:22.232146 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 44151us
I20260203 09:17:22.239804 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.240355 28887 raft_consensus.cc:2468] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:22.250502 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.251135 28885 raft_consensus.cc:2468] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:17:22.233901 29459 raft_consensus.cc:2468] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:17:22.241766 30136 raft_consensus.cc:3060] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:22.245885 30117 raft_consensus.cc:2804] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:22.261381 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.252255 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.285844 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.285995 30115 leader_election.cc:290] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:22.290683 30020 leader_election.cc:290] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:22.293172 30141 leader_election.cc:290] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.293066 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.263695 30134 raft_consensus.cc:493] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:22.294193 30134 raft_consensus.cc:515] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:22.296228 30134 leader_election.cc:290] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.298218 30149 leader_election.cc:290] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.237375 30151 raft_consensus.cc:515] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:22.261287 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:17:22.299037 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.294188 28887 raft_consensus.cc:2468] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:17:22.342988 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:22.477632 29462 raft_consensus.cc:2468] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:17:22.293594 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.468712 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.479934 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.480414 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.294716 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:22.465997 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.344977 30158 ts_tablet_manager.cc:933] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967)
I20260203 09:17:22.300522 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.494289 28888 raft_consensus.cc:2468] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:17:22.486686 28885 raft_consensus.cc:2468] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:22.481389 28805 raft_consensus.cc:2468] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:17:22.480104 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.480026 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.299609 30145 leader_election.cc:290] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.491631 30151 leader_election.cc:290] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.491700 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.345494 30147 leader_election.cc:290] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:22.491655 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.299535 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.343852 30153 leader_election.cc:290] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.410773 30120 leader_election.cc:290] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:22.348578 30128 leader_election.cc:290] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.409183 30154 leader_election.cc:290] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.464838 30135 leader_election.cc:290] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.511554 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.512178 28731 raft_consensus.cc:2468] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:17:22.490924 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.469516 30132 raft_consensus.cc:515] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:22.448030 30117 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:22.405416 30156 leader_election.cc:290] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:22.493402 28759 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5220 after lost signal to thread 28838
I20260203 09:17:22.467644 30161 ts_tablet_manager.cc:933] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967)
I20260203 09:17:22.506268 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.505689 28811 raft_consensus.cc:2468] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:17:22.506834 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.339843 30155 raft_consensus.cc:493] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:22.509325 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.513420 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.499864 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.519634 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.505303 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.517479 30120 raft_consensus.cc:493] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:22.521932 29462 raft_consensus.cc:1240] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:22.520603 30020 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:22.522212 30120 raft_consensus.cc:515] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:22.522970 30020 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:22.524276 30120 leader_election.cc:290] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:22.524911 30020 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:22.521960 30155 raft_consensus.cc:515] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:22.526938 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.527854 30155 leader_election.cc:290] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.529358 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47301e2bbfc94767a9905b0e12141d6d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.516372 30117 raft_consensus.cc:3060] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:22.517652 30162 raft_consensus.cc:493] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:22.534538 30162 raft_consensus.cc:515] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:22.535454 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:22.537654 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:22.537854 28759 debug-util.cc:398] Leaking SignalData structure 0x7b080030b060 after lost signal to thread 28913
I20260203 09:17:22.539098 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:22.539499 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.539872 29460 raft_consensus.cc:2393] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 2: Already voted for candidate cf00f643e7da4a98a0a11ea92869c24a in this term.
I20260203 09:17:22.540082 29457 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:22.540319 29461 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:22.540777 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:22.540982 29458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:22.542953 28888 raft_consensus.cc:2468] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 1.
I20260203 09:17:22.550441 28777 leader_election.cc:304] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:22.551187 28777 leader_election.cc:304] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:22.551818 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "021e904a783c4cbc96e5aa625a34a2d8" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:22.539057 28759 debug-util.cc:398] Leaking SignalData structure 0x7b080030d640 after lost signal to thread 29491
I20260203 09:17:22.553372 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.554003 28777 leader_election.cc:304] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:22.554674 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.554765 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.556973 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.557844 28777 leader_election.cc:304] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:22.562078 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:22.563736 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:22.564265 28777 leader_election.cc:304] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:22.564867 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.564754 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:22.546836 30162 leader_election.cc:290] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:22.572052 28851 leader_election.cc:304] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:22.572626 28777 leader_election.cc:304] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:22.573024 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.574731 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.575237 28731 raft_consensus.cc:2468] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 1.
I20260203 09:17:22.576316 30020 raft_consensus.cc:2804] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:22.576777 30020 raft_consensus.cc:493] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:22.577139 30020 raft_consensus.cc:3060] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:22.577548 28777 leader_election.cc:304] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:22.560906 30133 raft_consensus.cc:2804] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:22.580624 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.571807 30077 raft_consensus.cc:2804] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:22.581475 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.581907 30121 raft_consensus.cc:2804] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:22.542276 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:22.584321 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:17:22.585069 28759 debug-util.cc:398] Leaking SignalData structure 0x7b0800042fe0 after lost signal to thread 30110
I20260203 09:17:22.576876 28700 leader_election.cc:304] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:22.560873 30134 raft_consensus.cc:2804] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:22.589823 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.595289 30020 raft_consensus.cc:515] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:22.598452 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b6f1d6e275f4a8ba99a70dbb3ea3235" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.600806 28700 leader_election.cc:304] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:22.597889 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.603195 30020 leader_election.cc:290] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:22.603361 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.589022 30122 raft_consensus.cc:2804] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:22.611032 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:22.611143 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.605123 28700 leader_election.cc:304] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:22.596900 30121 raft_consensus.cc:493] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:22.613202 30121 raft_consensus.cc:3060] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:22.614184 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.589843 30133 raft_consensus.cc:493] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:22.576330 30155 consensus_queue.cc:1048] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260203 09:17:22.621392 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.615733 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.596530 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.597393 30077 raft_consensus.cc:493] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:22.605631 29456 raft_consensus.cc:2468] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:22.601660 30134 raft_consensus.cc:493] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:22.624284 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.625445 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b2c469d7255413d9f61a7cbaa4481a7" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.605990 30135 raft_consensus.cc:2804] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:22.606102 30154 raft_consensus.cc:2804] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:22.606091 30132 leader_election.cc:290] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:22.634421 28851 leader_election.cc:304] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:22.611639 30122 raft_consensus.cc:493] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:22.622488 30125 raft_consensus.cc:2749] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:22.634622 30077 raft_consensus.cc:3060] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:22.640465 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.649065 28700 leader_election.cc:304] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:22.643565 30163 ts_tablet_manager.cc:933] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967)
I20260203 09:17:22.640218 30154 raft_consensus.cc:493] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:22.622012 30133 raft_consensus.cc:3060] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:22.630321 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:22.648038 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 69855.2us
I20260203 09:17:22.603899 30136 raft_consensus.cc:515] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:22.648586 30122 raft_consensus.cc:3060] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:22.657258 28884 raft_consensus.cc:2393] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 2: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:22.646453 30159 consensus_queue.cc:1059] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260203 09:17:22.651392 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.651692 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.639293 30134 raft_consensus.cc:3060] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:22.652382 30118 raft_consensus.cc:2804] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:22.674656 30118 raft_consensus.cc:493] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:22.652321 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.654197 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b2c469d7255413d9f61a7cbaa4481a7" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.639369 30135 raft_consensus.cc:493] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:22.661727 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.670717 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.672719 28883 raft_consensus.cc:1240] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:22.653294 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.659421 30154 raft_consensus.cc:3060] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:22.654213 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.669154 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:22.659829 30128 raft_consensus.cc:2804] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:22.680675 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.674904 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.695495 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.681428 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.682816 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.687474 28734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.687824 30161 tablet_copy_client.cc:323] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.65:37967
I20260203 09:17:22.690191 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.690824 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.691445 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.687312 30158 tablet_copy_client.cc:323] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.65:37967
I20260203 09:17:22.694128 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:22.675099 30152 raft_consensus.cc:2804] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:22.711019 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.699489 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.679734 30118 raft_consensus.cc:3060] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:22.700191 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:22.685297 30128 raft_consensus.cc:493] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:22.717124 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.678299 30144 raft_consensus.cc:2804] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:22.705519 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fabfb779b8894cf0b22204fe12768dc3" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.680688 30135 raft_consensus.cc:3060] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:22.703316 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.696286 30117 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:22.716849 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.732504 28886 raft_consensus.cc:1240] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:22.733273 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.719970 30128 raft_consensus.cc:3060] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:22.715584 30136 leader_election.cc:290] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.717198 30152 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
W20260203 09:17:22.736557 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 67055.6us
I20260203 09:17:22.727599 30144 raft_consensus.cc:493] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:22.741111 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.742065 28730 raft_consensus.cc:2468] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
I20260203 09:17:22.762072 30077 raft_consensus.cc:515] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:22.764238 30077 leader_election.cc:290] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.739466 30152 raft_consensus.cc:3060] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:22.768132 29426 leader_election.cc:304] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:17:22.769469 28776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 111587us
W20260203 09:17:22.771631 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 92191.9us
I20260203 09:17:22.745076 30144 raft_consensus.cc:3060] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:22.778545 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.778918 30125 raft_consensus.cc:3055] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:22.779273 30125 raft_consensus.cc:740] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:22.780100 30125 consensus_queue.cc:260] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:22.781309 30125 raft_consensus.cc:3060] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:22.775218 29426 leader_election.cc:304] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:22.785140 29426 leader_election.cc:304] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:22.756237 30121 raft_consensus.cc:515] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:22.786650 29426 leader_election.cc:304] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:22.789582 28776 leader_election.cc:304] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:22.792145 29426 leader_election.cc:304] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:22.788940 30142 raft_consensus.cc:2804] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:22.789043 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.793299 30142 raft_consensus.cc:493] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:22.793407 30171 raft_consensus.cc:2749] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:22.774585 30139 raft_consensus.cc:2749] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:22.804957 28776 leader_election.cc:304] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:22.805855 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.756263 30122 raft_consensus.cc:515] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:22.807240 28776 leader_election.cc:304] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:22.795138 30167 raft_consensus.cc:2749] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 09:17:22.811260 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 68417.2us
I20260203 09:17:22.803622 30117 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:22.793962 30137 raft_consensus.cc:2749] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:22.816427 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.803037 30077 raft_consensus.cc:2749] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:22.819026 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.803807 30142 raft_consensus.cc:3060] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:22.816956 28776 leader_election.cc:304] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:22.810772 30136 raft_consensus.cc:2749] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:22.825912 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:22.813052 30168 raft_consensus.cc:2749] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:22.833387 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:22.842435 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.843875 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.846143 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:22.826543 28734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47301e2bbfc94767a9905b0e12141d6d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.853564 30118 raft_consensus.cc:515] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:22.865351 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.840871 30173 raft_consensus.cc:2804] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260203 09:17:22.869704 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 65518.7us
W20260203 09:17:22.840379 30164 log.cc:927] Time spent T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.159s user 0.001s sys 0.000s
I20260203 09:17:22.870810 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.848469 30163 tablet_copy_client.cc:323] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.65:37967
I20260203 09:17:22.876719 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.881644 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.882819 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.883960 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:22.872331 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:22.869833 30173 raft_consensus.cc:493] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:22.889343 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.891558 30118 leader_election.cc:290] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:22.887709 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:22.892884 29426 leader_election.cc:304] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:22.893219 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:22.905243 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:22.909282 28852 leader_election.cc:304] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:22.910584 28852 leader_election.cc:304] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:22.918150 28852 leader_election.cc:304] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:22.922379 28730 raft_consensus.cc:2468] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:22.923906 30157 raft_consensus.cc:2749] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:22.924559 30120 raft_consensus.cc:2749] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:22.937103 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:22.937489 28852 leader_election.cc:304] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:22.941255 30157 raft_consensus.cc:2749] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:22.941596 30122 leader_election.cc:290] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.889967 30173 raft_consensus.cc:3060] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:22.944772 28852 leader_election.cc:304] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:22.939958 30135 raft_consensus.cc:515] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:22.956034 28808 raft_consensus.cc:1240] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:22.904376 30121 leader_election.cc:290] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.941964 30157 raft_consensus.cc:2749] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:22.960026 30134 raft_consensus.cc:515] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:22.978658 30135 leader_election.cc:290] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:22.979492 28806 raft_consensus.cc:1240] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Rejecting Update request from peer cf00f643e7da4a98a0a11ea92869c24a for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:22.979671 30134 leader_election.cc:290] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Requested vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:22.912484 30128 raft_consensus.cc:515] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:22.981078 28736 raft_consensus.cc:1240] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Rejecting Update request from peer 77541303e1934638ba82f0f43f707adc for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:22.982040 30128 leader_election.cc:290] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:22.982399 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:22.965955 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:22.952086 30177 raft_consensus.cc:2804] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:22.967108 28701 leader_election.cc:304] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:22.967420 28852 leader_election.cc:304] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:22.967938 30118 raft_consensus.cc:2749] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:22.973260 28811 raft_consensus.cc:1240] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:22.984853 28852 leader_election.cc:304] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:22.985152 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:22.988560 28852 leader_election.cc:304] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:22.989423 30157 raft_consensus.cc:2749] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:22.990237 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:22.990284 30146 raft_consensus.cc:2749] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:22.991262 30152 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:22.992832 28807 raft_consensus.cc:1240] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:22.987318 30177 raft_consensus.cc:493] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:22.996956 30177 raft_consensus.cc:3060] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:23.002269 28701 leader_election.cc:304] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:17:23.002683 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 109887us
I20260203 09:17:23.003676 28701 leader_election.cc:304] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.004626 29426 leader_election.cc:304] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.008262 29426 leader_election.cc:304] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:23.009543 29426 leader_election.cc:304] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.012140 29426 leader_election.cc:304] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.017711 28852 leader_election.cc:304] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.018927 28852 leader_election.cc:304] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.001971 30156 raft_consensus.cc:2749] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:23.001937 30118 raft_consensus.cc:2749] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.020233 30020 raft_consensus.cc:2749] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.007133 30130 raft_consensus.cc:2749] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.006486 30160 raft_consensus.cc:2749] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:22.997423 30153 consensus_queue.cc:1059] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260203 09:17:23.006965 30132 raft_consensus.cc:2749] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:23.026119 30019 raft_consensus.cc:2749] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.026883 28701 leader_election.cc:304] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.002097 30135 consensus_queue.cc:1059] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260203 09:17:23.012856 30137 raft_consensus.cc:2749] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:22.998448 30154 raft_consensus.cc:515] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:23.005570 30167 consensus_queue.cc:1059] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260203 09:17:23.006712 30133 raft_consensus.cc:515] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:23.020902 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:23.046042 30154 leader_election.cc:290] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:23.045900 30144 raft_consensus.cc:515] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:23.047909 30144 leader_election.cc:290] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:23.039213 30155 raft_consensus.cc:3055] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:23.038959 30166 raft_consensus.cc:2749] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.034335 30128 consensus_queue.cc:1059] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260203 09:17:23.051031 30133 leader_election.cc:290] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:23.048461 30155 raft_consensus.cc:740] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:23.052871 28810 raft_consensus.cc:1240] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:23.053357 30139 raft_consensus.cc:3055] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:23.053771 30139 raft_consensus.cc:740] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:23.054652 28804 raft_consensus.cc:1240] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:23.055202 30139 consensus_queue.cc:260] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:23.053728 30155 consensus_queue.cc:260] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:23.056718 30142 raft_consensus.cc:515] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:23.071806 30173 raft_consensus.cc:515] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:23.073441 30153 raft_consensus.cc:3055] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:23.073859 30153 raft_consensus.cc:740] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:23.076203 30154 raft_consensus.cc:3055] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:23.075922 30153 consensus_queue.cc:260] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:23.076592 30154 raft_consensus.cc:740] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:23.059891 30152 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:23.076783 30135 consensus_queue.cc:1059] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:23.040845 30132 raft_consensus.cc:2749] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:23.077958 30156 raft_consensus.cc:3055] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:23.080003 30156 raft_consensus.cc:740] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:23.043218 30145 raft_consensus.cc:2749] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.081221 30156 consensus_queue.cc:260] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:23.083174 30142 leader_election.cc:290] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:23.075048 30155 raft_consensus.cc:3060] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
W20260203 09:17:23.085117 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 73147.4us
I20260203 09:17:23.056679 30139 raft_consensus.cc:3060] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:23.068101 30177 raft_consensus.cc:515] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:23.089767 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 69867.6us
I20260203 09:17:23.077538 30154 consensus_queue.cc:260] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:23.090852 28813 raft_consensus.cc:1240] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:23.091120 28852 leader_election.cc:304] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.091509 30154 raft_consensus.cc:3060] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:23.091840 30146 raft_consensus.cc:2749] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:23.092995 28852 leader_election.cc:304] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.093679 30146 raft_consensus.cc:2749] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.094214 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:23.094830 28852 leader_election.cc:304] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.095554 30146 raft_consensus.cc:2749] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.086016 29426 leader_election.cc:304] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:23.093169 28700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:23.099211 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:23.099809 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:23.099895 30145 consensus_queue.cc:1059] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:23.100471 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:23.103358 28701 leader_election.cc:304] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.104506 28701 leader_election.cc:304] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.103149 30156 raft_consensus.cc:3060] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:23.106360 30160 raft_consensus.cc:2749] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:23.106812 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:23.106959 30160 raft_consensus.cc:3055] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:23.107335 30160 raft_consensus.cc:740] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:23.106627 30130 raft_consensus.cc:2749] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.108247 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:23.106727 30145 consensus_queue.cc:1059] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260203 09:17:23.110078 30145 consensus_queue.cc:1059] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:23.110898 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:23.098205 30142 raft_consensus.cc:2749] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.093902 30153 raft_consensus.cc:3060] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:23.107255 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:23.112555 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:23.118510 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "021e904a783c4cbc96e5aa625a34a2d8" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:23.122171 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:23.122663 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:23.123204 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:23.112751 30173 leader_election.cc:290] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:23.123857 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:23.124140 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:23.124866 29462 raft_consensus.cc:3060] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:23.121227 28851 leader_election.cc:304] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:23.122602 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:23.127218 28700 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:23.128353 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:23.128533 28777 leader_election.cc:304] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:17:23.110989 30145 raft_consensus.cc:3055] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:23.129593 30145 raft_consensus.cc:740] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:23.130273 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:23.133246 28700 leader_election.cc:304] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:23.134253 28700 leader_election.cc:304] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:23.135043 28700 leader_election.cc:304] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:23.135928 30179 raft_consensus.cc:2804] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:23.136149 30181 raft_consensus.cc:3055] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:23.138722 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:23.139446 30130 raft_consensus.cc:2749] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.137043 30125 raft_consensus.cc:2749] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:23.142242 28851 leader_election.cc:304] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:23.142894 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:23.142463 30182 raft_consensus.cc:2749] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.123737 28748 tablet_copy_service.cc:140] P 847a7af9f0e2497cbb9025cc2c62557e: Received BeginTabletCopySession request for tablet 7e1bac12c6ee43d6901400e02b35d82f from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:45044)
I20260203 09:17:23.143002 30020 raft_consensus.cc:2749] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:23.122265 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:23.146910 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:23.148248 28851 leader_election.cc:304] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:23.150316 28748 tablet_copy_service.cc:161] P 847a7af9f0e2497cbb9025cc2c62557e: Beginning new tablet copy session on tablet 7e1bac12c6ee43d6901400e02b35d82f from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:45044: session id = cf00f643e7da4a98a0a11ea92869c24a-7e1bac12c6ee43d6901400e02b35d82f
I20260203 09:17:23.150367 30120 raft_consensus.cc:2749] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:23.140800 30128 raft_consensus.cc:2749] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.123828 28747 tablet_copy_service.cc:140] P 847a7af9f0e2497cbb9025cc2c62557e: Received BeginTabletCopySession request for tablet 1862780e910a42d5a3414a9329cd9259 from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:45044)
I20260203 09:17:23.152678 28746 tablet_copy_service.cc:140] P 847a7af9f0e2497cbb9025cc2c62557e: Received BeginTabletCopySession request for tablet 15917cb595b149fd847e4ab4424f8262 from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:45044)
I20260203 09:17:23.147971 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:23.154021 28746 tablet_copy_service.cc:161] P 847a7af9f0e2497cbb9025cc2c62557e: Beginning new tablet copy session on tablet 15917cb595b149fd847e4ab4424f8262 from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:45044: session id = cf00f643e7da4a98a0a11ea92869c24a-15917cb595b149fd847e4ab4424f8262
I20260203 09:17:23.143093 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:23.136405 30179 raft_consensus.cc:493] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:23.154691 28747 tablet_copy_service.cc:161] P 847a7af9f0e2497cbb9025cc2c62557e: Beginning new tablet copy session on tablet 1862780e910a42d5a3414a9329cd9259 from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:45044: session id = cf00f643e7da4a98a0a11ea92869c24a-1862780e910a42d5a3414a9329cd9259
I20260203 09:17:23.157487 30118 raft_consensus.cc:2749] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.157941 28851 leader_election.cc:304] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:23.159355 28851 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:23.160552 30117 raft_consensus.cc:2749] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:23.161543 28777 leader_election.cc:304] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:23.163071 28777 leader_election.cc:304] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:23.163993 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:23.164458 28777 leader_election.cc:304] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:23.108212 30160 consensus_queue.cc:260] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:23.146956 30181 raft_consensus.cc:740] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:23.165772 28777 leader_election.cc:304] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:17:23.167263 30160 raft_consensus.cc:3060] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:23.167800 30019 raft_consensus.cc:2749] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:23.170239 28777 leader_election.cc:304] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:23.171587 28777 leader_election.cc:304] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:23.174047 28777 leader_election.cc:304] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:23.176961 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:23.177237 28777 leader_election.cc:304] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:23.179013 29426 leader_election.cc:304] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:23.177398 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:23.176700 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:23.188308 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:23.158619 30179 raft_consensus.cc:3060] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:23.185168 30181 consensus_queue.cc:260] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:23.190623 28813 raft_consensus.cc:1240] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:23.165460 30144 raft_consensus.cc:2749] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.165318 30126 raft_consensus.cc:2749] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:23.172973 30134 raft_consensus.cc:2749] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:23.213954 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:23.214754 30154 raft_consensus.cc:493] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:23.196529 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:23.215270 30154 raft_consensus.cc:515] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:23.215710 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:23.191583 30121 raft_consensus.cc:3060] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:23.216415 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:23.217233 30154 leader_election.cc:290] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:23.219096 28729 raft_consensus.cc:2468] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:23.220122 29426 leader_election.cc:304] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.220149 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:23.220515 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:23.221056 30142 raft_consensus.cc:2804] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:23.221506 30142 raft_consensus.cc:697] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:23.186305 30145 consensus_queue.cc:260] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:23.222151 30121 raft_consensus.cc:2749] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.222762 30145 raft_consensus.cc:3060] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:23.222429 30142 consensus_queue.cc:237] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:23.197432 28748 tablet_copy_source_session.cc:215] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:23.222800 30184 consensus_queue.cc:1059] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260203 09:17:23.191388 28777 leader_election.cc:304] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:23.201186 30132 raft_consensus.cc:2749] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.226938 29458 raft_consensus.cc:1240] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Rejecting Update request from peer 77541303e1934638ba82f0f43f707adc for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:23.226975 30121 raft_consensus.cc:2749] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:23.227202 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:23.227716 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:23.172585 30152 raft_consensus.cc:2749] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.201714 29464 raft_consensus.cc:2468] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:23.204689 30177 leader_election.cc:290] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:23.226363 28777 leader_election.cc:304] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:23.191047 30181 raft_consensus.cc:3060] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:23.209715 29462 raft_consensus.cc:2468] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
I20260203 09:17:23.175933 30173 raft_consensus.cc:2804] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:23.189771 30136 raft_consensus.cc:2749] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.194510 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:23.172713 30133 raft_consensus.cc:2749] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 09:17:23.226333 28700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:23.175437 30146 raft_consensus.cc:1064] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:23.229166 30184 raft_consensus.cc:3055] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:23.230927 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:23.253332 28887 raft_consensus.cc:2393] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 2: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:23.231724 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:23.233302 30161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e1bac12c6ee43d6901400e02b35d82f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:23.252331 30184 raft_consensus.cc:740] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:23.235070 28777 leader_election.cc:304] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:23.237716 28776 leader_election.cc:304] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:23.257179 29426 leader_election.cc:304] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:23.258001 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:23.249205 28851 leader_election.cc:304] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.249899 29465 raft_consensus.cc:1240] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260203 09:17:23.260373 28777 leader_election.cc:304] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:23.261420 30019 raft_consensus.cc:2804] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:23.261826 30019 raft_consensus.cc:493] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:23.262197 30019 raft_consensus.cc:3060] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:23.251586 28852 leader_election.cc:304] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:23.229295 30154 consensus_queue.cc:1059] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260203 09:17:23.265707 30154 raft_consensus.cc:3055] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:23.266062 30154 raft_consensus.cc:740] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:23.266109 30136 raft_consensus.cc:2804] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:23.265926 30020 raft_consensus.cc:493] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:23.266961 30154 consensus_queue.cc:260] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:23.267554 30020 raft_consensus.cc:515] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:23.269186 30154 raft_consensus.cc:3060] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:23.248142 30152 raft_consensus.cc:2749] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.263581 30177 raft_consensus.cc:2749] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.249686 30173 raft_consensus.cc:493] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:23.270217 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:23.252244 30117 consensus_queue.cc:1059] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260203 09:17:23.271468 30117 raft_consensus.cc:3055] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:23.271836 30117 raft_consensus.cc:740] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:23.272699 30117 consensus_queue.cc:260] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:23.273896 30117 raft_consensus.cc:3060] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:23.266868 30133 raft_consensus.cc:2804] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:23.270644 30173 raft_consensus.cc:3060] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:23.255641 30184 consensus_queue.cc:260] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:23.271706 28700 leader_election.cc:304] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:23.269322 30020 leader_election.cc:290] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:23.277773 30147 raft_consensus.cc:493] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:23.286460 30159 raft_consensus.cc:2749] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:23.290377 30136 raft_consensus.cc:697] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:23.291139 30152 raft_consensus.cc:2749] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:23.297133 28777 leader_election.cc:304] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:23.297864 30136 consensus_queue.cc:237] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:23.290575 30147 raft_consensus.cc:515] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:23.298997 28777 leader_election.cc:304] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:23.299085 28631 catalog_manager.cc:5654] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 1 to 2, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68). New cstate: current_term: 2 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:23.300370 30134 raft_consensus.cc:2749] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.300949 30134 raft_consensus.cc:2749] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:23.296339 30019 raft_consensus.cc:515] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:23.277791 30133 raft_consensus.cc:493] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:23.301828 30133 raft_consensus.cc:3060] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:23.302731 30147 leader_election.cc:290] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:23.306519 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:23.307243 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:23.307853 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:23.308528 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:23.306521 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:23.308606 28804 raft_consensus.cc:2393] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:23.311394 28851 leader_election.cc:304] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:23.312099 30118 raft_consensus.cc:2749] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:23.312840 30146 consensus_queue.cc:237] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:23.313777 28851 leader_election.cc:304] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:23.277176 28747 tablet_copy_source_session.cc:215] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:23.317359 29464 raft_consensus.cc:2468] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:23.318065 30020 raft_consensus.cc:2749] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:23.319612 28851 leader_election.cc:304] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.320374 30020 raft_consensus.cc:2804] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election won for term 3
W20260203 09:17:23.320626 28701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:23.320935 30020 raft_consensus.cc:697] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 3 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:23.325657 28807 raft_consensus.cc:1240] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:23.329744 28734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:23.330826 30153 raft_consensus.cc:493] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:23.331389 30153 raft_consensus.cc:515] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:23.331806 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:23.329787 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:23.333418 30153 leader_election.cc:290] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:23.314226 30147 raft_consensus.cc:493] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:23.337328 30147 raft_consensus.cc:515] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:23.332708 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:23.334638 28701 leader_election.cc:304] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.334941 28732 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b"
dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
mode: GRACEFUL
new_leader_uuid: "77541303e1934638ba82f0f43f707adc"
from {username='slave'} at 127.0.0.1:33896
I20260203 09:17:23.302946 30019 leader_election.cc:290] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:23.339462 28701 leader_election.cc:304] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.338692 28732 raft_consensus.cc:606] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Received request to transfer leadership to TS 77541303e1934638ba82f0f43f707adc
I20260203 09:17:23.338374 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:23.339234 30153 raft_consensus.cc:2749] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:23.351253 30135 raft_consensus.cc:2749] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.351248 30020 consensus_queue.cc:237] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:23.353905 30179 raft_consensus.cc:515] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:23.338210 30159 consensus_queue.cc:1059] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260203 09:17:23.358115 30159 raft_consensus.cc:3055] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:23.358475 30159 raft_consensus.cc:740] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:23.359305 30159 consensus_queue.cc:260] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:23.359874 28635 catalog_manager.cc:5654] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 2 to 3, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 3 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:23.350061 28701 leader_election.cc:304] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.363642 28701 leader_election.cc:304] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.364193 28733 raft_consensus.cc:2468] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:23.365455 28701 leader_election.cc:304] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.368362 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:23.368801 28701 leader_election.cc:304] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.366642 30187 raft_consensus.cc:2749] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:23.369740 30182 raft_consensus.cc:2749] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.369855 30187 raft_consensus.cc:2749] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.370139 28701 leader_election.cc:304] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.370499 30183 raft_consensus.cc:2749] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260203 09:17:23.367904 28703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:23.365083 30135 raft_consensus.cc:2749] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.371519 28701 leader_election.cc:304] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.371660 30187 raft_consensus.cc:2749] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.372352 30135 raft_consensus.cc:2749] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.373904 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:23.377441 30173 raft_consensus.cc:515] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:23.380029 30159 raft_consensus.cc:3060] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:23.383322 29464 raft_consensus.cc:1240] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:23.350524 30184 raft_consensus.cc:3060] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:23.375484 28701 leader_election.cc:304] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:23.387221 28701 leader_election.cc:304] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.371122 30179 leader_election.cc:290] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:23.390904 30173 leader_election.cc:290] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:23.393198 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:23.402515 30187 raft_consensus.cc:2749] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:23.403507 30187 consensus_queue.cc:1059] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260203 09:17:23.404858 30187 raft_consensus.cc:3055] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:23.405200 30187 raft_consensus.cc:740] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:23.406121 30187 consensus_queue.cc:260] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:23.407445 30187 raft_consensus.cc:3060] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:23.408059 28883 raft_consensus.cc:1240] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:23.408538 28701 leader_election.cc:304] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:23.412402 28701 leader_election.cc:304] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.416728 30158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1862780e910a42d5a3414a9329cd9259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:23.422606 28701 leader_election.cc:304] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.424515 30147 leader_election.cc:290] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:23.415846 30135 raft_consensus.cc:2749] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.428835 28701 leader_election.cc:304] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.428002 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:23.408162 30156 raft_consensus.cc:2749] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.430994 28851 leader_election.cc:304] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:23.430644 28701 leader_election.cc:304] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.430920 30182 raft_consensus.cc:2749] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.431165 30155 raft_consensus.cc:2749] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.434911 28701 leader_election.cc:304] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.435745 30155 raft_consensus.cc:2749] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.417722 30181 raft_consensus.cc:2749] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.433717 30153 raft_consensus.cc:2749] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.422305 28729 raft_consensus.cc:2468] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
W20260203 09:17:23.446615 30188 log.cc:927] Time spent T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a: Append to log took a long time: real 0.088s user 0.000s sys 0.001s
I20260203 09:17:23.449450 30155 consensus_queue.cc:1059] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260203 09:17:23.425215 30133 raft_consensus.cc:515] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:23.455664 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:23.459945 28883 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98"
dest_uuid: "77541303e1934638ba82f0f43f707adc"
mode: GRACEFUL
new_leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
from {username='slave'} at 127.0.0.1:57870
I20260203 09:17:23.466619 30133 leader_election.cc:290] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:23.466841 28777 leader_election.cc:304] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:17:23.451931 30155 raft_consensus.cc:3055] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:23.467792 30155 raft_consensus.cc:740] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:23.467911 28746 tablet_copy_source_session.cc:215] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:23.468806 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:23.468704 30155 consensus_queue.cc:260] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:23.470131 30155 raft_consensus.cc:3060] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:23.471911 28883 raft_consensus.cc:606] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Received request to transfer leadership to TS be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.442144 30147 raft_consensus.cc:2749] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:23.461510 30161 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:53340 (request call id 180) took 1323 ms. Trace:
I20260203 09:17:23.479861 28701 leader_election.cc:304] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:23.481961 28777 leader_election.cc:304] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:17:23.485137 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:23.486853 28738 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f"
dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
mode: GRACEFUL
new_leader_uuid: "77541303e1934638ba82f0f43f707adc"
from {username='slave'} at 127.0.0.1:33896
I20260203 09:17:23.486279 30133 raft_consensus.cc:2804] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:23.488603 28736 raft_consensus.cc:2468] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
I20260203 09:17:23.489723 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:23.496573 28735 raft_consensus.cc:2393] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 2: Already voted for candidate cf00f643e7da4a98a0a11ea92869c24a in this term.
I20260203 09:17:23.486841 30156 raft_consensus.cc:2749] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:23.508993 28777 leader_election.cc:304] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:23.522315 28777 leader_election.cc:304] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:23.495272 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:23.527673 30126 raft_consensus.cc:2749] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.526115 30179 raft_consensus.cc:2749] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260203 09:17:23.521381 30133 raft_consensus.cc:697] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:23.541460 28733 raft_consensus.cc:1240] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:23.549911 30175 raft_consensus.cc:2804] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:23.550282 28807 raft_consensus.cc:1240] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Rejecting Update request from peer 77541303e1934638ba82f0f43f707adc for earlier term 3. Current term is 4. Ops: []
I20260203 09:17:23.550494 30175 raft_consensus.cc:697] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:23.551491 30175 consensus_queue.cc:237] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:23.552320 30133 consensus_queue.cc:237] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:23.562619 30020 consensus_queue.cc:1059] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:17:23.566426 28777 leader_election.cc:304] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:23.568709 30172 raft_consensus.cc:2749] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:23.591087 30163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15917cb595b149fd847e4ab4424f8262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:23.581336 30120 raft_consensus.cc:3055] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:17:23.597671 30120 raft_consensus.cc:740] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:23.598531 30120 consensus_queue.cc:260] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:23.606122 30144 consensus_queue.cc:1059] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260203 09:17:23.616173 30144 raft_consensus.cc:3055] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:23.616572 30144 raft_consensus.cc:740] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:23.617409 28738 raft_consensus.cc:606] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Received request to transfer leadership to TS 77541303e1934638ba82f0f43f707adc
I20260203 09:17:23.617455 30144 consensus_queue.cc:260] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:23.619649 30144 raft_consensus.cc:3060] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:23.617885 28738 raft_consensus.cc:614] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260203 09:17:23.637050 28736 raft_consensus.cc:1275] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:23.639225 30120 raft_consensus.cc:3060] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:23.641175 30162 consensus_queue.cc:1048] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:23.645126 29464 raft_consensus.cc:1275] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:23.617923 28729 raft_consensus.cc:1240] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:23.592386 28734 raft_consensus.cc:2468] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:23.654389 28880 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6"
dest_uuid: "77541303e1934638ba82f0f43f707adc"
mode: GRACEFUL
new_leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
from {username='slave'} at 127.0.0.1:57870
I20260203 09:17:23.654618 30158 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:53340 (request call id 181) took 1488 ms. Trace:
I20260203 09:17:23.677829 28807 raft_consensus.cc:1275] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260203 09:17:23.682227 28813 raft_consensus.cc:1240] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Rejecting Update request from peer 77541303e1934638ba82f0f43f707adc for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:23.679553 28880 raft_consensus.cc:606] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Received request to transfer leadership to TS be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:23.689631 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260203 09:17:23.691457 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:17:23.696043 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:17:23.677351 30019 consensus_queue.cc:1048] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260203 09:17:23.669447 30158 rpcz_store.cc:276] 0203 09:17:22.166032 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:22.166197 (+ 165us) service_pool.cc:225] Handling call
0203 09:17:22.498111 (+331914us) ts_tablet_manager.cc:934] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967)
0203 09:17:23.411135 (+913024us) tablet_copy_client.cc:368] Tablet copy session begun
0203 09:17:23.463720 (+ 52585us) tablet_metadata.cc:641] Metadata flushed
0203 09:17:23.487616 (+ 23896us) tablet_copy_client.cc:497] Wrote new tablet metadata
0203 09:17:23.653764 (+166148us) tablet_copy_client.cc:418] Wrote new consensus metadata
0203 09:17:23.654117 (+ 353us) tablet_replica.cc:206] Creating consensus instance
0203 09:17:23.654480 (+ 363us) ts_tablet_manager.cc:989] Replica registered.
0203 09:17:23.654546 (+ 66us) inbound_call.cc:173] Queueing success response
Metrics: {"dns_us":123164,"tablet-copy.queue_time_us":71622,"thread_start_us":50578,"threads_started":2}
I20260203 09:17:23.703313 30158 tablet_copy_client.cc:806] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:23.703941 30158 tablet_copy_client.cc:670] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:23.481192 30161 rpcz_store.cc:276] 0203 09:17:22.149540 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:22.153139 (+ 3599us) service_pool.cc:225] Handling call
0203 09:17:22.519550 (+366411us) ts_tablet_manager.cc:934] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967)
0203 09:17:23.231836 (+712286us) tablet_copy_client.cc:368] Tablet copy session begun
0203 09:17:23.392763 (+160927us) tablet_metadata.cc:641] Metadata flushed
0203 09:17:23.393029 (+ 266us) tablet_copy_client.cc:497] Wrote new tablet metadata
0203 09:17:23.460564 (+ 67535us) tablet_copy_client.cc:418] Wrote new consensus metadata
0203 09:17:23.460981 (+ 417us) tablet_replica.cc:206] Creating consensus instance
0203 09:17:23.461353 (+ 372us) ts_tablet_manager.cc:989] Replica registered.
0203 09:17:23.461418 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"dns_us":44533,"tablet-copy.queue_time_us":105154,"thread_start_us":109206,"threads_started":2}
I20260203 09:17:23.717981 30158 tablet_copy_client.cc:538] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:23.718560 30157 consensus_queue.cc:1048] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:23.721525 30162 raft_consensus.cc:993] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc: : Instructing follower be3b58b70fd74625a8ae8dfd7db7f6ee to start an election
I20260203 09:17:23.723145 28777 leader_election.cc:304] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:17:23.724488 30117 raft_consensus.cc:1081] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Signalling peer be3b58b70fd74625a8ae8dfd7db7f6ee to start an election
I20260203 09:17:23.725524 30161 tablet_copy_client.cc:806] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:23.742532 30161 tablet_copy_client.cc:670] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:23.725483 30172 raft_consensus.cc:2804] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:23.744042 30172 raft_consensus.cc:697] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:23.722009 30162 raft_consensus.cc:993] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc: : Instructing follower be3b58b70fd74625a8ae8dfd7db7f6ee to start an election
I20260203 09:17:23.746328 30146 raft_consensus.cc:1081] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Signalling peer be3b58b70fd74625a8ae8dfd7db7f6ee to start an election
I20260203 09:17:23.722716 30175 consensus_queue.cc:1059] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260203 09:17:23.752611 30175 raft_consensus.cc:3055] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:23.753124 30175 raft_consensus.cc:740] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:23.752992 28813 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98"
dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
from {username='slave'} at 127.0.0.1:36388
I20260203 09:17:23.754139 30175 consensus_queue.cc:260] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:23.754068 28813 raft_consensus.cc:493] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:23.755570 28813 raft_consensus.cc:3060] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:23.757164 30161 tablet_copy_client.cc:538] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:23.747330 30172 consensus_queue.cc:237] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:23.763203 28810 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6"
dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
from {username='slave'} at 127.0.0.1:36388
I20260203 09:17:23.763758 28810 raft_consensus.cc:493] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:23.764092 28810 raft_consensus.cc:3060] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:23.725703 30184 consensus_queue.cc:1059] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260203 09:17:23.776116 28729 raft_consensus.cc:1275] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:23.777869 30178 consensus_queue.cc:1048] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:23.786779 28810 raft_consensus.cc:515] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:23.789898 28810 leader_election.cc:290] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Requested vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:23.790983 30146 raft_consensus.cc:3055] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:23.765204 30175 raft_consensus.cc:3060] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:23.795166 28734 raft_consensus.cc:1275] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260203 09:17:23.792544 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
W20260203 09:17:23.793853 28701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:23.796036 29464 raft_consensus.cc:3060] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:23.791406 30146 raft_consensus.cc:740] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:23.796955 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:23.797770 28887 raft_consensus.cc:3055] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:23.798029 28887 raft_consensus.cc:740] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:23.798699 28887 consensus_queue.cc:260] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:23.799980 28887 raft_consensus.cc:3060] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:23.799559 30146 consensus_queue.cc:260] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:23.801435 30146 raft_consensus.cc:3060] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:23.801275 28633 catalog_manager.cc:5654] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 2 to 3, leader changed from cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 3 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:23.805608 28813 raft_consensus.cc:515] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:23.806944 29464 raft_consensus.cc:2468] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:23.808432 28776 leader_election.cc:304] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:23.784539 30163 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:53340 (request call id 186) took 1320 ms. Trace:
I20260203 09:17:23.817611 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:23.818598 28732 raft_consensus.cc:3060] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:23.819974 28810 raft_consensus.cc:1275] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260203 09:17:23.816339 30144 raft_consensus.cc:2804] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:23.824175 30144 raft_consensus.cc:697] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:23.823978 30019 consensus_queue.cc:1048] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260203 09:17:23.825196 30144 consensus_queue.cc:237] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:23.827176 28813 leader_election.cc:290] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:23.816466 30133 consensus_queue.cc:1048] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260203 09:17:23.835052 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:23.835753 28880 raft_consensus.cc:3055] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:23.836074 28880 raft_consensus.cc:740] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:23.837183 28880 consensus_queue.cc:260] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:23.838335 28880 raft_consensus.cc:3060] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:23.838649 30161 tablet_bootstrap.cc:492] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:23.867599 28813 raft_consensus.cc:1275] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:23.872013 30178 consensus_queue.cc:1048] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260203 09:17:23.881529 29464 raft_consensus.cc:1275] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260203 09:17:23.884065 30122 consensus_queue.cc:1048] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:23.889333 28887 raft_consensus.cc:2468] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:23.818006 30163 rpcz_store.cc:276] 0203 09:17:22.464020 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:22.464150 (+ 130us) service_pool.cc:225] Handling call
0203 09:17:22.669127 (+204977us) ts_tablet_manager.cc:934] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967)
0203 09:17:23.534698 (+865571us) tablet_copy_client.cc:368] Tablet copy session begun
0203 09:17:23.696038 (+161340us) tablet_metadata.cc:641] Metadata flushed
0203 09:17:23.696275 (+ 237us) tablet_copy_client.cc:497] Wrote new tablet metadata
0203 09:17:23.783743 (+ 87468us) tablet_copy_client.cc:418] Wrote new consensus metadata
0203 09:17:23.784052 (+ 309us) tablet_replica.cc:206] Creating consensus instance
0203 09:17:23.784407 (+ 355us) ts_tablet_manager.cc:989] Replica registered.
0203 09:17:23.784472 (+ 65us) inbound_call.cc:173] Queueing success response
Metrics: {"dns_us":42155,"tablet-copy.queue_time_us":109258,"thread_start_us":178663,"threads_started":2}
I20260203 09:17:23.893617 30163 tablet_copy_client.cc:806] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:23.894191 30163 tablet_copy_client.cc:670] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:23.901497 28732 raft_consensus.cc:2468] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:23.895051 30192 raft_consensus.cc:2955] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:23.906742 28777 leader_election.cc:304] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:23.907930 30126 raft_consensus.cc:2804] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election won for term 2
W20260203 09:17:23.904683 30196 log.cc:927] Time spent T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.062s user 0.001s sys 0.000s
I20260203 09:17:23.914749 30126 raft_consensus.cc:697] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:23.930302 30126 consensus_queue.cc:237] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:23.937937 30163 tablet_copy_client.cc:538] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:23.945516 28804 raft_consensus.cc:2955] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:23.991732 30163 tablet_bootstrap.cc:492] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:24.021992 29465 raft_consensus.cc:1275] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260203 09:17:24.023804 29462 raft_consensus.cc:2955] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
W20260203 09:17:24.042160 30194 log.cc:927] Time spent T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.206s user 0.002s sys 0.000s
I20260203 09:17:24.040937 30117 consensus_queue.cc:1048] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260203 09:17:24.080663 28880 raft_consensus.cc:2468] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
W20260203 09:17:24.176297 28776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 60768.5us
W20260203 09:17:24.188349 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 84438.6us
W20260203 09:17:24.197861 30198 log.cc:927] Time spent T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.082s user 0.001s sys 0.000s
I20260203 09:17:24.191205 30019 raft_consensus.cc:493] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:24.234452 30147 raft_consensus.cc:493] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
W20260203 09:17:24.257941 30164 log.cc:927] Time spent T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.056s user 0.000s sys 0.000s
I20260203 09:17:24.260771 30019 raft_consensus.cc:515] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:24.321977 30158 tablet_bootstrap.cc:492] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:24.272742 30147 raft_consensus.cc:515] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:24.348424 28732 raft_consensus.cc:2955] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:24.352531 28889 raft_consensus.cc:3060] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
W20260203 09:17:24.351145 28776 consensus_peers.cc:597] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:24.346709 30195 log.cc:927] Time spent T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f: Append to log took a long time: real 0.060s user 0.001s sys 0.000s
I20260203 09:17:24.364061 29458 raft_consensus.cc:1275] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:24.365748 30136 consensus_queue.cc:1048] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:24.378376 28889 raft_consensus.cc:1275] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:24.358348 30155 raft_consensus.cc:493] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:24.392463 30210 log.cc:927] Time spent T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
W20260203 09:17:24.393407 30204 log.cc:927] Time spent T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.160s user 0.001s sys 0.000s
I20260203 09:17:24.393622 30155 raft_consensus.cc:515] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:24.372455 30019 leader_election.cc:290] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:24.406046 28880 raft_consensus.cc:1275] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260203 09:17:24.398852 30202 log.cc:927] Time spent T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.220s user 0.000s sys 0.001s
W20260203 09:17:24.412937 30206 log.cc:927] Time spent T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.176s user 0.000s sys 0.001s
I20260203 09:17:24.421298 28889 raft_consensus.cc:1275] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260203 09:17:24.427451 30155 leader_election.cc:290] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:24.436359 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 88047.1us
I20260203 09:17:24.437448 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:24.438268 28732 raft_consensus.cc:2393] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 2: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:24.440835 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:24.441612 28810 raft_consensus.cc:2468] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:24.424427 30147 leader_election.cc:290] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:24.439622 30133 consensus_queue.cc:1048] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260203 09:17:24.443087 30126 consensus_queue.cc:1048] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260203 09:17:24.443519 28700 leader_election.cc:304] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:24.439981 30217 consensus_queue.cc:1048] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260203 09:17:24.461267 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:24.462224 28808 raft_consensus.cc:2393] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:24.460166 28734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:24.468220 28734 raft_consensus.cc:2468] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:24.469373 28729 raft_consensus.cc:1275] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260203 09:17:24.469620 28852 leader_election.cc:304] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:24.472400 28736 raft_consensus.cc:1275] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:24.474581 28631 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57772 (request call id 170) took 1174 ms. Trace:
I20260203 09:17:24.479665 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:24.475040 28631 rpcz_store.cc:276] 0203 09:17:23.296440 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:23.296612 (+ 172us) service_pool.cc:225] Handling call
0203 09:17:24.470864 (+1174252us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0203 09:17:23.604503 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0203 09:17:23.697826 (+ 93323us) write_op.cc:432] Acquiring schema lock in shared mode
0203 09:17:23.697880 (+ 54us) write_op.cc:435] Acquired schema lock
0203 09:17:23.697913 (+ 33us) tablet.cc:660] Decoding operations
0203 09:17:23.698294 (+ 381us) write_op.cc:620] Acquiring the partition lock for write op
0203 09:17:23.698392 (+ 98us) write_op.cc:641] Partition lock acquired for write op
0203 09:17:23.698425 (+ 33us) tablet.cc:683] Acquiring locks for 1 operations
0203 09:17:23.698745 (+ 320us) tablet.cc:699] Row locks acquired
0203 09:17:23.698779 (+ 34us) write_op.cc:260] PREPARE: finished
0203 09:17:23.698942 (+ 163us) write_op.cc:270] Start()
0203 09:17:23.699099 (+ 157us) write_op.cc:276] Timestamp: P: 1770110243698878 usec, L: 0
0203 09:17:23.699138 (+ 39us) op_driver.cc:348] REPLICATION: starting
0203 09:17:23.699816 (+ 678us) log.cc:844] Serialized 536 byte log entry
0203 09:17:23.845290 (+145474us) op_driver.cc:464] REPLICATION: finished
0203 09:17:24.233842 (+388552us) write_op.cc:301] APPLY: starting
0203 09:17:24.233931 (+ 89us) tablet.cc:1365] starting BulkCheckPresence
0203 09:17:24.234041 (+ 110us) tablet.cc:1368] finished BulkCheckPresence
0203 09:17:24.235788 (+ 1747us) tablet.cc:1370] starting ApplyRowOperation cycle
0203 09:17:24.236095 (+ 307us) tablet.cc:1381] finished ApplyRowOperation cycle
0203 09:17:24.236319 (+ 224us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0203 09:17:24.236369 (+ 50us) write_op.cc:312] APPLY: finished
0203 09:17:24.288771 (+ 52402us) log.cc:844] Serialized 23 byte log entry
0203 09:17:24.336709 (+ 47938us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:17:24.344533 (+ 7824us) write_op.cc:454] Released schema lock
0203 09:17:24.350947 (+ 6414us) write_op.cc:341] FINISH: Updating metrics
0203 09:17:24.360975 (+ 10028us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:17:24.361012 (+ 37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4198,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":388282,"apply.run_cpu_time_us":3255,"apply.run_wall_time_us":127134,"num_ops":1,"prepare.queue_time_us":247735,"prepare.run_cpu_time_us":31630,"prepare.run_wall_time_us":197950,"raft.queue_time_us":301794,"raft.run_cpu_time_us":28020,"raft.run_wall_time_us":325660,"replication_time_us":146005,"spinlock_wait_cycles":209189760,"thread_start_us":555471,"threads_started":4,"wal-append.queue_time_us":119626}]]}
W20260203 09:17:24.502231 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 58850.5us
I20260203 09:17:24.507699 28889 raft_consensus.cc:1275] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:24.511044 28734 raft_consensus.cc:1275] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:24.508013 30219 raft_consensus.cc:2804] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:24.507870 30019 raft_consensus.cc:2804] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:24.525465 30121 consensus_queue.cc:1048] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:17:24.521732 30213 consensus_queue.cc:1048] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260203 09:17:24.533682 30019 raft_consensus.cc:493] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:24.545194 30019 raft_consensus.cc:3060] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:24.529386 30219 raft_consensus.cc:493] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:24.576917 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:24.562952 30219 raft_consensus.cc:3060] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:24.577644 28881 raft_consensus.cc:2468] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:17:24.605366 30019 raft_consensus.cc:515] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:24.607352 30019 leader_election.cc:290] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:24.633942 28635 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56858 (request call id 298) took 1282 ms. Trace:
I20260203 09:17:24.634399 28635 rpcz_store.cc:276] 0203 09:17:23.351899 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:23.352090 (+ 191us) service_pool.cc:225] Handling call
0203 09:17:24.633872 (+1281782us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0203 09:17:23.816482 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0203 09:17:23.833598 (+ 17116us) write_op.cc:432] Acquiring schema lock in shared mode
0203 09:17:23.833635 (+ 37us) write_op.cc:435] Acquired schema lock
0203 09:17:23.833653 (+ 18us) tablet.cc:660] Decoding operations
0203 09:17:23.833978 (+ 325us) write_op.cc:620] Acquiring the partition lock for write op
0203 09:17:23.834027 (+ 49us) write_op.cc:641] Partition lock acquired for write op
0203 09:17:23.834060 (+ 33us) tablet.cc:683] Acquiring locks for 1 operations
0203 09:17:23.834232 (+ 172us) tablet.cc:699] Row locks acquired
0203 09:17:23.834252 (+ 20us) write_op.cc:260] PREPARE: finished
0203 09:17:23.834414 (+ 162us) write_op.cc:270] Start()
0203 09:17:23.834525 (+ 111us) write_op.cc:276] Timestamp: P: 1770110243834366 usec, L: 0
0203 09:17:23.834547 (+ 22us) op_driver.cc:348] REPLICATION: starting
0203 09:17:23.835141 (+ 594us) log.cc:844] Serialized 536 byte log entry
0203 09:17:24.316478 (+481337us) op_driver.cc:464] REPLICATION: finished
0203 09:17:24.451238 (+134760us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b60000505c8. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd77216c1 00007f2cd788d85c 00007f2cd77eddb2 00007f2cd77ee3d9 00007f2cd77f066a 00007f2cd77f05f8 00007f2cd77f0578 00007f2cd77f0533 00007f2cd77ef74c 00007f2cd9beba36 00007f2cd9be61e8
0203 09:17:24.451944 (+ 706us) write_op.cc:301] APPLY: starting
0203 09:17:24.452027 (+ 83us) tablet.cc:1365] starting BulkCheckPresence
0203 09:17:24.452127 (+ 100us) tablet.cc:1368] finished BulkCheckPresence
0203 09:17:24.452143 (+ 16us) tablet.cc:1370] starting ApplyRowOperation cycle
0203 09:17:24.452410 (+ 267us) tablet.cc:1381] finished ApplyRowOperation cycle
0203 09:17:24.452553 (+ 143us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0203 09:17:24.452604 (+ 51us) write_op.cc:312] APPLY: finished
0203 09:17:24.452816 (+ 212us) log.cc:844] Serialized 23 byte log entry
0203 09:17:24.452986 (+ 170us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:17:24.453060 (+ 74us) write_op.cc:454] Released schema lock
0203 09:17:24.453099 (+ 39us) write_op.cc:341] FINISH: Updating metrics
0203 09:17:24.453415 (+ 316us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:17:24.453442 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10789,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":468,"apply.run_cpu_time_us":1431,"apply.run_wall_time_us":1431,"num_ops":1,"prepare.queue_time_us":427209,"prepare.run_cpu_time_us":2605,"prepare.run_wall_time_us":21116,"replication_time_us":449366,"spinlock_wait_cycles":6019328}]]}
I20260203 09:17:24.646870 30139 raft_consensus.cc:493] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:24.647526 30139 raft_consensus.cc:515] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:24.650628 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:24.651335 28729 raft_consensus.cc:2468] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:24.653214 29426 leader_election.cc:304] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:24.655089 30225 raft_consensus.cc:2804] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:24.655520 30225 raft_consensus.cc:493] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:24.655889 30225 raft_consensus.cc:3060] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:24.669008 30139 leader_election.cc:290] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:24.670748 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:24.671957 28884 raft_consensus.cc:2393] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a in current term 2: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
W20260203 09:17:24.720911 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 202580us
I20260203 09:17:24.688485 30225 raft_consensus.cc:515] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:24.727399 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
W20260203 09:17:24.728819 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 213851us
I20260203 09:17:24.744561 30225 leader_election.cc:290] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:24.746085 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:24.750789 28885 raft_consensus.cc:2393] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a in current term 2: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:24.754634 28851 leader_election.cc:304] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:24.747259 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:24.763553 28738 raft_consensus.cc:2468] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:24.771013 28633 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56866 (request call id 288) took 1033 ms. Trace:
I20260203 09:17:24.730872 30219 raft_consensus.cc:515] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:24.775975 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 252418us
I20260203 09:17:24.780143 30162 raft_consensus.cc:3060] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:24.782059 30219 leader_election.cc:290] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:24.783530 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:24.784200 28887 raft_consensus.cc:3060] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 3
I20260203 09:17:24.796974 30173 consensus_queue.cc:1048] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:17:24.786422 28635 catalog_manager.cc:5654] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: config changed from index 2 to 3, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:24.819492 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:17:24.816706 28635 catalog_manager.cc:5654] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 1 to 2, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 2 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:24.821341 28887 raft_consensus.cc:2468] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:24.822672 28701 leader_election.cc:304] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:24.831691 28731 raft_consensus.cc:1275] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:24.811120 30155 raft_consensus.cc:493] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:24.839768 30166 raft_consensus.cc:493] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:24.830181 30220 raft_consensus.cc:2804] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:24.842344 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:24.848399 30229 raft_consensus.cc:493] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:24.771457 28633 rpcz_store.cc:276] 0203 09:17:23.737483 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:23.737657 (+ 174us) service_pool.cc:225] Handling call
0203 09:17:23.780052 (+ 42395us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b540008d754. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1f0c0 00007f2cd3dbdbba 00007f2cd9b3eeac 00007f2cd9c3910e 00007f2cd81344a4 00007f2cd8134432 00007f2cd8134361 00007f2cd81342dc 00007f2cd8133592 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:24.770924 (+990872us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0203 09:17:23.835664 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0203 09:17:23.836167 (+ 503us) write_op.cc:432] Acquiring schema lock in shared mode
0203 09:17:23.836198 (+ 31us) write_op.cc:435] Acquired schema lock
0203 09:17:23.836212 (+ 14us) tablet.cc:660] Decoding operations
0203 09:17:23.836549 (+ 337us) write_op.cc:620] Acquiring the partition lock for write op
0203 09:17:23.836599 (+ 50us) write_op.cc:641] Partition lock acquired for write op
0203 09:17:23.836624 (+ 25us) tablet.cc:683] Acquiring locks for 1 operations
0203 09:17:23.842124 (+ 5500us) tablet.cc:699] Row locks acquired
0203 09:17:23.842158 (+ 34us) write_op.cc:260] PREPARE: finished
0203 09:17:23.848900 (+ 6742us) write_op.cc:270] Start()
0203 09:17:23.855810 (+ 6910us) write_op.cc:276] Timestamp: P: 1770110243848267 usec, L: 0
0203 09:17:23.860717 (+ 4907us) op_driver.cc:348] REPLICATION: starting
0203 09:17:24.271378 (+410661us) log.cc:844] Serialized 536 byte log entry
0203 09:17:24.384051 (+112673us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b540008d754. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db0aa8 00007f2cd77ed4d1 00007f2cd77ecca8 00007f2cd77f1941 00007f2cd77f18f9 00007f2cd77f1889 00007f2cd77f1851 00007f2cd77f0a7d 0000000000379254 0000000000379099
0203 09:17:24.480832 (+ 96781us) op_driver.cc:464] REPLICATION: finished
0203 09:17:24.481148 (+ 316us) write_op.cc:301] APPLY: starting
0203 09:17:24.481222 (+ 74us) tablet.cc:1365] starting BulkCheckPresence
0203 09:17:24.481324 (+ 102us) tablet.cc:1368] finished BulkCheckPresence
0203 09:17:24.481345 (+ 21us) tablet.cc:1370] starting ApplyRowOperation cycle
0203 09:17:24.481585 (+ 240us) tablet.cc:1381] finished ApplyRowOperation cycle
0203 09:17:24.481733 (+ 148us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0203 09:17:24.481777 (+ 44us) write_op.cc:312] APPLY: finished
0203 09:17:24.481959 (+ 182us) log.cc:844] Serialized 23 byte log entry
0203 09:17:24.482114 (+ 155us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:17:24.482197 (+ 83us) write_op.cc:454] Released schema lock
0203 09:17:24.482235 (+ 38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":157401,"reported_tablets":4,"spinlock_wait_cycles":57609600,"child_traces":[["op",{"apply.queue_time_us":99,"apply.run_cpu_time_us":1342,"apply.run_wall_time_us":1342,"num_ops":1,"prepare.queue_time_us":23487,"prepare.run_cpu_time_us":8920,"prepare.run_wall_time_us":548569,"replication_time_us":619966,"spinlock_wait_cycles":724964736}]]}
I20260203 09:17:24.855824 30219 raft_consensus.cc:493] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:24.855988 30220 raft_consensus.cc:697] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:24.859606 28736 raft_consensus.cc:2468] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:24.868285 28808 raft_consensus.cc:3060] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:24.844492 30155 raft_consensus.cc:515] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:24.868986 30183 raft_consensus.cc:493] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:24.861543 30019 raft_consensus.cc:493] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:24.854233 30233 raft_consensus.cc:493] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:24.904359 30163 tablet_bootstrap.cc:492] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:24.848080 30166 raft_consensus.cc:515] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:24.897167 30158 tablet_bootstrap.cc:492] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:24.877686 30217 consensus_queue.cc:1048] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260203 09:17:24.905716 29426 leader_election.cc:304] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:17:24.872982 30162 raft_consensus.cc:2749] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:24.912678 30215 raft_consensus.cc:493] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:24.929601 30215 raft_consensus.cc:515] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:24.931071 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:24.889585 30219 raft_consensus.cc:515] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:24.935415 30219 leader_election.cc:290] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:24.935945 30219 raft_consensus.cc:493] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:24.910908 30183 raft_consensus.cc:515] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:24.938521 30155 leader_election.cc:290] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:24.916110 30019 raft_consensus.cc:515] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:24.939818 30183 leader_election.cc:290] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:24.941772 30019 leader_election.cc:290] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:24.913069 30220 consensus_queue.cc:237] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:24.919277 30166 leader_election.cc:290] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:24.887494 30139 raft_consensus.cc:493] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:24.928103 30177 raft_consensus.cc:2804] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:24.924899 30233 raft_consensus.cc:515] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:24.951009 30233 leader_election.cc:290] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:24.947093 28736 raft_consensus.cc:2468] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:24.879854 30229 raft_consensus.cc:515] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:24.951931 30177 raft_consensus.cc:697] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:24.954172 30229 leader_election.cc:290] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:24.953954 30177 consensus_queue.cc:237] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:24.954830 30139 raft_consensus.cc:515] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:24.956845 30139 leader_election.cc:290] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:24.959933 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:24.936401 30219 raft_consensus.cc:515] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:24.960712 28813 raft_consensus.cc:2468] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:24.964447 30163 tablet_bootstrap.cc:492] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:24.964787 29425 leader_election.cc:304] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:24.966429 30142 raft_consensus.cc:2804] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:24.966832 30142 raft_consensus.cc:493] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:24.967171 30142 raft_consensus.cc:3060] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:24.968824 29426 leader_election.cc:304] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:24.971168 30167 raft_consensus.cc:2804] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:24.971582 30167 raft_consensus.cc:493] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:24.971887 30167 raft_consensus.cc:3060] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:24.978129 30212 raft_consensus.cc:493] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:24.979388 30212 raft_consensus.cc:515] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:24.979490 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:24.991272 30158 tablet_bootstrap.cc:492] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:24.991568 28736 raft_consensus.cc:2393] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a in current term 2: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:24.992163 30158 ts_tablet_manager.cc:1403] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.708s user 0.032s sys 0.029s
I20260203 09:17:24.993187 30163 ts_tablet_manager.cc:1403] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 1.002s user 0.030s sys 0.027s
I20260203 09:17:24.993539 30219 leader_election.cc:290] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:25.006469 30222 raft_consensus.cc:493] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:25.024968 30126 raft_consensus.cc:493] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:24.994483 30215 leader_election.cc:290] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:25.007176 30235 raft_consensus.cc:493] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:24.983399 30212 leader_election.cc:290] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:25.036789 28808 raft_consensus.cc:2468] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:25.063055 30166 raft_consensus.cc:493] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:25.063911 30166 raft_consensus.cc:515] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:25.025614 30126 raft_consensus.cc:515] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:25.090127 30206 log.cc:927] Time spent T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.059s user 0.000s sys 0.001s
I20260203 09:17:25.029574 30222 raft_consensus.cc:515] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:25.109916 28634 catalog_manager.cc:5654] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 1 to 2, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 2 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:25.136281 28634 catalog_manager.cc:5654] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 1 to 2, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 2 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:25.125296 28887 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2"
dest_uuid: "77541303e1934638ba82f0f43f707adc"
mode: GRACEFUL
new_leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
from {username='slave'} at 127.0.0.1:57870
I20260203 09:17:25.138628 28887 raft_consensus.cc:606] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Received request to transfer leadership to TS be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:25.138978 28887 raft_consensus.cc:614] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260203 09:17:25.138126 28634 catalog_manager.cc:5654] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 1 to 2, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 2 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:25.125972 30158 raft_consensus.cc:359] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:25.129000 30218 raft_consensus.cc:493] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:25.131822 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:25.158003 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 339520us
I20260203 09:17:25.159077 28634 catalog_manager.cc:5654] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 1 to 2, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 2 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
W20260203 09:17:25.148489 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 283443us
I20260203 09:17:25.172690 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:25.172973 28852 leader_election.cc:304] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:25.157469 30212 raft_consensus.cc:493] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:25.181051 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:25.183476 28737 raft_consensus.cc:2468] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:25.149879 30158 raft_consensus.cc:740] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:25.189565 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:25.190300 28889 raft_consensus.cc:2468] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:25.191250 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:25.192034 28806 raft_consensus.cc:2393] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:25.163528 30213 raft_consensus.cc:493] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:25.186544 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:25.187345 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:25.185151 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 274600us
I20260203 09:17:25.193768 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:25.167845 28880 raft_consensus.cc:2468] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 1.
I20260203 09:17:25.293252 28886 raft_consensus.cc:2468] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:25.305984 28807 raft_consensus.cc:2393] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 2: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:25.306077 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:25.306972 28701 leader_election.cc:304] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
W20260203 09:17:25.410346 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 104704us
I20260203 09:17:25.163684 30218 raft_consensus.cc:515] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:25.410234 28737 raft_consensus.cc:2468] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:25.292724 30161 tablet_bootstrap.cc:492] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:25.415462 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:25.415937 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:25.188242 30019 raft_consensus.cc:2804] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:25.415019 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:25.403892 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:25.426012 28806 raft_consensus.cc:2468] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:25.416071 28812 raft_consensus.cc:2468] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:25.117125 30235 raft_consensus.cc:515] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:25.431550 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 124678us
I20260203 09:17:25.414549 30217 raft_consensus.cc:493] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:25.293035 30166 leader_election.cc:290] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:25.446028 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:25.400260 30213 raft_consensus.cc:515] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:25.402472 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:25.421715 30236 raft_consensus.cc:493] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:25.451857 28889 raft_consensus.cc:1275] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:25.431836 28734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:17:25.502140 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 88632.8us
I20260203 09:17:25.189252 30212 raft_consensus.cc:515] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:25.573472 28700 leader_election.cc:304] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:25.401401 30155 raft_consensus.cc:493] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:25.414980 28881 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d"
dest_uuid: "77541303e1934638ba82f0f43f707adc"
mode: GRACEFUL
new_leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
from {username='slave'} at 127.0.0.1:57870
I20260203 09:17:25.446852 28731 raft_consensus.cc:2468] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:25.523774 28887 raft_consensus.cc:2468] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
W20260203 09:17:25.500979 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 47755.7us
I20260203 09:17:25.526906 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:25.461333 30192 raft_consensus.cc:493] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:25.532070 30126 leader_election.cc:290] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:25.534313 30236 raft_consensus.cc:515] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:25.447878 30121 raft_consensus.cc:493] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:25.584621 28732 raft_consensus.cc:2393] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a in current term 2: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:25.529856 30222 leader_election.cc:290] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:25.465507 30217 raft_consensus.cc:515] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:25.592375 30155 raft_consensus.cc:515] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:25.595507 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:25.598907 30248 log.cc:927] Time spent T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.164s user 0.003s sys 0.000s
I20260203 09:17:25.599208 30259 raft_consensus.cc:493] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:25.604656 30238 log.cc:927] Time spent T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.428s user 0.001s sys 0.000s
I20260203 09:17:25.589329 28734 raft_consensus.cc:2468] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:25.600986 30161 tablet_bootstrap.cc:492] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:25.575733 30019 raft_consensus.cc:697] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 3 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
W20260203 09:17:25.611743 30142 consensus_meta.cc:287] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a: Time spent flushing consensus metadata: real 0.644s user 0.009s sys 0.000s
I20260203 09:17:25.613180 28811 raft_consensus.cc:2468] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:17:25.615418 30243 raft_consensus.cc:493] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
W20260203 09:17:25.621883 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 183655us
I20260203 09:17:25.623503 30147 raft_consensus.cc:493] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:25.625785 30146 raft_consensus.cc:493] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:25.589681 30219 raft_consensus.cc:2804] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:25.571981 30235 leader_election.cc:290] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:25.646641 30250 raft_consensus.cc:493] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:25.621479 30144 consensus_queue.cc:1048] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260203 09:17:25.649555 30121 raft_consensus.cc:515] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:25.603667 28881 raft_consensus.cc:606] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 3 LEADER]: Received request to transfer leadership to TS 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:25.436513 30158 consensus_queue.cc:260] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:25.526804 30163 raft_consensus.cc:359] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:25.659657 30218 leader_election.cc:290] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:25.663316 28805 raft_consensus.cc:2468] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
W20260203 09:17:25.673528 30239 log.cc:927] Time spent T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.549s user 0.000s sys 0.001s
I20260203 09:17:25.696946 28807 raft_consensus.cc:2393] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 4: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:25.603101 30192 raft_consensus.cc:515] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:25.700973 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:25.701094 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:25.724691 30224 raft_consensus.cc:493] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:25.674033 28884 raft_consensus.cc:2468] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:17:25.677098 30222 raft_consensus.cc:493] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:25.686012 30220 raft_consensus.cc:2804] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:25.877024 30217 leader_election.cc:290] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:25.877817 30220 raft_consensus.cc:493] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:25.737864 30019 consensus_queue.cc:237] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:25.878363 30220 raft_consensus.cc:3060] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:25.755847 30146 raft_consensus.cc:515] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:25.758705 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 60636us
I20260203 09:17:25.851544 28738 raft_consensus.cc:2468] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:25.898245 28852 leader_election.cc:304] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:25.758111 28883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40958 (request call id 1190) took 1253 ms. Trace:
I20260203 09:17:25.679152 30259 raft_consensus.cc:515] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:25.850710 30163 raft_consensus.cc:740] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:25.904873 30183 raft_consensus.cc:2804] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:25.763598 30212 leader_election.cc:290] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:25.766295 30161 ts_tablet_manager.cc:1403] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 1.928s user 0.047s sys 0.048s
W20260203 09:17:25.760062 30167 consensus_meta.cc:287] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a: Time spent flushing consensus metadata: real 0.788s user 0.010s sys 0.004s
I20260203 09:17:25.862900 30192 leader_election.cc:290] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:25.731460 30147 raft_consensus.cc:515] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:25.864604 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:25.761835 30213 leader_election.cc:290] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:25.722589 30142 raft_consensus.cc:515] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:25.756577 30249 log.cc:927] Time spent T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.125s user 0.001s sys 0.000s
W20260203 09:17:25.719441 30177 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s user 0.038s sys 0.084s
I20260203 09:17:25.897099 30157 raft_consensus.cc:493] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:25.729545 30219 raft_consensus.cc:493] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:25.764405 30155 leader_election.cc:290] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:25.910040 30183 raft_consensus.cc:493] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:25.897025 28804 raft_consensus.cc:2393] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
W20260203 09:17:25.921182 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 464482us
I20260203 09:17:25.949680 30183 raft_consensus.cc:3060] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:25.949374 30219 raft_consensus.cc:3060] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:25.949348 30157 raft_consensus.cc:515] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:25.955075 30157 leader_election.cc:290] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:25.924533 28701 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s user 0.027s sys 0.069s
W20260203 09:17:25.956560 28701 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s user 0.027s sys 0.069s
W20260203 09:17:25.957892 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 546447us
I20260203 09:17:25.899360 28883 rpcz_store.cc:276] 0203 09:17:24.504281 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:24.505195 (+ 914us) service_pool.cc:225] Handling call
0203 09:17:24.505408 (+ 213us) raft_consensus.cc:1471] Updating replica for 1 ops
0203 09:17:24.641337 (+135929us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:24.641358 (+ 21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0203 09:17:24.645084 (+ 3726us) log.cc:844] Serialized 26 byte log entry
0203 09:17:24.862051 (+216967us) raft_consensus.cc:1645] Marking committed up to 2
0203 09:17:24.862084 (+ 33us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:24.862211 (+ 127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0203 09:17:25.757782 (+895571us) raft_consensus.cc:1685] finished
0203 09:17:25.757807 (+ 25us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:25.757976 (+ 169us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12057,"raft.queue_time_us":27356,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":10308,"thread_start_us":293624,"threads_started":2,"wal-append.queue_time_us":345568}
W20260203 09:17:25.965952 30177 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.003s user 0.038s sys 0.084s
I20260203 09:17:25.969308 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43626 (request call id 1275) took 1157 ms. Trace:
I20260203 09:17:25.969807 28730 rpcz_store.cc:276] 0203 09:17:24.812201 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:24.812314 (+ 113us) service_pool.cc:225] Handling call
0203 09:17:24.830484 (+ 18170us) raft_consensus.cc:1471] Updating replica for 1 ops
0203 09:17:24.830781 (+ 297us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:24.830809 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0203 09:17:24.839341 (+ 8532us) log.cc:844] Serialized 26 byte log entry
0203 09:17:25.171074 (+331733us) raft_consensus.cc:1645] Marking committed up to 2
0203 09:17:25.171122 (+ 48us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:25.171188 (+ 66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0203 09:17:25.969012 (+797824us) raft_consensus.cc:1685] finished
0203 09:17:25.969038 (+ 26us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:25.969200 (+ 162us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":4703,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":4649,"spinlock_wait_cycles":6016,"thread_start_us":319510,"threads_started":1,"wal-append.queue_time_us":464514}
I20260203 09:17:25.916810 30167 raft_consensus.cc:515] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:26.003803 29425 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.980s user 0.045s sys 0.131s
W20260203 09:17:26.004249 29425 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.981s user 0.045s sys 0.131s
W20260203 09:17:26.004506 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 981065us
I20260203 09:17:25.905143 30163 consensus_queue.cc:260] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
W20260203 09:17:26.058391 29427 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s user 0.029s sys 0.011s
W20260203 09:17:26.058938 29427 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s user 0.029s sys 0.011s
W20260203 09:17:26.049815 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 99644.9us
I20260203 09:17:25.754990 30250 raft_consensus.cc:515] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:25.896236 30222 raft_consensus.cc:515] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:25.926074 30224 raft_consensus.cc:515] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:26.063871 30255 raft_consensus.cc:493] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:26.102165 30255 raft_consensus.cc:515] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:25.745803 30243 raft_consensus.cc:515] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:26.081126 30250 leader_election.cc:290] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:26.114897 28733 raft_consensus.cc:2468] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:26.115375 30121 leader_election.cc:290] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:26.093640 30225 raft_consensus.cc:493] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:26.116988 30167 leader_election.cc:290] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:26.107667 30142 leader_election.cc:290] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:26.132908 30236 leader_election.cc:290] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:26.128158 30225 raft_consensus.cc:515] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:26.135655 30225 leader_election.cc:290] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:26.210372 29426 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s user 0.005s sys 0.012s
W20260203 09:17:26.305610 29426 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s user 0.005s sys 0.016s
I20260203 09:17:26.312541 30146 leader_election.cc:290] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:26.312865 30243 leader_election.cc:290] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:26.313198 30158 ts_tablet_manager.cc:1434] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 1.321s user 0.019s sys 0.012s
W20260203 09:17:26.313537 30158 ts_tablet_manager.cc:1467] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a: Tablet startup took 1321ms
W20260203 09:17:26.210570 28700 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s user 0.007s sys 0.011s
W20260203 09:17:26.315891 28700 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.741s user 0.007s sys 0.011s
W20260203 09:17:26.316238 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 742801us
W20260203 09:17:26.316522 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 420658us
W20260203 09:17:26.287034 28776 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.814s user 0.013s sys 0.010s
W20260203 09:17:26.317204 28776 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.844s user 0.014s sys 0.010s
W20260203 09:17:26.305979 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 720841us
I20260203 09:17:26.313772 30259 leader_election.cc:290] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:26.334326 28702 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.758s user 0.005s sys 0.018s
W20260203 09:17:26.334789 28702 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s user 0.005s sys 0.019s
I20260203 09:17:26.142098 30255 leader_election.cc:290] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:26.344317 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:26.317549 30155 raft_consensus.cc:493] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:26.317919 30224 leader_election.cc:290] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:26.318015 30147 leader_election.cc:290] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:26.348287 28852 leader_election.cc:304] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:26.325582 30250 raft_consensus.cc:493] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:26.354111 29462 raft_consensus.cc:2368] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 2. Current term is 3.
I20260203 09:17:26.362253 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:26.365911 30155 raft_consensus.cc:515] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:26.345520 30157 raft_consensus.cc:493] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:26.335716 30225 raft_consensus.cc:493] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:26.325212 30236 consensus_queue.cc:1048] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260203 09:17:26.337412 30219 raft_consensus.cc:515] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:26.354286 30235 raft_consensus.cc:493] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:26.304054 30183 raft_consensus.cc:515] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:26.339253 30258 raft_consensus.cc:493] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:26.727164 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:26.763099 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:26.562255 30265 raft_consensus.cc:493] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:26.766544 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:26.424901 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:26.717700 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
W20260203 09:17:26.428211 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 96525.7us
I20260203 09:17:26.797935 28810 raft_consensus.cc:2468] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:17:26.748993 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:26.347685 30146 raft_consensus.cc:493] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:26.798569 28729 raft_consensus.cc:3060] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:26.790503 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:26.807446 30157 raft_consensus.cc:515] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:26.839773 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:26.840409 30263 raft_consensus.cc:493] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:26.840595 28809 raft_consensus.cc:2393] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 2: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:26.840983 30263 raft_consensus.cc:515] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:26.841511 30157 leader_election.cc:290] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:26.841377 30175 raft_consensus.cc:493] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:26.424237 30264 raft_consensus.cc:493] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:26.842181 30175 raft_consensus.cc:515] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:26.842121 30142 raft_consensus.cc:493] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:26.842520 30262 raft_consensus.cc:493] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:26.843433 30262 raft_consensus.cc:515] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:26.844209 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:26.842588 30264 raft_consensus.cc:515] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:26.844518 30175 leader_election.cc:290] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:26.798660 30225 raft_consensus.cc:515] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:26.846130 30269 log.cc:927] Time spent T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.117s user 0.000s sys 0.000s
I20260203 09:17:26.417351 30222 leader_election.cc:290] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:26.847157 28882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40958 (request call id 1201) took 1219 ms. Trace:
I20260203 09:17:26.846918 30142 raft_consensus.cc:515] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:26.835695 30173 raft_consensus.cc:493] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:26.842962 30263 leader_election.cc:290] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:26.839427 28738 raft_consensus.cc:2393] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a in current term 2: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:26.849491 28701 leader_election.cc:304] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:26.807710 28885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40958 (request call id 1198) took 1267 ms. Trace:
I20260203 09:17:26.837801 28807 raft_consensus.cc:2468] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:26.850679 28885 rpcz_store.cc:276] 0203 09:17:25.590497 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:25.591210 (+ 713us) service_pool.cc:225] Handling call
0203 09:17:25.702018 (+110808us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b58002b8098. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd0b478b1 00007f2cd0cc9db1 00007f2cd0cc9c62 00007f2cd9b74dd9 00007f2cd8cf4260 00007f2cd8dbcdbb 00007f2cd8dbce41 00007f2cd8d7eaf0 00007f2cd8d69459 00007f2cd8d68f02 00007f2cd22f5d34
0203 09:17:25.702216 (+ 198us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:26.118360 (+416144us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:26.118390 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:26.118430 (+ 40us) raft_consensus.cc:1645] Marking committed up to 1
0203 09:17:26.118460 (+ 30us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:26.807401 (+688941us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b540022e2d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db5a81 00007f2cd3db44be 00007f2cd8d68f49 00007f2cd22f5d34 00007f2cd22f5cc2 00007f2cd22f5bf1 00007f2cd22f5b6c 00007f2cd22f4e22 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:26.807467 (+ 66us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:26.807640 (+ 173us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":962457344}
I20260203 09:17:26.398265 30259 raft_consensus.cc:493] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
W20260203 09:17:26.777004 30230 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.669s user 0.048s sys 0.089s
I20260203 09:17:26.847749 28882 rpcz_store.cc:276] 0203 09:17:25.628024 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:25.628402 (+ 378us) service_pool.cc:225] Handling call
0203 09:17:25.647687 (+ 19285us) raft_consensus.cc:1471] Updating replica for 1 ops
0203 09:17:25.703490 (+ 55803us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:25.703516 (+ 26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0203 09:17:25.716488 (+ 12972us) log.cc:844] Serialized 26 byte log entry
0203 09:17:26.248443 (+531955us) raft_consensus.cc:1645] Marking committed up to 1
0203 09:17:26.248492 (+ 49us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:26.248572 (+ 80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0203 09:17:26.846949 (+598377us) raft_consensus.cc:1685] finished
0203 09:17:26.846971 (+ 22us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:26.847103 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":124596,"raft.queue_time_us":59713,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":19471,"thread_start_us":465597,"threads_started":1,"wal-append.queue_time_us":729168}
I20260203 09:17:26.755730 30163 ts_tablet_manager.cc:1434] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 1.748s user 0.014s sys 0.035s
W20260203 09:17:26.800151 30220 consensus_meta.cc:287] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e: Time spent flushing consensus metadata: real 0.916s user 0.013s sys 0.000s
I20260203 09:17:26.428316 30224 raft_consensus.cc:2804] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:26.562026 30167 raft_consensus.cc:493] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:26.495785 30267 raft_consensus.cc:493] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:26.882469 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:26.868782 28732 raft_consensus.cc:2468] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 1.
I20260203 09:17:26.891754 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:26.914573 29465 raft_consensus.cc:2468] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:26.445623 30177 raft_consensus.cc:493] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:26.865433 28701 leader_election.cc:304] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:26.714143 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:26.428076 30166 raft_consensus.cc:493] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
W20260203 09:17:26.929503 28853 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s user 0.000s sys 0.030s
I20260203 09:17:26.771322 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:26.426118 30147 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:26.487641 28733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43612 (request call id 1635) took 1260 ms. Trace:
I20260203 09:17:26.867547 30222 raft_consensus.cc:493] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:26.570266 30223 raft_consensus.cc:493] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:26.847913 30173 raft_consensus.cc:515] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:26.892668 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
W20260203 09:17:26.916945 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 51625.9us
I20260203 09:17:26.908524 28729 raft_consensus.cc:2468] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 3.
W20260203 09:17:26.920583 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 53776.2us
I20260203 09:17:26.505102 30251 raft_consensus.cc:493] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
W20260203 09:17:26.889745 30163 ts_tablet_manager.cc:1467] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a: Tablet startup took 1886ms
I20260203 09:17:26.771754 28735 raft_consensus.cc:1275] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:26.418032 30250 raft_consensus.cc:515] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:26.903443 30230 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.782s user 0.053s sys 0.090s
W20260203 09:17:26.931720 28853 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s user 0.000s sys 0.030s
I20260203 09:17:26.605329 30257 raft_consensus.cc:493] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:26.487682 30218 raft_consensus.cc:493] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:26.505177 30268 raft_consensus.cc:493] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:26.881609 30266 raft_consensus.cc:2804] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:26.866938 30157 raft_consensus.cc:493] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:26.882381 30133 raft_consensus.cc:493] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:26.851692 30146 raft_consensus.cc:515] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:26.853022 30265 raft_consensus.cc:515] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:26.835824 30235 raft_consensus.cc:515] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:26.807535 30258 raft_consensus.cc:515] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:27.465893 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:27.295936 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 61567.5us
I20260203 09:17:27.442205 28811 raft_consensus.cc:1275] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260203 09:17:27.317809 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:26.907867 30263 raft_consensus.cc:493] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:26.906903 30224 raft_consensus.cc:493] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:27.418841 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:27.298377 28807 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e"
dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
mode: GRACEFUL
new_leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
from {username='slave'} at 127.0.0.1:60448
I20260203 09:17:27.419916 28777 leader_election.cc:304] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
W20260203 09:17:26.965265 28852 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s user 0.009s sys 0.017s
I20260203 09:17:27.391480 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:27.504065 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:27.504617 28732 raft_consensus.cc:2468] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:27.504878 28883 raft_consensus.cc:2468] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:27.479846 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:27.435279 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:27.505827 28852 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.104s user 0.009s sys 0.052s
W20260203 09:17:27.506153 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 1.1579e+06us
I20260203 09:17:27.506354 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:27.508054 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:27.508924 28883 raft_consensus.cc:2468] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:27.504101 28807 raft_consensus.cc:606] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Received request to transfer leadership to TS 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:27.513113 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:27.513826 28887 raft_consensus.cc:3060] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:27.519106 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:27.481315 28851 leader_election.cc:304] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:27.438812 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:27.455440 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 153269us
I20260203 09:17:27.503327 29464 raft_consensus.cc:2468] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:27.505527 28882 raft_consensus.cc:2468] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:27.552249 28887 raft_consensus.cc:2468] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:27.072903 29457 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
W20260203 09:17:27.480461 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 46105.7us
W20260203 09:17:27.557539 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 50796.7us
I20260203 09:17:27.562577 29425 leader_election.cc:304] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:26.909561 30243 raft_consensus.cc:493] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:27.061853 30225 leader_election.cc:290] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:27.255172 30254 raft_consensus.cc:493] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:27.578737 28852 leader_election.cc:304] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:27.050452 30236 raft_consensus.cc:493] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:26.909725 30244 raft_consensus.cc:493] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:27.316206 30283 raft_consensus.cc:493] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
W20260203 09:17:27.583971 28776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 105435us
W20260203 09:17:27.584961 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 110572us
I20260203 09:17:27.295027 30142 leader_election.cc:290] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:27.387485 30155 leader_election.cc:290] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:27.063840 30183 leader_election.cc:290] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:27.073062 30187 raft_consensus.cc:2804] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:27.390345 30122 raft_consensus.cc:493] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:27.390723 30279 raft_consensus.cc:493] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:27.530834 29464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53340 (request call id 208) took 1083 ms. Trace:
I20260203 09:17:27.421303 30284 raft_consensus.cc:493] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:27.285228 30219 leader_election.cc:290] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:27.442262 30175 raft_consensus.cc:493] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:27.471750 30266 raft_consensus.cc:493] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:27.387364 30256 raft_consensus.cc:493] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:27.233058 30121 raft_consensus.cc:493] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:27.442351 30217 raft_consensus.cc:493] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
W20260203 09:17:27.644629 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 163408us
I20260203 09:17:26.913026 30259 raft_consensus.cc:515] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:26.961421 28880 raft_consensus.cc:2468] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:27.060626 30264 leader_election.cc:290] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:26.938819 30262 leader_election.cc:290] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:27.066669 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:27.255661 30144 raft_consensus.cc:493] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:27.562093 30229 raft_consensus.cc:493] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:27.530880 30224 raft_consensus.cc:3060] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:27.660686 30183 raft_consensus.cc:2804] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:27.647435 30212 raft_consensus.cc:2804] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:27.473692 30251 raft_consensus.cc:515] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:27.603873 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45044 (request call id 110) took 1028 ms. Trace:
I20260203 09:17:27.556450 30282 raft_consensus.cc:493] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:27.631372 30187 raft_consensus.cc:493] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:27.641139 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260203 09:17:26.909451 30220 raft_consensus.cc:515] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:27.473104 30218 raft_consensus.cc:515] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:26.963253 30166 raft_consensus.cc:515] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:27.704294 30275 raft_consensus.cc:2804] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:26.931565 30267 raft_consensus.cc:515] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:27.556802 30277 raft_consensus.cc:493] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:27.502780 30223 raft_consensus.cc:515] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:26.990373 30147 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:27.473058 30222 raft_consensus.cc:515] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:27.698482 30175 raft_consensus.cc:515] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:27.500443 30157 raft_consensus.cc:515] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:27.641315 29464 rpcz_store.cc:276] 0203 09:17:26.447536 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:27.418461 (+970925us) service_pool.cc:225] Handling call
0203 09:17:27.530774 (+112313us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260203 09:17:27.668962 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 249157us
I20260203 09:17:27.730695 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:27.557793 30133 raft_consensus.cc:515] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:27.694922 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 100924us
I20260203 09:17:27.578063 29457 raft_consensus.cc:2468] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
W20260203 09:17:27.696508 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 117864us
I20260203 09:17:26.939651 30177 raft_consensus.cc:515] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:27.530709 30263 raft_consensus.cc:515] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:26.937520 28733 rpcz_store.cc:276] 0203 09:17:25.180051 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:25.182542 (+ 2491us) service_pool.cc:225] Handling call
0203 09:17:25.864288 (+681746us) spinlock_profiling.cc:243] Waited 97.8 ms on lock 0x7b5800261098. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd0b478b1 00007f2cd0cc9db1 00007f2cd0cc9c62 00007f2cd9b74dd9 00007f2cd8cf4260 00007f2cd8dbcdbb 00007f2cd8dbce41 00007f2cd8d6abd0 00007f2cd8d6a4b4 00007f2cd22fa834 00007f2cd22fa7c2
0203 09:17:26.418564 (+554276us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54001fca54. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:26.440279 (+ 21715us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":616013440}
I20260203 09:17:27.707233 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:27.739559 29462 raft_consensus.cc:2468] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:17:27.637323 30155 raft_consensus.cc:493] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
W20260203 09:17:27.708684 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 146215us
W20260203 09:17:26.313885 30158 ts_tablet_manager.cc:1469] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a: Trace:
0203 09:17:22.166032 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:22.166197 (+ 165us) service_pool.cc:225] Handling call
0203 09:17:22.498111 (+331914us) ts_tablet_manager.cc:934] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967)
0203 09:17:23.411135 (+913024us) tablet_copy_client.cc:368] Tablet copy session begun
0203 09:17:23.463720 (+ 52585us) tablet_metadata.cc:641] Metadata flushed
0203 09:17:23.487616 (+ 23896us) tablet_copy_client.cc:497] Wrote new tablet metadata
0203 09:17:23.653764 (+166148us) tablet_copy_client.cc:418] Wrote new consensus metadata
0203 09:17:23.654117 (+ 353us) tablet_replica.cc:206] Creating consensus instance
0203 09:17:23.654480 (+ 363us) ts_tablet_manager.cc:989] Replica registered.
0203 09:17:23.654546 (+ 66us) inbound_call.cc:173] Queueing success response
0203 09:17:24.274713 (+620167us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0203 09:17:24.992538 (+717825us) ts_tablet_manager.cc:1435] Starting tablet replica
0203 09:17:25.039269 (+ 46731us) tablet_replica.cc:261] Starting instrumentation
0203 09:17:25.122680 (+ 83411us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":123164,"raft.queue_time_us":2598,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":1680,"tablet-copy.queue_time_us":71622,"tablet-download-pool.queue_time_us":139,"tablet-download-pool.run_cpu_time_us":1086,"tablet-download-pool.run_wall_time_us":6689,"thread_start_us":50578,"threads_started":2}
I20260203 09:17:27.692312 30266 raft_consensus.cc:3060] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:26.928037 30167 raft_consensus.cc:515] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:27.744793 29457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53310 (request call id 381) took 1324 ms. Trace:
I20260203 09:17:27.735503 30133 leader_election.cc:290] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:27.701025 30256 raft_consensus.cc:515] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:27.751236 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:27.751874 28733 raft_consensus.cc:2468] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:17:27.741420 30139 raft_consensus.cc:3060] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:27.711366 28730 rpcz_store.cc:276] 0203 09:17:26.575680 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:26.585490 (+ 9810us) service_pool.cc:225] Handling call
0203 09:17:26.790850 (+205360us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:27.588754 (+797904us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:27.588786 (+ 32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:27.588837 (+ 51us) raft_consensus.cc:1645] Marking committed up to 5
0203 09:17:27.588866 (+ 29us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:27.603593 (+ 14727us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b540006c554. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db5a81 00007f2cd3db44be 00007f2cd8d68f49 00007f2cd22f5d34 00007f2cd22f5cc2 00007f2cd22f5bf1 00007f2cd22f5b6c 00007f2cd22f4e22 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:27.603648 (+ 55us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:27.603803 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1834525952}
I20260203 09:17:27.714170 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:17:27.714423 28805 raft_consensus.cc:2468] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 1.
I20260203 09:17:27.601305 30236 raft_consensus.cc:515] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:27.699843 28881 raft_consensus.cc:1275] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260203 09:17:27.531298 30268 raft_consensus.cc:515] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:27.729835 30275 raft_consensus.cc:493] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:27.530361 30257 raft_consensus.cc:515] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:27.704196 28880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59280 (request call id 174) took 1285 ms. Trace:
I20260203 09:17:27.704658 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:27.710071 30274 raft_consensus.cc:493] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:27.723681 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:27.724246 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:27.725534 28701 leader_election.cc:304] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:27.713326 30212 raft_consensus.cc:493] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:27.715445 30183 raft_consensus.cc:493] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:27.716545 30187 raft_consensus.cc:3060] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:27.693194 30122 raft_consensus.cc:515] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:27.713115 30219 raft_consensus.cc:493] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:27.604781 30243 raft_consensus.cc:515] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:27.502506 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:27.318099 30161 raft_consensus.cc:359] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:27.699703 30121 raft_consensus.cc:515] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:27.731302 28732 raft_consensus.cc:2468] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:27.732808 29456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53340 (request call id 206) took 1311 ms. Trace:
I20260203 09:17:27.734526 30245 raft_consensus.cc:493] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:27.735636 30157 leader_election.cc:290] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:27.736284 28700 leader_election.cc:304] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:27.628417 30254 raft_consensus.cc:515] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:27.702013 30217 raft_consensus.cc:515] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:27.716022 30144 raft_consensus.cc:515] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:27.738308 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
W20260203 09:17:27.750660 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 226612us
I20260203 09:17:27.756440 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:17:27.757360 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:27.737936 30147 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:27.733690 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:27.716315 30229 raft_consensus.cc:515] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:27.759198 29463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53310 (request call id 379) took 1334 ms. Trace:
W20260203 09:17:27.694731 28851 connection.cc:232] RPC call timeout handler was delayed by -1.1493834199995945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
I20260203 09:17:27.744722 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:27.746577 30146 leader_election.cc:290] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:27.610005 30244 raft_consensus.cc:515] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:27.704766 30284 raft_consensus.cc:515] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:27.642274 30283 raft_consensus.cc:515] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:27.749624 30250 leader_election.cc:290] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:27.725204 30282 raft_consensus.cc:515] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:27.752838 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:27.658052 30279 raft_consensus.cc:515] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:27.744990 30155 raft_consensus.cc:515] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:28.030845 28729 raft_consensus.cc:2393] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 2: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
W20260203 09:17:27.794685 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 60878.1us
I20260203 09:17:27.933688 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:27.914197 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:28.031492 29426 leader_election.cc:304] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:27.738665 30277 raft_consensus.cc:515] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:27.752542 30256 leader_election.cc:290] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:27.995530 28737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45044 (request call id 115) took 1146 ms. Trace:
W20260203 09:17:27.797386 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 48226.4us
I20260203 09:17:27.818670 29425 leader_election.cc:304] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:28.041121 29426 leader_election.cc:304] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:28.050166 28737 rpcz_store.cc:276] 0203 09:17:26.849088 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:26.849320 (+ 232us) service_pool.cc:225] Handling call
0203 09:17:26.907016 (+ 57696us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:27.741469 (+834453us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:27.741500 (+ 31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:27.741541 (+ 41us) raft_consensus.cc:1645] Marking committed up to 5
0203 09:17:27.741571 (+ 30us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:27.995221 (+253650us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b540028b254. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db5a81 00007f2cd3db44be 00007f2cd8d68f49 00007f2cd22f5d34 00007f2cd22f5cc2 00007f2cd22f5bf1 00007f2cd22f5b6c 00007f2cd22f4e22 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:27.995276 (+ 55us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:27.995457 (+ 181us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1918662016}
I20260203 09:17:27.755586 30173 leader_election.cc:290] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:28.051698 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 326234us
I20260203 09:17:28.053001 29426 leader_election.cc:304] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:27.767292 30286 raft_consensus.cc:493] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:28.032020 29463 rpcz_store.cc:276] 0203 09:17:26.419695 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:26.420822 (+ 1127us) service_pool.cc:225] Handling call
0203 09:17:26.853108 (+432286us) raft_consensus.cc:1471] Updating replica for 1 ops
0203 09:17:26.853465 (+ 357us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:26.853494 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0203 09:17:27.076479 (+222985us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b2c001458a8. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd26b39b1 00007f2cd26c2fe2 00007f2cd3df0851 00007f2cd3db50ba 00007f2cd3db44be 00007f2cd8d68f49 00007f2cd22f5d34 00007f2cd22f5cc2 00007f2cd22f5bf1 00007f2cd22f5b6c 00007f2cd22f4e22
0203 09:17:27.076936 (+ 457us) log.cc:844] Serialized 26 byte log entry
0203 09:17:27.502810 (+425874us) raft_consensus.cc:1645] Marking committed up to 2
0203 09:17:27.502848 (+ 38us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:27.502908 (+ 60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0203 09:17:27.748180 (+245272us) raft_consensus.cc:1685] finished
0203 09:17:27.748199 (+ 19us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:27.754342 (+ 6143us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":6177,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":36311,"spinlock_wait_cycles":12425472,"thread_start_us":204151,"threads_started":1,"wal-append.queue_time_us":522729}
I20260203 09:17:28.367403 28851 leader_election.cc:400] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Vote denied by peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627) with higher term. Message: Invalid argument: T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 2. Current term is 3.
W20260203 09:17:27.433816 30163 ts_tablet_manager.cc:1469] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a: Trace:
0203 09:17:22.464020 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:22.464150 (+ 130us) service_pool.cc:225] Handling call
0203 09:17:22.669127 (+204977us) ts_tablet_manager.cc:934] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967)
0203 09:17:23.534698 (+865571us) tablet_copy_client.cc:368] Tablet copy session begun
0203 09:17:23.696038 (+161340us) tablet_metadata.cc:641] Metadata flushed
0203 09:17:23.696275 (+ 237us) tablet_copy_client.cc:497] Wrote new tablet metadata
0203 09:17:23.783743 (+ 87468us) tablet_copy_client.cc:418] Wrote new consensus metadata
0203 09:17:23.784052 (+ 309us) tablet_replica.cc:206] Creating consensus instance
0203 09:17:23.784407 (+ 355us) ts_tablet_manager.cc:989] Replica registered.
0203 09:17:23.784472 (+ 65us) inbound_call.cc:173] Queueing success response
0203 09:17:23.991280 (+206808us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0203 09:17:25.013919 (+1022639us) ts_tablet_manager.cc:1435] Starting tablet replica
0203 09:17:25.084945 (+ 71026us) tablet_replica.cc:261] Starting instrumentation
0203 09:17:25.085866 (+ 921us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":42155,"mutex_wait_us":137071,"raft.queue_time_us":50166,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":11664,"tablet-copy.queue_time_us":109258,"tablet-download-pool.queue_time_us":1736,"tablet-download-pool.run_cpu_time_us":2065,"tablet-download-pool.run_wall_time_us":33691,"thread_start_us":178663,"threads_started":2}
W20260203 09:17:28.581502 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 271056us
I20260203 09:17:28.586722 28851 leader_election.cc:304] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
W20260203 09:17:27.893297 30296 log.cc:927] Time spent T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.115s user 0.001s sys 0.000s
I20260203 09:17:27.769833 30275 raft_consensus.cc:3060] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:27.758049 28813 raft_consensus.cc:2468] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
W20260203 09:17:28.125228 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 71885.1us
I20260203 09:17:28.589221 28701 leader_election.cc:304] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:28.590232 30146 raft_consensus.cc:2804] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:28.590698 30146 raft_consensus.cc:493] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:27.797262 30294 raft_consensus.cc:493] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:27.914393 30166 leader_election.cc:290] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:27.779422 30265 leader_election.cc:290] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:28.035255 30212 raft_consensus.cc:3060] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:27.748633 29457 rpcz_store.cc:276] 0203 09:17:26.420245 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:26.424075 (+ 3830us) service_pool.cc:225] Handling call
0203 09:17:27.072732 (+648657us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b580023f798. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd0b478b1 00007f2cd0cc9db1 00007f2cd0cc9c62 00007f2cd9b74dd9 00007f2cd8cf4260 00007f2cd8dbcdbb 00007f2cd8dbce41 00007f2cd8d6abd0 00007f2cd8d6a4b4 00007f2cd22fa834 00007f2cd22fa7c2
0203 09:17:27.741221 (+668489us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":11050240}
I20260203 09:17:28.530606 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:28.074427 28812 raft_consensus.cc:2468] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:28.610423 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:28.098716 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:28.066116 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 247522us
I20260203 09:17:27.860831 29461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53340 (request call id 207) took 1432 ms. Trace:
I20260203 09:17:28.033052 29456 rpcz_store.cc:276] 0203 09:17:26.416878 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:26.424254 (+ 7376us) service_pool.cc:225] Handling call
0203 09:17:27.066462 (+642208us) spinlock_profiling.cc:243] Waited 54.3 ms on lock 0x7b580023f798. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd0b478b1 00007f2cd0cc9db1 00007f2cd0cc9c62 00007f2cd9b74dd9 00007f2cd8cf4260 00007f2cd8dbcdbb 00007f2cd8dbce41 00007f2cd8d6abd0 00007f2cd8d6a4b4 00007f2cd22fa834 00007f2cd22fa7c2
0203 09:17:27.726679 (+660217us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":124917632}
W20260203 09:17:28.521375 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 313530us
I20260203 09:17:28.617774 28746 tablet_copy_service.cc:342] P 847a7af9f0e2497cbb9025cc2c62557e: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-1862780e910a42d5a3414a9329cd9259 received from {username='slave'} at 127.0.0.1:45044
W20260203 09:17:28.500180 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 467168us
I20260203 09:17:28.618242 28746 tablet_copy_service.cc:434] P 847a7af9f0e2497cbb9025cc2c62557e: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-1862780e910a42d5a3414a9329cd9259 on tablet 1862780e910a42d5a3414a9329cd9259 with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:28.618503 28852 leader_election.cc:304] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:28.618994 30147 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:28.619560 30147 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:28.620867 30302 raft_consensus.cc:2804] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:28.613443 29465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53326 (request call id 436) took 2137 ms. Trace:
I20260203 09:17:27.860914 30299 raft_consensus.cc:493] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:28.202111 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:28.580720 30283 leader_election.cc:290] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:28.172185 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:28.105347 30262 raft_consensus.cc:493] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:27.915097 30177 leader_election.cc:290] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:28.034487 30161 raft_consensus.cc:740] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:28.655309 30161 consensus_queue.cc:260] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:27.850672 30276 raft_consensus.cc:493] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:27.874068 30185 raft_consensus.cc:493] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:28.199659 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
W20260203 09:17:28.125721 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 389491us
I20260203 09:17:27.826894 30258 leader_election.cc:290] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:27.809777 30290 raft_consensus.cc:493] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:28.003247 30235 leader_election.cc:290] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:27.996140 30259 leader_election.cc:290] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:27.921144 30220 leader_election.cc:290] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:28.599130 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:27.921842 30218 leader_election.cc:290] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:27.933943 30288 raft_consensus.cc:493] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:28.032876 30183 raft_consensus.cc:3060] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:17:28.466059 30224 consensus_meta.cc:287] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc: Time spent flushing consensus metadata: real 0.694s user 0.003s sys 0.006s
I20260203 09:17:28.171794 28735 raft_consensus.cc:2393] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 4: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:28.616736 30304 raft_consensus.cc:493] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:28.611166 28737 raft_consensus.cc:2468] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 1.
I20260203 09:17:27.809775 30289 raft_consensus.cc:493] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:28.591064 30146 raft_consensus.cc:3060] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:27.768946 28880 rpcz_store.cc:276] 0203 09:17:26.419251 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:26.424129 (+ 4878us) service_pool.cc:225] Handling call
0203 09:17:27.704068 (+1279939us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 09:17:28.621673 29465 rpcz_store.cc:276] 0203 09:17:26.476273 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:27.472366 (+996093us) service_pool.cc:225] Handling call
0203 09:17:27.472711 (+ 345us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:27.732261 (+259550us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:27.732290 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:27.732333 (+ 43us) raft_consensus.cc:1645] Marking committed up to 4
0203 09:17:27.732361 (+ 28us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:28.613223 (+880862us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54003354d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db5a81 00007f2cd3db44be 00007f2cd8d68f49 00007f2cd22f5d34 00007f2cd22f5cc2 00007f2cd22f5bf1 00007f2cd22f5b6c 00007f2cd22f4e22 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:28.613270 (+ 47us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:28.613389 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":596475648}
I20260203 09:17:28.269984 30167 leader_election.cc:290] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:28.531719 30236 leader_election.cc:290] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:28.368336 30260 raft_consensus.cc:493] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:28.105576 30256 raft_consensus.cc:2804] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:28.627321 28882 raft_consensus.cc:2468] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:28.172498 30263 leader_election.cc:290] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:28.189332 30222 leader_election.cc:290] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:28.107200 30225 raft_consensus.cc:2804] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:28.641145 29425 leader_election.cc:304] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:28.155877 30254 leader_election.cc:290] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:28.233402 30175 leader_election.cc:290] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:28.475638 30268 leader_election.cc:290] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:28.157372 30244 leader_election.cc:290] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:28.385068 30251 leader_election.cc:290] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:27.861159 30295 raft_consensus.cc:493] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:28.321834 30217 leader_election.cc:290] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:28.388959 30278 raft_consensus.cc:2804] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:28.073437 30250 raft_consensus.cc:2804] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:28.506305 30157 raft_consensus.cc:493] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:28.658871 30262 raft_consensus.cc:515] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:28.647800 30299 raft_consensus.cc:515] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:28.649660 29426 leader_election.cc:304] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:27.932034 30298 raft_consensus.cc:493] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:28.207933 30266 raft_consensus.cc:515] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:28.617548 29461 rpcz_store.cc:276] 0203 09:17:26.428817 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:27.587444 (+1158627us) service_pool.cc:225] Handling call
0203 09:17:27.850496 (+263052us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b580023f798. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd0b478b1 00007f2cd0cc9db1 00007f2cd0cc9c62 00007f2cd9b74dd9 00007f2cd8cf4260 00007f2cd8dbcdbb 00007f2cd8dbce41 00007f2cd8d7eaf0 00007f2cd8d69459 00007f2cd8d68f02 00007f2cd22f5d34
0203 09:17:27.850778 (+ 282us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:27.851026 (+ 248us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:27.851053 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:27.851094 (+ 41us) raft_consensus.cc:1645] Marking committed up to 4
0203 09:17:27.851128 (+ 34us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:27.851186 (+ 58us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:27.860733 (+ 9547us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":79712128}
I20260203 09:17:28.171481 30267 leader_election.cc:290] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:28.620107 30243 leader_election.cc:290] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:28.519186 30293 raft_consensus.cc:2804] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:28.771260 30167 raft_consensus.cc:2804] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:28.771674 28884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59280 (request call id 170) took 2413 ms. Trace:
I20260203 09:17:28.045799 30219 raft_consensus.cc:515] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:28.772228 28884 rpcz_store.cc:276] 0203 09:17:26.358375 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:26.364389 (+ 6014us) service_pool.cc:225] Handling call
0203 09:17:26.475299 (+110910us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:27.609127 (+1133828us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:27.628184 (+ 19057us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:27.640751 (+ 12567us) raft_consensus.cc:1645] Marking committed up to 5
0203 09:17:27.640820 (+ 69us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:28.771363 (+1130543us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54000eb5d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db5a81 00007f2cd3db44be 00007f2cd8d68f49 00007f2cd22f5d34 00007f2cd22f5cc2 00007f2cd22f5bf1 00007f2cd22f5b6c 00007f2cd22f4e22 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:28.771448 (+ 85us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:28.771612 (+ 164us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2526069504}
I20260203 09:17:28.771275 30293 raft_consensus.cc:493] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:28.774060 30293 raft_consensus.cc:3060] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:28.660588 29462 raft_consensus.cc:2468] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:28.621320 30302 raft_consensus.cc:493] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:28.675244 28732 raft_consensus.cc:2468] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 1.
I20260203 09:17:28.675812 28888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59280 (request call id 167) took 2315 ms. Trace:
I20260203 09:17:28.659165 30223 leader_election.cc:290] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:28.658430 30121 leader_election.cc:290] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:28.672883 30229 leader_election.cc:290] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:28.692766 30307 raft_consensus.cc:493] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:28.674688 30258 consensus_queue.cc:1048] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260203 09:17:28.610536 30294 raft_consensus.cc:515] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:28.768844 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 119291us
I20260203 09:17:28.752923 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:28.676591 30185 raft_consensus.cc:515] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:28.770736 30278 raft_consensus.cc:493] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:28.800979 28737 raft_consensus.cc:2468] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 1.
I20260203 09:17:28.774117 30219 leader_election.cc:290] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:28.661629 28700 leader_election.cc:304] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:28.679965 30235 raft_consensus.cc:493] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:28.696779 30144 leader_election.cc:290] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:28.777418 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 136365us
I20260203 09:17:28.778738 28888 rpcz_store.cc:276] 0203 09:17:26.357037 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:26.357203 (+ 166us) service_pool.cc:225] Handling call
0203 09:17:26.800501 (+443298us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:27.738202 (+937701us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:27.738232 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:27.738272 (+ 40us) raft_consensus.cc:1645] Marking committed up to 5
0203 09:17:27.738296 (+ 24us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:28.672251 (+933955us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b54002e90d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db5a81 00007f2cd3db44be 00007f2cd8d68f49 00007f2cd22f5d34 00007f2cd22f5cc2 00007f2cd22f5bf1 00007f2cd22f5b6c 00007f2cd22f4e22 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:28.672302 (+ 51us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:28.672446 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2156124928}
I20260203 09:17:28.815470 28738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:43606 (request call id 704) took 1946 ms. Trace:
I20260203 09:17:28.816220 29426 leader_election.cc:304] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:28.776679 30250 raft_consensus.cc:493] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:28.706271 30305 raft_consensus.cc:2804] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:17:28.674768 30276 raft_consensus.cc:515] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:28.794370 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:17:28.795996 28812 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50256 (request call id 131) took 1370 ms (client timeout 1580 ms). Trace:
I20260203 09:17:28.796456 30266 leader_election.cc:290] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:28.797551 30307 raft_consensus.cc:515] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:28.811647 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 150080us
I20260203 09:17:28.839049 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:28.839612 28700 leader_election.cc:304] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
W20260203 09:17:28.833155 28812 rpcz_store.cc:269] 0203 09:17:27.425254 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:27.425376 (+ 122us) service_pool.cc:225] Handling call
0203 09:17:28.795767 (+1370391us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54003642d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:28.795903 (+ 136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1308082944}
I20260203 09:17:28.685444 30297 raft_consensus.cc:493] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:28.769217 30256 raft_consensus.cc:493] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:28.104856 30245 raft_consensus.cc:515] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:28.771711 30167 raft_consensus.cc:493] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:28.681823 30290 raft_consensus.cc:515] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:28.708105 30122 leader_election.cc:290] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:28.750510 30300 raft_consensus.cc:493] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:28.820552 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
W20260203 09:17:28.707671 30139 consensus_meta.cc:287] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a: Time spent flushing consensus metadata: real 0.947s user 0.009s sys 0.001s
I20260203 09:17:28.847591 30161 ts_tablet_manager.cc:1434] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 2.921s user 0.022s sys 0.097s
I20260203 09:17:28.823551 30308 raft_consensus.cc:2804] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260203 09:17:28.824074 30301 log.cc:927] Time spent T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f: Append to log took a long time: real 0.193s user 0.001s sys 0.000s
I20260203 09:17:28.103727 30274 raft_consensus.cc:515] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:28.815891 28738 rpcz_store.cc:276] 0203 09:17:26.855274 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:26.889334 (+ 34060us) service_pool.cc:225] Handling call
0203 09:17:28.801649 (+1912315us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b54001fc054. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1f0c0 00007f2cd3dbdbba 00007f2cd8d6e58e 00007f2cd230d437 00007f2cd230d3c2 00007f2cd230d2f1 00007f2cd230d26c 00007f2cd230c522 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:28.802031 (+ 382us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1925936000}
I20260203 09:17:28.793601 30225 raft_consensus.cc:697] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 3 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:28.829671 29426 leader_election.cc:304] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc
W20260203 09:17:28.893847 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 64257.6us
I20260203 09:17:28.781461 30302 raft_consensus.cc:3060] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:28.691509 30224 raft_consensus.cc:515] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:28.628284 30286 raft_consensus.cc:515] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:28.830950 29459 raft_consensus.cc:2468] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
I20260203 09:17:28.831535 30262 leader_election.cc:290] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:28.828071 30235 raft_consensus.cc:515] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:28.831755 29461 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:28.810804 30278 raft_consensus.cc:3060] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:28.781172 30254 raft_consensus.cc:2749] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:28.837329 30185 leader_election.cc:290] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:28.838090 30292 raft_consensus.cc:2804] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:28.779583 30157 raft_consensus.cc:515] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:28.847431 28700 leader_election.cc:304] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:28.899552 30308 raft_consensus.cc:493] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:28.848470 30222 consensus_queue.cc:1048] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:17:28.826586 30250 raft_consensus.cc:3060] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:28.817946 28733 raft_consensus.cc:2468] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
I20260203 09:17:28.822796 30294 leader_election.cc:290] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:28.872040 30299 leader_election.cc:290] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:28.848407 30219 raft_consensus.cc:2804] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:28.735651 30289 raft_consensus.cc:515] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:28.824958 30279 leader_election.cc:290] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:28.825508 30177 consensus_queue.cc:1048] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260203 09:17:28.852428 30256 raft_consensus.cc:3060] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:28.851743 28746 tablet_copy_service.cc:342] P 847a7af9f0e2497cbb9025cc2c62557e: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-15917cb595b149fd847e4ab4424f8262 received from {username='slave'} at 127.0.0.1:45044
I20260203 09:17:28.953303 30224 leader_election.cc:290] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:28.953576 28746 tablet_copy_service.cc:434] P 847a7af9f0e2497cbb9025cc2c62557e: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-15917cb595b149fd847e4ab4424f8262 on tablet 15917cb595b149fd847e4ab4424f8262 with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:28.897230 29464 raft_consensus.cc:1217] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20260203 09:17:28.955171 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:28.850067 30267 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:28.851822 29457 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:28.956296 30245 leader_election.cc:290] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:28.942029 30266 raft_consensus.cc:2804] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:28.849695 30251 raft_consensus.cc:493] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:28.957645 30266 raft_consensus.cc:493] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:28.958074 30266 raft_consensus.cc:3060] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:28.957906 30251 raft_consensus.cc:515] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:28.846426 28735 raft_consensus.cc:2468] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 1.
I20260203 09:17:28.802716 30295 raft_consensus.cc:515] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:28.959806 30299 raft_consensus.cc:493] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:28.856231 30167 raft_consensus.cc:3060] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:28.911204 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
W20260203 09:17:28.874181 30161 ts_tablet_manager.cc:1467] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a: Tablet startup took 2963ms
I20260203 09:17:28.913177 30307 leader_election.cc:290] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:28.855166 30305 raft_consensus.cc:697] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 4 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:28.876235 30139 raft_consensus.cc:2749] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:28.780076 30298 raft_consensus.cc:515] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:28.819878 30260 raft_consensus.cc:515] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:28.917001 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:28.920774 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:28.899205 30255 raft_consensus.cc:2804] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:28.924803 28886 raft_consensus.cc:3060] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:28.726091 30288 raft_consensus.cc:515] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:28.899401 30243 raft_consensus.cc:493] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:28.914391 30147 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
W20260203 09:17:28.929980 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 82649.2us
I20260203 09:17:28.853505 30297 raft_consensus.cc:515] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:28.932123 30292 raft_consensus.cc:493] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:28.935946 30213 raft_consensus.cc:993] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee: : Instructing follower 847a7af9f0e2497cbb9025cc2c62557e to start an election
I20260203 09:17:28.932210 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:28.929450 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:28.938860 30308 raft_consensus.cc:3060] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:28.919117 30300 raft_consensus.cc:515] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:28.750766 30304 raft_consensus.cc:515] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:28.924088 30257 leader_election.cc:290] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:28.956318 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:28.960326 30299 raft_consensus.cc:515] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:28.982580 29426 leader_election.cc:304] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:29.032927 30276 leader_election.cc:290] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:28.947978 30219 raft_consensus.cc:493] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:29.031658 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43626 (request call id 1296) took 1307 ms. Trace:
I20260203 09:17:28.977596 30225 consensus_queue.cc:237] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:29.040243 30286 leader_election.cc:290] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:29.390625 30255 raft_consensus.cc:493] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:29.364993 30289 leader_election.cc:290] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:29.381755 30275 consensus_meta.cc:287] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc: Time spent flushing consensus metadata: real 0.793s user 0.012s sys 0.000s
W20260203 09:17:29.392393 30187 consensus_meta.cc:287] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent flushing consensus metadata: real 1.338s user 0.007s sys 0.004s
I20260203 09:17:29.097540 28887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59280 (request call id 183) took 1039 ms. Trace:
I20260203 09:17:29.116772 28810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50256 (request call id 130) took 1692 ms. Trace:
I20260203 09:17:29.198854 28634 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56858 (request call id 299) took 4155 ms. Trace:
I20260203 09:17:29.392257 28730 rpcz_store.cc:276] 0203 09:17:27.724407 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:27.757383 (+ 32976us) service_pool.cc:225] Handling call
0203 09:17:27.757646 (+ 263us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:28.773156 (+1015510us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:28.773186 (+ 30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:28.773227 (+ 41us) raft_consensus.cc:1645] Marking committed up to 4
0203 09:17:28.773256 (+ 29us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:29.031393 (+258137us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54002797d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db5a81 00007f2cd3db44be 00007f2cd8d68f49 00007f2cd22f5d34 00007f2cd22f5cc2 00007f2cd22f5bf1 00007f2cd22f5b6c 00007f2cd22f4e22 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:29.031445 (+ 52us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:29.031592 (+ 147us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2334987008}
W20260203 09:17:29.038244 29425 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.232.66:41611 timed out after 1.580s (SENT) [suppressed 2 similar messages]
I20260203 09:17:29.407565 28887 rpcz_store.cc:276] 0203 09:17:28.058210 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:28.058355 (+ 145us) service_pool.cc:225] Handling call
0203 09:17:28.520229 (+461874us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:28.939682 (+419453us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:28.939715 (+ 33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:28.939757 (+ 42us) raft_consensus.cc:1645] Marking committed up to 5
0203 09:17:28.939786 (+ 29us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:29.097326 (+157540us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b54002e9ad4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db5a81 00007f2cd3db44be 00007f2cd8d68f49 00007f2cd22f5d34 00007f2cd22f5cc2 00007f2cd22f5bf1 00007f2cd22f5b6c 00007f2cd22f4e22 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:29.097365 (+ 39us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:29.097482 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":964179840}
I20260203 09:17:29.151542 28631 catalog_manager.cc:5654] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 1 to 2, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68). New cstate: current_term: 2 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260203 09:17:29.395347 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 412846us
I20260203 09:17:29.122798 28733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43626 (request call id 1295) took 1398 ms. Trace:
I20260203 09:17:29.115254 29459 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53310 (request call id 386) took 1583 ms. Trace:
I20260203 09:17:29.406049 30309 raft_consensus.cc:2804] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:29.116312 29458 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53310 (request call id 383) took 2185 ms. Trace:
I20260203 09:17:29.183090 29460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53310 (request call id 378) took 2763 ms. Trace:
I20260203 09:17:29.137339 28804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36404 (request call id 1103) took 2390 ms. Trace:
I20260203 09:17:29.115831 28806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50256 (request call id 129) took 1692 ms. Trace:
W20260203 09:17:29.376055 30146 consensus_meta.cc:287] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc: Time spent flushing consensus metadata: real 0.666s user 0.004s sys 0.002s
I20260203 09:17:29.399741 30275 raft_consensus.cc:515] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:29.430449 28806 rpcz_store.cc:276] 0203 09:17:27.423647 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:27.423752 (+ 105us) service_pool.cc:225] Handling call
0203 09:17:27.424036 (+ 284us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:28.531162 (+1107126us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:28.531190 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:28.531228 (+ 38us) raft_consensus.cc:1645] Marking committed up to 5
0203 09:17:28.531258 (+ 30us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:29.115538 (+584280us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b54000361d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db5a81 00007f2cd3db44be 00007f2cd8d68f49 00007f2cd22f5d34 00007f2cd22f5cc2 00007f2cd22f5bf1 00007f2cd22f5b6c 00007f2cd22f4e22 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:29.115597 (+ 59us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:29.115734 (+ 137us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1495210368}
I20260203 09:17:29.198761 30157 leader_election.cc:290] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:29.319276 30183 consensus_meta.cc:287] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc: Time spent flushing consensus metadata: real 0.624s user 0.011s sys 0.000s
I20260203 09:17:29.407989 28810 rpcz_store.cc:276] 0203 09:17:27.424419 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:27.424554 (+ 135us) service_pool.cc:225] Handling call
0203 09:17:27.424857 (+ 303us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:27.735889 (+311032us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:27.735918 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:27.735955 (+ 37us) raft_consensus.cc:1645] Marking committed up to 5
0203 09:17:27.735982 (+ 27us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:29.116532 (+1380550us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b540020d354. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db5a81 00007f2cd3db44be 00007f2cd8d68f49 00007f2cd22f5d34 00007f2cd22f5cc2 00007f2cd22f5bf1 00007f2cd22f5b6c 00007f2cd22f4e22 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:29.116588 (+ 56us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:29.116718 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":714871168}
I20260203 09:17:29.399919 30255 raft_consensus.cc:3060] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:29.413661 30187 raft_consensus.cc:515] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:29.426712 30309 raft_consensus.cc:493] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
W20260203 09:17:29.129914 28813 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36404 (request call id 1106) took 2382 ms (client timeout 2535 ms). Trace:
I20260203 09:17:29.431075 28886 raft_consensus.cc:2468] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 3.
I20260203 09:17:29.398362 30219 raft_consensus.cc:3060] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:29.095463 30155 leader_election.cc:290] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:29.091764 30298 leader_election.cc:290] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:29.398608 30292 raft_consensus.cc:3060] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:29.183565 30251 leader_election.cc:290] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:29.096159 28734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45044 (request call id 117) took 1795 ms. Trace:
I20260203 09:17:29.393483 30284 leader_election.cc:290] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:29.393592 30299 leader_election.cc:290] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:29.429750 30167 raft_consensus.cc:515] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:29.321410 30295 leader_election.cc:290] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:29.121619 30274 leader_election.cc:290] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:29.428961 29460 rpcz_store.cc:276] 0203 09:17:26.419379 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:26.424063 (+ 4684us) service_pool.cc:225] Handling call
0203 09:17:27.072089 (+648026us) spinlock_profiling.cc:243] Waited 55 ms on lock 0x7b580023f798. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd0b478b1 00007f2cd0cc9db1 00007f2cd0cc9c62 00007f2cd9b74dd9 00007f2cd8cf4260 00007f2cd8dbcdbb 00007f2cd8dbce41 00007f2cd8d7eaf0 00007f2cd8d69459 00007f2cd8d68f02 00007f2cd22f5d34
0203 09:17:27.072291 (+ 202us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:27.804696 (+732405us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:27.807216 (+ 2520us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:27.810820 (+ 3604us) raft_consensus.cc:1645] Marking committed up to 4
0203 09:17:27.817751 (+ 6931us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:29.182637 (+1364886us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b54004961d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db5a81 00007f2cd3db44be 00007f2cd8d68f49 00007f2cd22f5d34 00007f2cd22f5cc2 00007f2cd22f5bf1 00007f2cd22f5b6c 00007f2cd22f4e22 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:29.182699 (+ 62us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:29.182951 (+ 252us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1726368384}
I20260203 09:17:29.442090 30183 raft_consensus.cc:515] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:29.450466 30187 leader_election.cc:290] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:29.414273 28733 rpcz_store.cc:276] 0203 09:17:27.724148 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:27.752584 (+ 28436us) service_pool.cc:225] Handling call
0203 09:17:29.122596 (+1370012us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b5400278dd4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:29.122734 (+ 138us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1786598144}
I20260203 09:17:29.452375 28731 raft_consensus.cc:2393] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 3: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:29.425503 30235 leader_election.cc:290] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
W20260203 09:17:29.483135 30256 consensus_meta.cc:287] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a: Time spent flushing consensus metadata: real 0.530s user 0.008s sys 0.004s
I20260203 09:17:29.027393 30267 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:29.059654 30290 leader_election.cc:290] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:29.390182 30243 raft_consensus.cc:515] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:29.344338 30266 raft_consensus.cc:515] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:29.474334 28886 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59280 (request call id 172) took 3099 ms (client timeout 2065 ms). Trace:
I20260203 09:17:29.183125 30282 leader_election.cc:290] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:29.507894 28886 rpcz_store.cc:269] 0203 09:17:26.361867 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:26.361991 (+ 124us) service_pool.cc:225] Handling call
0203 09:17:29.461175 (+3099184us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b54000eb0d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:29.461301 (+ 126us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4890649984}
W20260203 09:17:29.487085 30293 consensus_meta.cc:287] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a: Time spent flushing consensus metadata: real 0.712s user 0.008s sys 0.008s
I20260203 09:17:29.445755 30277 leader_election.cc:290] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:29.431306 29458 rpcz_store.cc:276] 0203 09:17:26.930637 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:27.587527 (+656890us) service_pool.cc:225] Handling call
0203 09:17:27.695989 (+108462us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:27.752022 (+ 56033us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:27.752054 (+ 32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:27.752096 (+ 42us) raft_consensus.cc:1645] Marking committed up to 5
0203 09:17:27.752132 (+ 36us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:29.116077 (+1363945us) spinlock_profiling.cc:243] Waited 55.8 ms on lock 0x7b54004b4e54. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db5a81 00007f2cd3db44be 00007f2cd8d68f49 00007f2cd22f5d34 00007f2cd22f5cc2 00007f2cd22f5bf1 00007f2cd22f5b6c 00007f2cd22f4e22 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:29.116130 (+ 53us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:29.116253 (+ 123us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":128430464}
W20260203 09:17:29.475410 30133 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.943s user 0.020s sys 0.081s
I20260203 09:17:29.447839 30288 leader_election.cc:290] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:29.474874 30212 consensus_meta.cc:287] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent flushing consensus metadata: real 0.834s user 0.009s sys 0.004s
I20260203 09:17:29.459273 30309 raft_consensus.cc:3060] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:29.414582 29459 rpcz_store.cc:276] 0203 09:17:27.531960 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:27.721948 (+189988us) service_pool.cc:225] Handling call
0203 09:17:29.115015 (+1393067us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b5400580f54. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:29.115165 (+ 150us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1838177664}
I20260203 09:17:29.492152 30297 leader_election.cc:290] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
W20260203 09:17:29.493702 28731 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43626 (request call id 1294) took 1769 ms (client timeout 2184 ms). Trace:
I20260203 09:17:29.407809 28736 raft_consensus.cc:2468] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 4.
I20260203 09:17:29.440130 30146 raft_consensus.cc:515] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:29.499996 28701 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.910s user 0.016s sys 0.077s
I20260203 09:17:29.484690 30291 raft_consensus.cc:1081] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Signalling peer 847a7af9f0e2497cbb9025cc2c62557e to start an election
I20260203 09:17:29.408520 28634 rpcz_store.cc:276] 0203 09:17:24.996630 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:24.996901 (+ 271us) service_pool.cc:225] Handling call
0203 09:17:29.152295 (+4155394us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0203 09:17:25.444163 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0203 09:17:25.685719 (+241556us) write_op.cc:432] Acquiring schema lock in shared mode
0203 09:17:25.696632 (+ 10913us) write_op.cc:435] Acquired schema lock
0203 09:17:25.696685 (+ 53us) tablet.cc:660] Decoding operations
0203 09:17:25.764228 (+ 67543us) write_op.cc:620] Acquiring the partition lock for write op
0203 09:17:25.764297 (+ 69us) write_op.cc:641] Partition lock acquired for write op
0203 09:17:25.764328 (+ 31us) tablet.cc:683] Acquiring locks for 4 operations
0203 09:17:25.764753 (+ 425us) tablet.cc:699] Row locks acquired
0203 09:17:25.764774 (+ 21us) write_op.cc:260] PREPARE: finished
0203 09:17:25.765075 (+ 301us) write_op.cc:270] Start()
0203 09:17:25.765271 (+ 196us) write_op.cc:276] Timestamp: P: 1770110245764986 usec, L: 0
0203 09:17:25.765291 (+ 20us) op_driver.cc:348] REPLICATION: starting
0203 09:17:25.782366 (+ 17075us) log.cc:844] Serialized 1764 byte log entry
0203 09:17:26.429503 (+647137us) op_driver.cc:464] REPLICATION: finished
0203 09:17:27.073733 (+644230us) write_op.cc:301] APPLY: starting
0203 09:17:27.073820 (+ 87us) tablet.cc:1365] starting BulkCheckPresence
0203 09:17:27.073985 (+ 165us) tablet.cc:1368] finished BulkCheckPresence
0203 09:17:27.074114 (+ 129us) tablet.cc:1370] starting ApplyRowOperation cycle
0203 09:17:27.577925 (+503811us) tablet.cc:1381] finished ApplyRowOperation cycle
0203 09:17:27.578130 (+ 205us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0203 09:17:27.578190 (+ 60us) write_op.cc:312] APPLY: finished
0203 09:17:27.590244 (+ 12054us) log.cc:844] Serialized 41 byte log entry
0203 09:17:27.870042 (+279798us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:17:27.891961 (+ 21919us) write_op.cc:454] Released schema lock
0203 09:17:27.931281 (+ 39320us) write_op.cc:341] FINISH: Updating metrics
0203 09:17:28.126491 (+195210us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:17:28.159140 (+ 32649us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2532,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":541559,"apply.run_cpu_time_us":33820,"apply.run_wall_time_us":978357,"num_ops":4,"prepare.queue_time_us":10884,"prepare.run_cpu_time_us":5491,"prepare.run_wall_time_us":387642,"replication_time_us":599515,"thread_start_us":648198,"threads_started":2,"wal-append.queue_time_us":578937}]]}
I20260203 09:17:29.421612 30302 raft_consensus.cc:515] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:29.430047 28804 rpcz_store.cc:276] 0203 09:17:26.746974 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:26.754602 (+ 7628us) service_pool.cc:225] Handling call
0203 09:17:26.770898 (+ 16296us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:27.805946 (+1035048us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:27.805991 (+ 45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:27.808617 (+ 2626us) raft_consensus.cc:1645] Marking committed up to 3
0203 09:17:27.817452 (+ 8835us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:29.137035 (+1319583us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540023a854. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db5a81 00007f2cd3db44be 00007f2cd8d68f49 00007f2cd22f5d34 00007f2cd22f5cc2 00007f2cd22f5bf1 00007f2cd22f5b6c 00007f2cd22f4e22 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:29.137087 (+ 52us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:29.137217 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2379834752}
I20260203 09:17:29.475772 28734 rpcz_store.cc:276] 0203 09:17:27.300491 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:27.300628 (+ 137us) service_pool.cc:225] Handling call
0203 09:17:27.386654 (+ 86026us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:27.753515 (+366861us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:27.755832 (+ 2317us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:27.760446 (+ 4614us) raft_consensus.cc:1645] Marking committed up to 5
0203 09:17:27.769175 (+ 8729us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:29.095896 (+1326721us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b540029b154. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db5a81 00007f2cd3db44be 00007f2cd8d68f49 00007f2cd22f5d34 00007f2cd22f5cc2 00007f2cd22f5bf1 00007f2cd22f5b6c 00007f2cd22f4e22 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:29.095954 (+ 58us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:29.096099 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":823790976}
I20260203 09:17:29.542433 30167 leader_election.cc:290] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:29.122175 30305 consensus_queue.cc:237] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:29.544924 28703 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.364s user 0.006s sys 0.027s
W20260203 09:17:29.458639 28813 rpcz_store.cc:269] 0203 09:17:26.747834 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:26.755000 (+ 7166us) service_pool.cc:225] Handling call
0203 09:17:29.129674 (+2374674us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b5400204254. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:29.129819 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1876736384}
I20260203 09:17:29.505640 30256 raft_consensus.cc:515] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:29.549263 28731 rpcz_store.cc:269] 0203 09:17:27.723877 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:27.724036 (+ 159us) service_pool.cc:225] Handling call
0203 09:17:29.493372 (+1769336us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b540034ec54. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:29.493629 (+ 257us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3270074112}
W20260203 09:17:29.545012 30133 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.018s user 0.021s sys 0.083s
W20260203 09:17:29.551445 28701 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.961s user 0.016s sys 0.077s
W20260203 09:17:29.582278 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 992085us
I20260203 09:17:29.584334 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.585101 28887 raft_consensus.cc:2468] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:29.585155 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "021e904a783c4cbc96e5aa625a34a2d8" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.587100 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.587643 28886 raft_consensus.cc:2468] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:29.587661 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b6f1d6e275f4a8ba99a70dbb3ea3235" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.588896 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.589437 28882 raft_consensus.cc:2468] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
W20260203 09:17:29.590523 28852 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.964s user 0.014s sys 0.007s
W20260203 09:17:29.598055 28852 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.972s user 0.015s sys 0.008s
I20260203 09:17:29.545230 30293 raft_consensus.cc:515] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:29.609465 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.544291 30267 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:29.574622 28703 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.394s user 0.007s sys 0.027s
I20260203 09:17:29.609684 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.610834 28887 raft_consensus.cc:2368] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 2. Current term is 3.
I20260203 09:17:29.611909 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
W20260203 09:17:29.560248 28777 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.370s user 0.010s sys 0.009s
W20260203 09:17:29.617075 28777 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.427s user 0.011s sys 0.009s
W20260203 09:17:29.617506 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 1.42732e+06us
I20260203 09:17:29.618763 28777 leader_election.cc:304] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:29.620047 28777 leader_election.cc:304] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:29.621806 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.610487 28888 raft_consensus.cc:2468] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
W20260203 09:17:29.559930 28736 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43626 (request call id 1293) took 1835 ms (client timeout 1955 ms). Trace:
I20260203 09:17:29.629036 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b2c469d7255413d9f61a7cbaa4481a7" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:29.634956 28738 raft_consensus.cc:2468] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:17:29.631743 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:29.637553 28731 raft_consensus.cc:2468] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:17:29.638407 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:29.638837 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.632318 28701 leader_election.cc:304] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:29.550166 30212 raft_consensus.cc:515] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:29.638959 28731 raft_consensus.cc:2468] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:17:29.643733 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.632596 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.644426 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:29.650453 28882 raft_consensus.cc:2393] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 4: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:29.644140 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.651973 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.653522 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:29.654186 28738 raft_consensus.cc:2468] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:17:29.655586 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.643791 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:29.589756 30183 leader_election.cc:290] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:29.602746 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:29.601099 30260 leader_election.cc:290] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:29.601428 30275 leader_election.cc:290] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:29.682592 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:29.694005 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:17:29.700011 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 67768.7us
I20260203 09:17:29.695492 30304 leader_election.cc:290] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:29.658092 29465 raft_consensus.cc:2368] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3.
W20260203 09:17:29.624131 28881 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.955s user 0.000s sys 0.019s
W20260203 09:17:29.635258 30250 consensus_meta.cc:287] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent flushing consensus metadata: real 0.685s user 0.010s sys 0.006s
I20260203 09:17:29.790266 30250 raft_consensus.cc:515] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:29.632478 28854 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.006s user 0.000s sys 0.019s
W20260203 09:17:29.793119 28854 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.167s user 0.000s sys 0.020s
I20260203 09:17:29.726145 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:29.727012 30314 raft_consensus.cc:2804] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260203 09:17:29.632393 30173 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.297s user 0.004s sys 0.012s
I20260203 09:17:29.745371 28701 leader_election.cc:304] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
W20260203 09:17:29.794235 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 48930.3us
I20260203 09:17:29.750913 28852 leader_election.cc:304] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:29.652547 28889 raft_consensus.cc:2468] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:29.724473 30297 raft_consensus.cc:493] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:29.797796 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.641618 30267 raft_consensus.cc:493] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:29.738723 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.626703 30310 raft_consensus.cc:2804] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:29.765396 28734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:17:29.626799 28736 rpcz_store.cc:269] 0203 09:17:27.723641 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:27.725122 (+ 1481us) service_pool.cc:225] Handling call
0203 09:17:28.932089 (+1206967us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b5800261098. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd0b478b1 00007f2cd0cc9db1 00007f2cd0cca12e 000000000035a3c9 00007f2cd8cf4560 00007f2cd8dbcdd4 00007f2cd8dbce41 00007f2cd8d6abd0 00007f2cd8d6a4b4 00007f2cd22fa834 00007f2cd22fa7c2
0203 09:17:29.558860 (+626771us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6726016}
I20260203 09:17:29.644330 30282 raft_consensus.cc:493] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:29.803992 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.804453 30282 raft_consensus.cc:515] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:29.804751 30267 raft_consensus.cc:515] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:29.768834 28883 raft_consensus.cc:2468] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:29.805811 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.806236 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.806430 28880 raft_consensus.cc:2468] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:17:29.806787 30267 leader_election.cc:290] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:29.769273 30302 leader_election.cc:290] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:29.642973 30300 leader_election.cc:290] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:29.772492 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.773686 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.807631 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:17:29.781424 28851 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.166s user 0.022s sys 0.053s
I20260203 09:17:29.641561 30290 raft_consensus.cc:493] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:29.793273 28737 raft_consensus.cc:2468] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:29.642046 28777 leader_election.cc:304] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
W20260203 09:17:29.811448 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 169466us
I20260203 09:17:29.643338 30213 raft_consensus.cc:2804] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:29.758975 28884 raft_consensus.cc:3060] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:29.749696 30295 raft_consensus.cc:493] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:29.725873 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:29.798202 30277 raft_consensus.cc:2804] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:29.796335 30314 raft_consensus.cc:493] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
W20260203 09:17:29.832953 28776 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.509s user 0.025s sys 0.035s
I20260203 09:17:29.833369 28738 raft_consensus.cc:2468] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:17:29.798776 28889 raft_consensus.cc:2468] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
W20260203 09:17:29.833695 28776 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.509s user 0.026s sys 0.035s
I20260203 09:17:29.800168 28701 leader_election.cc:304] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:29.834614 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:29.799409 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
W20260203 09:17:29.801771 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 50946.2us
I20260203 09:17:29.792613 30250 leader_election.cc:290] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:29.836522 28852 leader_election.cc:304] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:29.837045 30250 raft_consensus.cc:2804] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:29.803545 30310 raft_consensus.cc:493] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:29.776139 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:29.837404 30250 raft_consensus.cc:493] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:29.837800 28730 raft_consensus.cc:2468] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:29.753162 30274 raft_consensus.cc:493] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:29.838382 30295 raft_consensus.cc:515] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:29.834482 30314 raft_consensus.cc:3060] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:29.845754 30157 raft_consensus.cc:2804] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:29.846169 30157 raft_consensus.cc:493] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:29.846504 30157 raft_consensus.cc:3060] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:29.840008 30310 raft_consensus.cc:3060] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:29.849412 30308 raft_consensus.cc:515] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:29.830228 30290 raft_consensus.cc:515] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:29.852795 30290 leader_election.cc:290] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:29.806910 28883 raft_consensus.cc:2468] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:29.854013 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.854833 28887 raft_consensus.cc:2393] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 3: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
W20260203 09:17:29.809862 28851 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.194s user 0.022s sys 0.053s
W20260203 09:17:29.797142 30173 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.473s user 0.005s sys 0.012s
I20260203 09:17:29.783531 30266 leader_election.cc:290] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:29.808295 30297 raft_consensus.cc:515] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:29.821695 28734 raft_consensus.cc:2468] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:17:29.821957 30146 leader_election.cc:290] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:29.821087 30213 raft_consensus.cc:493] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:29.826984 30291 raft_consensus.cc:2804] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:29.828464 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:29.898576 28732 raft_consensus.cc:2393] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:29.803896 30256 leader_election.cc:290] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:29.787655 28881 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.128s user 0.000s sys 0.020s
I20260203 09:17:29.835018 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.835809 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.837837 30250 raft_consensus.cc:3060] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:29.808198 28882 raft_consensus.cc:2468] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:17:29.838778 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:29.754467 30243 leader_election.cc:290] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:29.944777 28777 connection.cc:232] RPC call timeout handler was delayed by -2.6095642799996313s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22340000000000002s for a response
I20260203 09:17:29.837425 28852 leader_election.cc:304] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
W20260203 09:17:29.026607 30161 ts_tablet_manager.cc:1469] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a: Trace:
0203 09:17:22.149540 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:22.153139 (+ 3599us) service_pool.cc:225] Handling call
0203 09:17:22.519550 (+366411us) ts_tablet_manager.cc:934] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967)
0203 09:17:23.231836 (+712286us) tablet_copy_client.cc:368] Tablet copy session begun
0203 09:17:23.392763 (+160927us) tablet_metadata.cc:641] Metadata flushed
0203 09:17:23.393029 (+ 266us) tablet_copy_client.cc:497] Wrote new tablet metadata
0203 09:17:23.460564 (+ 67535us) tablet_copy_client.cc:418] Wrote new consensus metadata
0203 09:17:23.460981 (+ 417us) tablet_replica.cc:206] Creating consensus instance
0203 09:17:23.461353 (+ 372us) ts_tablet_manager.cc:989] Replica registered.
0203 09:17:23.461418 (+ 65us) inbound_call.cc:173] Queueing success response
0203 09:17:23.838234 (+376816us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0203 09:17:25.924786 (+2086552us) ts_tablet_manager.cc:1435] Starting tablet replica
0203 09:17:26.315126 (+390340us) tablet_replica.cc:261] Starting instrumentation
0203 09:17:26.315797 (+ 671us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":44533,"mutex_wait_us":177431,"raft.queue_time_us":506,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":1511,"tablet-copy.queue_time_us":105154,"tablet-download-pool.queue_time_us":358,"tablet-download-pool.run_cpu_time_us":1243,"tablet-download-pool.run_wall_time_us":6396,"thread_start_us":109206,"threads_started":2}
I20260203 09:17:29.867537 28738 raft_consensus.cc:2410] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260203 09:17:29.856366 28731 raft_consensus.cc:2368] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 2. Current term is 3.
I20260203 09:17:29.868429 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:29.809762 30304 raft_consensus.cc:2804] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:29.869792 30147 raft_consensus.cc:493] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:29.871821 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:29.822763 30293 leader_election.cc:290] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:29.889056 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:29.890348 30309 raft_consensus.cc:515] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:29.892086 30282 leader_election.cc:290] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:29.893055 30212 leader_election.cc:290] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:29.894176 30278 consensus_meta.cc:287] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a: Time spent flushing consensus metadata: real 0.964s user 0.007s sys 0.007s
I20260203 09:17:29.893874 30292 raft_consensus.cc:515] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:29.829674 28736 raft_consensus.cc:2468] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:29.856045 30274 raft_consensus.cc:515] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:29.895215 29458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:29.895217 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:29.834601 30277 raft_consensus.cc:493] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:29.921190 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.945029 28730 raft_consensus.cc:2468] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:29.933549 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.979333 28883 raft_consensus.cc:2468] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:17:29.979836 28889 raft_consensus.cc:2393] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 3: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:29.948143 28885 raft_consensus.cc:2468] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:29.949282 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:29.950273 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:29.980247 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:29.981247 28731 raft_consensus.cc:2468] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:17:29.981812 28883 raft_consensus.cc:2393] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 3: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:29.982111 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:29.954049 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fabfb779b8894cf0b22204fe12768dc3" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:29.955493 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 118124us
I20260203 09:17:29.983870 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:29.984478 28738 raft_consensus.cc:2468] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
W20260203 09:17:29.984153 28729 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.800s user 0.023s sys 0.056s
W20260203 09:17:29.985384 28729 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.801s user 0.023s sys 0.056s
I20260203 09:17:29.985948 28852 leader_election.cc:304] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:29.958972 30287 raft_consensus.cc:493] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
W20260203 09:17:29.950287 30313 log.cc:927] Time spent T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.212s user 0.000s sys 0.001s
I20260203 09:17:29.991412 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:29.967024 30318 raft_consensus.cc:493] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:29.965559 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:29.898151 30291 raft_consensus.cc:493] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:29.967877 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:29.966926 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:29.946316 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.958616 30243 raft_consensus.cc:2804] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:29.983031 30277 raft_consensus.cc:3060] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:29.959379 30147 raft_consensus.cc:515] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:29.955502 30304 raft_consensus.cc:493] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:29.899650 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:29.985415 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:30.058131 28738 raft_consensus.cc:2368] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 2. Current term is 3.
I20260203 09:17:29.988552 30139 raft_consensus.cc:493] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
W20260203 09:17:29.986522 29425 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.534s user 0.012s sys 0.023s
I20260203 09:17:29.973690 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:30.063853 29425 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.611s user 0.012s sys 0.024s
I20260203 09:17:30.064272 28882 raft_consensus.cc:2468] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
W20260203 09:17:30.064226 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 1.02597e+06us
I20260203 09:17:30.064630 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47301e2bbfc94767a9905b0e12141d6d" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:30.065760 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fabfb779b8894cf0b22204fe12768dc3" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:29.962112 30133 raft_consensus.cc:493] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:30.069406 28701 leader_election.cc:304] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:29.974004 30278 raft_consensus.cc:515] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:29.899130 30213 raft_consensus.cc:3060] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:29.964329 29459 raft_consensus.cc:2468] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:29.995772 28852 leader_election.cc:304] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:29.967530 30293 raft_consensus.cc:493] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:29.998180 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:29.999315 29465 raft_consensus.cc:2393] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 2: Already voted for candidate cf00f643e7da4a98a0a11ea92869c24a in this term.
W20260203 09:17:30.157894 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 162213us
I20260203 09:17:30.160005 28852 leader_election.cc:304] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:30.058678 29457 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:30.009094 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:29.970552 29460 raft_consensus.cc:2468] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
W20260203 09:17:29.989014 30230 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.133s user 0.072s sys 0.174s
I20260203 09:17:30.059036 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b2c469d7255413d9f61a7cbaa4481a7" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:29.960400 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:29.986380 30223 raft_consensus.cc:2749] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:30.013717 30291 raft_consensus.cc:3060] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
W20260203 09:17:29.972129 28700 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.511s user 0.026s sys 0.059s
I20260203 09:17:30.009517 30275 raft_consensus.cc:2804] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:29.926281 30219 raft_consensus.cc:515] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:30.073434 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:30.071499 28701 leader_election.cc:304] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:30.008859 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:29.980329 30310 raft_consensus.cc:515] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:30.076196 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:30.077155 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "021e904a783c4cbc96e5aa625a34a2d8" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:30.136070 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:30.153656 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:30.219374 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:30.163748 28852 leader_election.cc:304] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:30.155179 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:30.059711 30295 leader_election.cc:290] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:30.212706 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 50026.1us
I20260203 09:17:30.075012 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:17:30.216696 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 145263us
I20260203 09:17:30.217104 28885 raft_consensus.cc:2393] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a in current term 3: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
W20260203 09:17:30.181397 30255 consensus_meta.cc:287] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a: Time spent flushing consensus metadata: real 0.732s user 0.009s sys 0.001s
I20260203 09:17:30.162570 29426 leader_election.cc:304] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:30.063187 28734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:17:30.211895 28700 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.751s user 0.034s sys 0.059s
I20260203 09:17:30.216547 28732 raft_consensus.cc:2468] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:17:30.221917 28737 raft_consensus.cc:2468] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
W20260203 09:17:30.233336 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 834113us
I20260203 09:17:30.080281 30266 raft_consensus.cc:2804] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:30.216058 28730 raft_consensus.cc:2393] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 3: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:30.226007 29465 raft_consensus.cc:2393] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate cf00f643e7da4a98a0a11ea92869c24a in this term.
I20260203 09:17:30.225368 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:30.317974 28731 raft_consensus.cc:2468] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:17:30.174916 30235 raft_consensus.cc:2804] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:30.227866 30183 raft_consensus.cc:2804] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:30.228114 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:30.219630 30275 raft_consensus.cc:493] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:30.221594 30305 raft_consensus.cc:2804] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:17:30.014246 30243 raft_consensus.cc:493] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:30.174825 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:30.382712 28882 raft_consensus.cc:3060] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:17:29.984242 28735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.944s user 0.032s sys 0.029s
I20260203 09:17:30.231768 28701 leader_election.cc:304] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:30.233629 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:30.151192 30308 leader_election.cc:290] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:30.165736 30322 raft_consensus.cc:2749] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260203 09:17:30.223567 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 59991.6us
W20260203 09:17:30.241636 28776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 384783us
I20260203 09:17:29.997344 30287 raft_consensus.cc:515] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:30.010483 30318 raft_consensus.cc:515] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:30.154301 29461 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fabfb779b8894cf0b22204fe12768dc3" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:30.304530 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:30.305164 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:30.241637 28700 leader_election.cc:400] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Vote denied by peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627) with higher term. Message: Invalid argument: T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3.
I20260203 09:17:30.180863 28746 tablet_copy_service.cc:342] P 847a7af9f0e2497cbb9025cc2c62557e: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-7e1bac12c6ee43d6901400e02b35d82f received from {username='slave'} at 127.0.0.1:45044
I20260203 09:17:30.075456 30139 raft_consensus.cc:515] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:30.089316 30133 raft_consensus.cc:515] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:30.183766 30293 raft_consensus.cc:515] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:30.252489 29458 raft_consensus.cc:1240] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Rejecting Update request from peer 77541303e1934638ba82f0f43f707adc for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:30.244624 30266 raft_consensus.cc:493] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
W20260203 09:17:30.221079 30230 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.383s user 0.072s sys 0.184s
I20260203 09:17:30.309689 28884 raft_consensus.cc:2468] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:30.261322 30309 leader_election.cc:290] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:30.164578 28733 raft_consensus.cc:2468] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:17:30.318300 30310 leader_election.cc:290] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:30.259769 28734 raft_consensus.cc:2468] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:30.242084 30255 raft_consensus.cc:515] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:30.480830 28777 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s user 0.031s sys 0.032s
I20260203 09:17:30.756492 28700 leader_election.cc:403] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260203 09:17:30.327792 28888 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.682s user 0.045s sys 0.083s
I20260203 09:17:30.391975 28730 raft_consensus.cc:1275] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:17:30.150020 30304 raft_consensus.cc:3060] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:30.309916 30256 raft_consensus.cc:2804] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:30.308923 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:30.787298 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43612 (request call id 1658) took 1156 ms. Trace:
W20260203 09:17:30.389353 28735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.349s user 0.033s sys 0.029s
I20260203 09:17:30.433597 30223 raft_consensus.cc:2804] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:30.318573 30235 raft_consensus.cc:493] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:30.365149 30290 raft_consensus.cc:493] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:30.318116 30147 leader_election.cc:290] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:30.318956 30297 leader_election.cc:290] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:30.303192 30314 raft_consensus.cc:515] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:30.786072 28732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43612 (request call id 1674) took 1041 ms. Trace:
I20260203 09:17:30.478924 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:17:30.432039 30275 raft_consensus.cc:3060] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:30.438697 30305 raft_consensus.cc:697] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:30.454903 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "021e904a783c4cbc96e5aa625a34a2d8" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:30.817073 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b6f1d6e275f4a8ba99a70dbb3ea3235" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:30.756736 28777 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.802s user 0.038s sys 0.047s
W20260203 09:17:30.818300 28777 connection.cc:232] RPC call timeout handler was delayed by -2.00835124599962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
W20260203 09:17:30.818645 28777 connection.cc:232] RPC call timeout handler was delayed by -1.7275512459996207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
W20260203 09:17:30.818919 28777 connection.cc:232] RPC call timeout handler was delayed by -1.7275512459996207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
W20260203 09:17:30.819185 28777 connection.cc:232] RPC call timeout handler was delayed by -1.5214512459997422s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21840000000000004s for a response
W20260203 09:17:30.819449 28777 connection.cc:232] RPC call timeout handler was delayed by -1.4404512459996113s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22740000000000002s for a response
W20260203 09:17:30.819715 28777 connection.cc:232] RPC call timeout handler was delayed by -1.1443512459995873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26030000000000003s for a response
W20260203 09:17:30.819994 28777 connection.cc:232] RPC call timeout handler was delayed by -1.0894512459999532s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2664s for a response
W20260203 09:17:30.480979 28631 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.043s user 0.000s sys 0.066s
W20260203 09:17:30.822505 28631 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.385s user 0.006s sys 0.086s
I20260203 09:17:30.440192 28852 leader_election.cc:304] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
W20260203 09:17:30.790005 28888 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.147s user 0.052s sys 0.087s
I20260203 09:17:30.795322 28730 rpcz_store.cc:276] 0203 09:17:29.630990 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:30.388471 (+757481us) service_pool.cc:225] Handling call
0203 09:17:30.391634 (+ 3163us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:30.786934 (+395300us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:30.787239 (+ 305us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 09:17:30.342074 30183 raft_consensus.cc:493] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:30.809695 28737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43612 (request call id 1662) took 1168 ms. Trace:
I20260203 09:17:30.912401 29464 raft_consensus.cc:2468] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:30.811995 29463 raft_consensus.cc:2393] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 2: Already voted for candidate cf00f643e7da4a98a0a11ea92869c24a in this term.
I20260203 09:17:30.791496 30235 raft_consensus.cc:3060] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:30.817133 28810 raft_consensus.cc:2468] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
W20260203 09:17:30.789896 28733 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43612 (request call id 1646) took 1162 ms (client timeout 1541 ms). Trace:
I20260203 09:17:30.378827 30300 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
W20260203 09:17:30.637491 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 112376us
I20260203 09:17:30.441109 30292 leader_election.cc:290] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
W20260203 09:17:30.941658 28701 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s user 0.012s sys 0.052s
W20260203 09:17:30.942031 28701 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s user 0.012s sys 0.052s
W20260203 09:17:30.942291 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 710588us
I20260203 09:17:30.943158 28701 leader_election.cc:304] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
W20260203 09:17:30.755364 30323 log.cc:927] Time spent T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.450s user 0.000s sys 0.000s
I20260203 09:17:30.817800 28811 raft_consensus.cc:2468] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:17:30.439273 28881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59280 (request call id 182) took 2381 ms. Trace:
I20260203 09:17:30.389672 30243 raft_consensus.cc:3060] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:30.788116 30256 raft_consensus.cc:493] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
W20260203 09:17:30.481303 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 528056us
W20260203 09:17:30.947712 28851 connection.cc:232] RPC call timeout handler was delayed by -1.0158385099998668s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2786s for a response
W20260203 09:17:30.916322 30157 consensus_meta.cc:287] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc: Time spent flushing consensus metadata: real 1.065s user 0.005s sys 0.005s
W20260203 09:17:30.915177 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 475063us
I20260203 09:17:30.790475 30223 raft_consensus.cc:493] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:30.914011 28737 rpcz_store.cc:276] 0203 09:17:29.641452 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:30.787995 (+1146543us) service_pool.cc:225] Handling call
0203 09:17:30.809186 (+ 21191us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:30.809343 (+ 157us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:30.809374 (+ 31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:30.809419 (+ 45us) raft_consensus.cc:1645] Marking committed up to 4
0203 09:17:30.809449 (+ 30us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:30.809509 (+ 60us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:30.809628 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260203 09:17:30.913116 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 90869us
I20260203 09:17:30.793318 30266 raft_consensus.cc:3060] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:30.794636 28746 tablet_copy_service.cc:434] P 847a7af9f0e2497cbb9025cc2c62557e: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-7e1bac12c6ee43d6901400e02b35d82f on tablet 7e1bac12c6ee43d6901400e02b35d82f with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:30.790035 28884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40946 (request call id 1105) took 1203 ms. Trace:
I20260203 09:17:30.918048 30183 raft_consensus.cc:3060] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:30.930111 30255 leader_election.cc:290] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:30.930914 30324 log.cc:927] Time spent T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.624s user 0.000s sys 0.001s
W20260203 09:17:30.931483 30325 log.cc:927] Time spent T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.615s user 0.000s sys 0.001s
I20260203 09:17:30.932338 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:30.980051 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:30.980948 28734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43612 (request call id 1663) took 1338 ms. Trace:
I20260203 09:17:30.793746 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:30.938184 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:30.981341 28734 rpcz_store.cc:276] 0203 09:17:29.642948 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:30.794133 (+1151185us) service_pool.cc:225] Handling call
0203 09:17:30.935810 (+141677us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:30.953983 (+ 18173us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:30.960922 (+ 6939us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:30.969895 (+ 8973us) raft_consensus.cc:1645] Marking committed up to 1
0203 09:17:30.980704 (+ 10809us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:30.980775 (+ 71us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:30.980894 (+ 119us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 09:17:30.982251 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:30.982894 28807 raft_consensus.cc:2468] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:17:30.983246 28734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43626 (request call id 1300) took 1142 ms. Trace:
I20260203 09:17:30.983721 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:30.985822 30287 leader_election.cc:290] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:30.979120 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43626 (request call id 1298) took 3254 ms. Trace:
I20260203 09:17:30.987040 28729 rpcz_store.cc:276] 0203 09:17:27.724922 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:28.046164 (+321242us) service_pool.cc:225] Handling call
0203 09:17:28.046506 (+ 342us) raft_consensus.cc:1471] Updating replica for 1 ops
0203 09:17:28.046841 (+ 335us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:28.046869 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0203 09:17:28.105468 (+ 58599us) log.cc:844] Serialized 26 byte log entry
0203 09:17:29.184064 (+1078596us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b1800378640. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd9b5bc91 00007f2cd9b68671 00007f2cd0ce9c67 00007f2cd9ad2709 00007f2cd0d0657b 00007f2cd0d0481f 00007f2cd0d06ae2 00007f2cd394e5ab 00007f2cd39540c3 00007f2cd3954471 00007f2cd3d7073f
0203 09:17:29.985781 (+801717us) raft_consensus.cc:1645] Marking committed up to 1
0203 09:17:29.985824 (+ 43us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:29.985894 (+ 70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0203 09:17:30.978779 (+992885us) raft_consensus.cc:1685] finished
0203 09:17:30.978801 (+ 22us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:30.979034 (+ 233us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":581,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":114591,"spinlock_wait_cycles":40270592,"thread_start_us":801531,"threads_started":1,"wal-append.queue_time_us":2057749}
I20260203 09:17:30.710278 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
W20260203 09:17:30.914852 29428 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s user 0.006s sys 0.009s
I20260203 09:17:30.943327 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43612 (request call id 1665) took 1291 ms. Trace:
W20260203 09:17:30.948107 28886 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.867s user 0.071s sys 0.099s
W20260203 09:17:31.026449 28886 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.946s user 0.071s sys 0.099s
I20260203 09:17:30.484663 30274 leader_election.cc:290] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:30.796568 28732 rpcz_store.cc:276] 0203 09:17:29.744222 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:30.249538 (+505316us) service_pool.cc:225] Handling call
0203 09:17:30.785990 (+536452us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 09:17:31.032006 28732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43626 (request call id 1304) took 1190 ms. Trace:
I20260203 09:17:31.032349 28732 rpcz_store.cc:276] 0203 09:17:29.841550 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:31.031210 (+1189660us) service_pool.cc:225] Handling call
0203 09:17:31.031524 (+ 314us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:31.031705 (+ 181us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:31.031730 (+ 25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:31.031770 (+ 40us) raft_consensus.cc:1645] Marking committed up to 4
0203 09:17:31.031797 (+ 27us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:31.031846 (+ 49us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:31.031955 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 09:17:30.949222 28851 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:30.793754 28880 raft_consensus.cc:2468] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:17:30.858918 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:30.951885 29426 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.721s user 0.023s sys 0.048s
W20260203 09:17:31.039256 29426 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s user 0.023s sys 0.048s
I20260203 09:17:30.967142 30223 raft_consensus.cc:3060] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:30.455564 30212 raft_consensus.cc:493] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:30.961179 28852 leader_election.cc:400] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Vote denied by peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967) with higher term. Message: Invalid argument: T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 2. Current term is 3.
I20260203 09:17:30.964090 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:30.796521 30290 raft_consensus.cc:515] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:30.918182 30219 leader_election.cc:290] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:30.941799 30297 raft_consensus.cc:2804] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:30.954577 30157 raft_consensus.cc:515] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:31.030504 28813 raft_consensus.cc:3060] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:31.054597 30212 raft_consensus.cc:515] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:30.952252 30256 raft_consensus.cc:3060] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:31.026330 28730 rpcz_store.cc:276] 0203 09:17:29.651626 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:30.936505 (+1284879us) service_pool.cc:225] Handling call
0203 09:17:30.936891 (+ 386us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:30.943024 (+ 6133us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:30.943050 (+ 26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:30.943089 (+ 39us) raft_consensus.cc:1645] Marking committed up to 1
0203 09:17:30.943118 (+ 29us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:30.943173 (+ 55us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:30.943276 (+ 103us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 09:17:31.041081 30274 raft_consensus.cc:2749] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:31.060784 30297 raft_consensus.cc:493] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:31.061389 30297 raft_consensus.cc:3060] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:31.056708 30212 leader_election.cc:290] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:31.063411 30290 leader_election.cc:290] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:31.064023 30290 raft_consensus.cc:2804] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:31.069810 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.070711 28808 raft_consensus.cc:2468] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:31.071802 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:31.075815 28882 consensus_meta.cc:287] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc: Time spent flushing consensus metadata: real 0.692s user 0.007s sys 0.000s
I20260203 09:17:31.109549 28882 raft_consensus.cc:2468] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 3.
I20260203 09:17:31.110314 28882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59280 (request call id 194) took 1114 ms. Trace:
I20260203 09:17:31.110782 28882 rpcz_store.cc:276] 0203 09:17:29.996214 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:30.073460 (+ 77246us) service_pool.cc:225] Handling call
0203 09:17:31.110237 (+1036777us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 09:17:30.981352 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.028470 28777 leader_election.cc:400] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Vote denied by peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899) with higher term. Message: Invalid argument: T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 2. Current term is 3.
I20260203 09:17:31.035274 28732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43626 (request call id 1311) took 1077 ms. Trace:
I20260203 09:17:30.989943 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43626 (request call id 1303) took 1148 ms. Trace:
I20260203 09:17:30.954979 30147 raft_consensus.cc:493] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
W20260203 09:17:31.039920 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 877386us
I20260203 09:17:30.951534 28701 leader_election.cc:304] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
W20260203 09:17:31.026037 29428 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s user 0.006s sys 0.009s
W20260203 09:17:31.115609 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 164410us
I20260203 09:17:30.980396 30139 leader_election.cc:290] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:31.042289 28888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40958 (request call id 1208) took 1419 ms. Trace:
I20260203 09:17:31.043102 28852 leader_election.cc:403] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260203 09:17:30.979139 28735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45044 (request call id 128) took 1997 ms. Trace:
I20260203 09:17:30.947358 30300 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:30.983649 28734 rpcz_store.cc:276] 0203 09:17:29.840566 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:30.982447 (+1141881us) service_pool.cc:225] Handling call
0203 09:17:30.982748 (+ 301us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:30.982925 (+ 177us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:30.982953 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:30.982996 (+ 43us) raft_consensus.cc:1645] Marking committed up to 1
0203 09:17:30.983036 (+ 40us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:30.983092 (+ 56us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:30.983193 (+ 101us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 09:17:31.056392 30157 leader_election.cc:290] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:31.077966 30314 leader_election.cc:290] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Requested vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:31.064378 30290 raft_consensus.cc:493] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:31.054347 28889 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "298c016813da45bdbc537b5851b5e728"
dest_uuid: "77541303e1934638ba82f0f43f707adc"
mode: GRACEFUL
new_leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
from {username='slave'} at 127.0.0.1:57870
I20260203 09:17:31.126004 28889 raft_consensus.cc:606] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Received request to transfer leadership to TS 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:30.919744 28733 rpcz_store.cc:269] 0203 09:17:29.627405 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:29.631294 (+ 3889us) service_pool.cc:225] Handling call
0203 09:17:29.874021 (+242727us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b5800261098. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd0b478b1 00007f2cd0cc9db1 00007f2cd0cc9c62 00007f2cd9b74dd9 00007f2cd8cf4260 00007f2cd8dbcdbb 00007f2cd8dbce41 00007f2cd8d6abd0 00007f2cd8d6a4b4 00007f2cd22fa834 00007f2cd22fa7c2
0203 09:17:30.787862 (+913841us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":51805568}
W20260203 09:17:31.127565 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 178423us
I20260203 09:17:31.118220 28888 rpcz_store.cc:276] 0203 09:17:29.623107 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:29.623263 (+ 156us) service_pool.cc:225] Handling call
0203 09:17:29.623522 (+ 259us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:29.623696 (+ 174us) raft_consensus.cc:1534] Early marking committed up to index 5
0203 09:17:30.915849 (+1292153us) log.cc:844] Serialized 14 byte log entry
0203 09:17:31.041975 (+126126us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:31.042024 (+ 49us) raft_consensus.cc:1645] Marking committed up to 5
0203 09:17:31.042065 (+ 41us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:31.042129 (+ 64us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:31.042236 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":1415353,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":46,"raft.queue_time_us":15288,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":1396419,"threads_started":2}
I20260203 09:17:31.128438 28851 leader_election.cc:304] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:30.996320 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
W20260203 09:17:31.087807 30250 consensus_meta.cc:287] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent flushing consensus metadata: real 1.139s user 0.010s sys 0.000s
I20260203 09:17:30.970842 28884 rpcz_store.cc:276] 0203 09:17:29.584311 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:29.586224 (+ 1913us) service_pool.cc:225] Handling call
0203 09:17:30.787896 (+1201672us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 09:17:30.946364 28881 rpcz_store.cc:276] 0203 09:17:28.057400 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:28.073118 (+ 15718us) service_pool.cc:225] Handling call
0203 09:17:28.337883 (+264765us) raft_consensus.cc:1471] Updating replica for 1 ops
0203 09:17:28.385307 (+ 47424us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:28.395195 (+ 9888us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0203 09:17:28.645894 (+250699us) log.cc:844] Serialized 26 byte log entry
0203 09:17:29.948677 (+1302783us) raft_consensus.cc:1645] Marking committed up to 4
0203 09:17:29.948727 (+ 50us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:29.948800 (+ 73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0203 09:17:30.359258 (+410458us) raft_consensus.cc:1685] finished
0203 09:17:30.365148 (+ 5890us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:30.431887 (+ 66739us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":1284219,"threads_started":1,"wal-append.queue_time_us":1354972}
I20260203 09:17:31.100369 30133 leader_election.cc:290] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:31.104399 29463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53340 (request call id 213) took 2187 ms (client timeout 1944 ms). Trace:
I20260203 09:17:31.107136 28886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40946 (request call id 1128) took 1147 ms. Trace:
I20260203 09:17:31.079355 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:30.953624 30278 leader_election.cc:290] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:31.113242 28777 leader_election.cc:403] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260203 09:17:31.113322 28732 rpcz_store.cc:276] 0203 09:17:29.958087 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:31.033249 (+1075162us) service_pool.cc:225] Handling call
0203 09:17:31.033631 (+ 382us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:31.033814 (+ 183us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:31.033839 (+ 25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:31.033880 (+ 41us) raft_consensus.cc:1645] Marking committed up to 1
0203 09:17:31.033907 (+ 27us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:31.033959 (+ 52us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:31.035223 (+ 1264us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 09:17:31.116712 28701 leader_election.cc:304] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
W20260203 09:17:31.137147 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 114597us
I20260203 09:17:31.113484 28729 rpcz_store.cc:276] 0203 09:17:29.841309 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:30.988573 (+1147264us) service_pool.cc:225] Handling call
0203 09:17:30.989415 (+ 842us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:30.989618 (+ 203us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:30.989644 (+ 26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:30.989690 (+ 46us) raft_consensus.cc:1645] Marking committed up to 1
0203 09:17:30.989720 (+ 30us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:30.989774 (+ 54us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:30.989884 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 09:17:31.138113 29426 leader_election.cc:304] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
W20260203 09:17:31.120163 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 165627us
I20260203 09:17:31.113920 28809 raft_consensus.cc:2393] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:31.054093 30340 raft_consensus.cc:3060] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 3
I20260203 09:17:31.146416 30256 raft_consensus.cc:515] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:31.143312 30314 raft_consensus.cc:2804] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:31.148926 30256 leader_election.cc:290] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:31.122757 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 883344us
I20260203 09:17:31.149066 30314 raft_consensus.cc:493] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:31.149350 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.129390 28807 raft_consensus.cc:3060] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:31.128141 30290 raft_consensus.cc:3060] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:17:31.129978 29463 rpcz_store.cc:269] 0203 09:17:28.916469 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:28.916680 (+ 211us) service_pool.cc:225] Handling call
0203 09:17:31.104049 (+2187369us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54003354d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:31.104255 (+ 206us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3259124992}
I20260203 09:17:31.117651 30341 raft_consensus.cc:2804] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:31.139259 28852 leader_election.cc:304] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:31.124745 30308 raft_consensus.cc:2749] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967) with higher term. Message: Invalid argument: T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 2. Current term is 3.
I20260203 09:17:31.143854 28701 leader_election.cc:304] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
W20260203 09:17:31.144613 28851 connection.cc:232] RPC call timeout handler was delayed by -1.0489456450000034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
I20260203 09:17:31.039402 30305 consensus_queue.cc:237] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:31.130239 28886 rpcz_store.cc:276] 0203 09:17:29.959753 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:29.983301 (+ 23548us) service_pool.cc:225] Handling call
0203 09:17:29.983597 (+ 296us) raft_consensus.cc:1471] Updating replica for 1 ops
0203 09:17:29.996508 (+ 12911us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:29.996539 (+ 31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0203 09:17:30.010231 (+ 13692us) log.cc:844] Serialized 26 byte log entry
0203 09:17:31.026813 (+1016582us) raft_consensus.cc:1645] Marking committed up to 1
0203 09:17:31.026860 (+ 47us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:31.026927 (+ 67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0203 09:17:31.106893 (+ 79966us) raft_consensus.cc:1685] finished
0203 09:17:31.106917 (+ 24us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:31.107072 (+ 155us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12521,"raft.queue_time_us":15970,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":49443,"thread_start_us":945895,"threads_started":1,"wal-append.queue_time_us":1046502}
I20260203 09:17:31.140475 30157 raft_consensus.cc:2749] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:31.163233 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.119464 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.158231 30275 raft_consensus.cc:515] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:31.162379 28807 raft_consensus.cc:2468] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:31.166519 28701 leader_election.cc:304] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:31.148805 28732 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e"
dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
from {username='slave'} at 127.0.0.1:43626
I20260203 09:17:31.165421 28852 leader_election.cc:304] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:31.122466 30147 raft_consensus.cc:515] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:31.196027 28810 raft_consensus.cc:2468] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:17:31.135357 30250 raft_consensus.cc:515] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:31.194439 30213 consensus_meta.cc:287] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent flushing consensus metadata: real 0.999s user 0.007s sys 0.003s
W20260203 09:17:31.196568 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 51950.3us
I20260203 09:17:31.144147 30133 raft_consensus.cc:3060] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 3
I20260203 09:17:31.196904 28732 raft_consensus.cc:493] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:31.148543 30309 raft_consensus.cc:2804] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:31.160945 30314 raft_consensus.cc:3060] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:31.197041 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:31.171625 30277 consensus_meta.cc:287] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent flushing consensus metadata: real 1.113s user 0.010s sys 0.000s
I20260203 09:17:31.225978 28807 raft_consensus.cc:2393] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:31.199007 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:31.202085 28731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43612 (request call id 1652) took 1572 ms. Trace:
I20260203 09:17:31.227388 28731 rpcz_store.cc:276] 0203 09:17:29.629475 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:30.369526 (+740051us) service_pool.cc:225] Handling call
0203 09:17:31.201387 (+831861us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b5800261098. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd0b478b1 00007f2cd0cc9db1 00007f2cd0cc9c62 00007f2cd9b74dd9 00007f2cd8cf4260 00007f2cd8dbcdbb 00007f2cd8dbce41 00007f2cd8d7eaf0 00007f2cd8d69459 00007f2cd8d68f02 00007f2cd22f5d34
0203 09:17:31.201594 (+ 207us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:31.201776 (+ 182us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:31.201801 (+ 25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:31.201842 (+ 41us) raft_consensus.cc:1645] Marking committed up to 1
0203 09:17:31.201870 (+ 28us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:31.201924 (+ 54us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:31.202032 (+ 108us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":11009408}
I20260203 09:17:31.171661 30342 raft_consensus.cc:2804] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:31.198846 28852 leader_election.cc:304] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:31.229341 28852 leader_election.cc:304] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:31.206957 28732 raft_consensus.cc:3060] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:31.210490 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:31.222445 28734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45044 (request call id 130) took 1239 ms. Trace:
I20260203 09:17:31.223003 30293 leader_election.cc:290] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:31.223328 30183 raft_consensus.cc:515] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:31.230563 28888 raft_consensus.cc:1275] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260203 09:17:31.194741 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.165035 30341 raft_consensus.cc:493] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:31.204316 30308 raft_consensus.cc:2804] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:31.234306 28737 raft_consensus.cc:1240] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:31.235251 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:31.247466 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:31.248067 28888 raft_consensus.cc:3060] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:31.248570 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.249873 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.251031 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.251493 30235 raft_consensus.cc:515] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:31.251634 30297 raft_consensus.cc:515] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:31.253001 29457 raft_consensus.cc:1240] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:31.195436 30318 leader_election.cc:290] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:31.258018 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 94237us
I20260203 09:17:31.169900 30344 raft_consensus.cc:2804] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:31.235693 30339 raft_consensus.cc:493] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:31.246428 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:31.241590 29426 leader_election.cc:304] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:31.239018 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.253778 28732 raft_consensus.cc:515] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:31.234102 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:31.224298 30292 raft_consensus.cc:493] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:31.245708 30343 log.cc:927] Time spent T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.076s user 0.001s sys 0.000s
I20260203 09:17:31.273758 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
W20260203 09:17:31.272691 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 106216us
I20260203 09:17:31.274802 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:31.236616 30274 raft_consensus.cc:2804] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:31.231921 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.252106 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.238547 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:31.270548 29426 leader_election.cc:304] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:31.271180 28883 raft_consensus.cc:2368] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3.
I20260203 09:17:31.271436 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.206202 30213 raft_consensus.cc:515] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:31.246512 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:31.234634 30342 raft_consensus.cc:493] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:31.235862 30309 raft_consensus.cc:697] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 3 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:31.290212 30183 leader_election.cc:290] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:31.290082 30309 consensus_queue.cc:237] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:31.232858 28734 rpcz_store.cc:276] 0203 09:17:29.982761 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:31.125146 (+1142385us) service_pool.cc:225] Handling call
0203 09:17:31.159057 (+ 33911us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:31.171816 (+ 12759us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:31.196265 (+ 24449us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:31.203919 (+ 7654us) raft_consensus.cc:1645] Marking committed up to 5
0203 09:17:31.206403 (+ 2484us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:31.222206 (+ 15803us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:31.222369 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 09:17:31.247282 30308 raft_consensus.cc:493] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:31.298125 30308 raft_consensus.cc:3060] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
W20260203 09:17:31.298564 30304 consensus_meta.cc:287] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc: Time spent flushing consensus metadata: real 0.505s user 0.009s sys 0.000s
I20260203 09:17:31.246572 30341 raft_consensus.cc:3060] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:31.234395 30277 raft_consensus.cc:515] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:31.276163 28732 leader_election.cc:290] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:31.276216 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:31.276618 30339 raft_consensus.cc:515] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:31.278512 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:31.118562 28735 rpcz_store.cc:276] 0203 09:17:28.981685 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:29.027957 (+ 46272us) service_pool.cc:225] Handling call
0203 09:17:29.037068 (+ 9111us) raft_consensus.cc:1471] Updating replica for 1 ops
0203 09:17:29.037434 (+ 366us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:29.037465 (+ 31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0203 09:17:29.039884 (+ 2419us) log.cc:844] Serialized 26 byte log entry
0203 09:17:30.796278 (+1756394us) raft_consensus.cc:1645] Marking committed up to 4
0203 09:17:30.815182 (+ 18904us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:30.911198 (+ 96016us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0203 09:17:30.978878 (+ 67680us) raft_consensus.cc:1685] finished
0203 09:17:30.978911 (+ 33us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:30.979069 (+ 158us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":411,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":31679,"thread_start_us":1749885,"threads_started":1,"wal-append.queue_time_us":1192365}
I20260203 09:17:31.284972 28812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:36384 (request call id 781) took 2353 ms. Trace:
I20260203 09:17:31.285158 29457 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:31.285887 28804 raft_consensus.cc:2393] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 4: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:31.287819 28738 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43612 (request call id 1659) took 1656 ms. Trace:
I20260203 09:17:31.272534 30278 raft_consensus.cc:2749] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:31.293202 30342 raft_consensus.cc:3060] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:31.293969 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:31.323405 30327 consensus_queue.cc:1048] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260203 09:17:31.332548 30147 leader_election.cc:290] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:31.333741 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:31.335919 28737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43626 (request call id 1299) took 1495 ms. Trace:
I20260203 09:17:31.337107 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:31.341599 30297 leader_election.cc:290] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:31.264636 30344 raft_consensus.cc:493] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:31.292570 28734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:31.296852 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.257730 30266 raft_consensus.cc:515] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:31.336300 28737 rpcz_store.cc:276] 0203 09:17:29.840298 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:30.961675 (+1121377us) service_pool.cc:225] Handling call
0203 09:17:30.984059 (+ 22384us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:31.254042 (+269983us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:31.335692 (+ 81650us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b54002fc6d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db5a81 00007f2cd3db44be 00007f2cd8d68f49 00007f2cd22f5d34 00007f2cd22f5cc2 00007f2cd22f5bf1 00007f2cd22f5b6c 00007f2cd22f4e22 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:31.335861 (+ 169us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":575108992}
I20260203 09:17:31.297616 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.260279 28733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45044 (request call id 131) took 1276 ms. Trace:
I20260203 09:17:31.299873 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:31.303097 28888 raft_consensus.cc:2468] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 3.
I20260203 09:17:31.309129 28812 rpcz_store.cc:276] 0203 09:17:28.931697 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:28.932504 (+ 807us) service_pool.cc:225] Handling call
0203 09:17:31.284287 (+2351783us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b54001ccfd4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1f0c0 00007f2cd3dbdbba 00007f2cd8d6e58e 00007f2cd230d437 00007f2cd230d3c2 00007f2cd230d2f1 00007f2cd230d26c 00007f2cd230c522 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:31.284879 (+ 592us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4261926272}
I20260203 09:17:31.266557 28813 raft_consensus.cc:2468] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:31.356408 28731 raft_consensus.cc:2393] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a in current term 2: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:31.354385 29426 leader_election.cc:304] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:31.323336 30275 leader_election.cc:290] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:31.312369 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.320679 28738 rpcz_store.cc:276] 0203 09:17:29.631464 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:30.390330 (+758866us) service_pool.cc:225] Handling call
0203 09:17:31.287193 (+896863us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b5800261098. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd0b478b1 00007f2cd0cc9db1 00007f2cd0cc9c62 00007f2cd9b74dd9 00007f2cd8cf4260 00007f2cd8dbcdbb 00007f2cd8dbce41 00007f2cd8d7eaf0 00007f2cd8d69459 00007f2cd8d68f02 00007f2cd22f5d34
0203 09:17:31.287363 (+ 170us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:31.287519 (+ 156us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:31.287543 (+ 24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:31.287591 (+ 48us) raft_consensus.cc:1645] Marking committed up to 1
0203 09:17:31.287621 (+ 30us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:31.287671 (+ 50us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:31.287762 (+ 91us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":923131264}
I20260203 09:17:31.279284 30274 raft_consensus.cc:493] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:31.320665 28732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:43626 (request call id 1318) took 1251 ms. Trace:
W20260203 09:17:31.294891 29464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53340 (request call id 218) took 1328 ms (client timeout 1652 ms). Trace:
I20260203 09:17:31.279601 30293 raft_consensus.cc:2749] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:31.284999 30322 raft_consensus.cc:2804] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:31.295925 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:31.350332 28805 raft_consensus.cc:2468] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:31.354104 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:31.278823 30292 raft_consensus.cc:515] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:31.309653 28807 raft_consensus.cc:2368] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3.
I20260203 09:17:31.307113 30304 raft_consensus.cc:515] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:31.279795 30157 consensus_queue.cc:1059] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260203 09:17:31.327857 30300 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:31.505523 28889 raft_consensus.cc:2393] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a in current term 3: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:31.507349 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:31.383509 28810 raft_consensus.cc:2468] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:17:31.514811 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:31.506328 28732 rpcz_store.cc:276] 0203 09:17:30.063746 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:31.137014 (+1073268us) service_pool.cc:225] Handling call
0203 09:17:31.308120 (+171106us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 09:17:31.516180 28737 raft_consensus.cc:2393] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a in current term 3: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
W20260203 09:17:31.510495 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 235212us
I20260203 09:17:31.517010 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.348989 30344 raft_consensus.cc:3060] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
W20260203 09:17:31.446259 30353 log.cc:927] Time spent T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
I20260203 09:17:31.514750 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.548358 28887 raft_consensus.cc:2393] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 2: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:31.548302 28812 raft_consensus.cc:2468] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 3.
I20260203 09:17:31.514683 30278 raft_consensus.cc:493] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:31.549484 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.550555 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.549872 30278 raft_consensus.cc:515] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:31.551102 28812 raft_consensus.cc:2468] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:31.551990 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
W20260203 09:17:31.504128 29464 rpcz_store.cc:269] 0203 09:17:29.966541 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:29.966677 (+ 136us) service_pool.cc:225] Handling call
0203 09:17:31.294701 (+1328024us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b540063b854. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:31.294823 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2096395008}
I20260203 09:17:31.527199 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:31.553264 28805 raft_consensus.cc:2393] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:31.553985 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.554293 30278 leader_election.cc:290] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
W20260203 09:17:31.446911 30320 log.cc:927] Time spent T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.065s user 0.000s sys 0.000s
I20260203 09:17:31.358742 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b2c469d7255413d9f61a7cbaa4481a7" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.535135 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.520939 29426 leader_election.cc:304] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:31.436636 28735 raft_consensus.cc:1240] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Rejecting Update request from peer cf00f643e7da4a98a0a11ea92869c24a for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:31.547317 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b2c469d7255413d9f61a7cbaa4481a7" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.573843 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:17:31.573774 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 344511us
I20260203 09:17:31.454550 29458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fabfb779b8894cf0b22204fe12768dc3" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:31.509963 30322 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:31.580334 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.580881 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:31.581027 28806 raft_consensus.cc:2468] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:31.575232 28852 leader_election.cc:400] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Vote denied by peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967) with higher term. Message: Invalid argument: T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 2. Current term is 3.
I20260203 09:17:31.581506 28852 leader_election.cc:403] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260203 09:17:31.581573 29464 raft_consensus.cc:2393] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 2: Already voted for candidate cf00f643e7da4a98a0a11ea92869c24a in this term.
I20260203 09:17:31.581935 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:31.424018 30339 leader_election.cc:290] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:31.359508 28734 raft_consensus.cc:2468] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 3.
I20260203 09:17:31.461392 30277 leader_election.cc:290] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Requested vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:31.459393 30235 leader_election.cc:290] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:31.458362 30213 leader_election.cc:290] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:31.571659 29465 raft_consensus.cc:3060] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:31.380837 30254 raft_consensus.cc:2804] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:31.554934 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.574465 28732 raft_consensus.cc:2468] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 1.
I20260203 09:17:31.596268 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.430461 30266 leader_election.cc:290] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:31.597397 28805 raft_consensus.cc:2468] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:31.508934 30274 raft_consensus.cc:3060] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:31.422442 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.514264 30250 leader_election.cc:290] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:31.417537 30291 consensus_meta.cc:287] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent flushing consensus metadata: real 1.196s user 0.009s sys 0.005s
I20260203 09:17:31.535365 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.590159 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:31.428339 30243 raft_consensus.cc:515] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:31.450124 30290 raft_consensus.cc:515] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:31.352075 28733 rpcz_store.cc:276] 0203 09:17:29.983695 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:31.137454 (+1153759us) service_pool.cc:225] Handling call
0203 09:17:31.171759 (+ 34305us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:31.206553 (+ 34794us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:31.224682 (+ 18129us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:31.227853 (+ 3171us) raft_consensus.cc:1645] Marking committed up to 5
0203 09:17:31.236205 (+ 8352us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:31.243430 (+ 7225us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:31.258834 (+ 15404us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 09:17:31.589746 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.586822 30322 raft_consensus.cc:3060] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:31.646389 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:31.648072 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.654946 28805 raft_consensus.cc:3060] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:17:31.656240 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 426253us
I20260203 09:17:31.589563 30183 raft_consensus.cc:2749] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967) with higher term. Message: Invalid argument: T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 2. Current term is 3.
I20260203 09:17:31.588160 30278 raft_consensus.cc:2749] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260203 09:17:31.653259 30223 consensus_meta.cc:287] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent flushing consensus metadata: real 0.542s user 0.010s sys 0.000s
W20260203 09:17:31.648181 30340 consensus_meta.cc:287] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent flushing consensus metadata: real 0.502s user 0.006s sys 0.004s
I20260203 09:17:31.625995 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:31.643173 30133 raft_consensus.cc:2749] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899) with higher term. Message: Invalid argument: T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 2. Current term is 3.
I20260203 09:17:31.664871 30292 leader_election.cc:290] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:31.633939 30254 raft_consensus.cc:697] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [term 3 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:31.620035 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:31.602010 30147 consensus_queue.cc:1048] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260203 09:17:31.678747 30275 raft_consensus.cc:993] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc: : Instructing follower 847a7af9f0e2497cbb9025cc2c62557e to start an election
I20260203 09:17:31.680986 30275 raft_consensus.cc:1081] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Signalling peer 847a7af9f0e2497cbb9025cc2c62557e to start an election
I20260203 09:17:31.679188 29458 raft_consensus.cc:1240] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Rejecting Update request from peer 77541303e1934638ba82f0f43f707adc for earlier term 1. Current term is 2. Ops: []
W20260203 09:17:31.685092 28887 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40946 (request call id 1132) took 1628 ms (client timeout 2007 ms). Trace:
W20260203 09:17:31.685482 28887 rpcz_store.cc:269] 0203 09:17:30.058174 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:30.058815 (+ 641us) service_pool.cc:225] Handling call
0203 09:17:31.684897 (+1626082us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540022ddd4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:31.685032 (+ 135us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3073070848}
I20260203 09:17:31.686105 30254 consensus_queue.cc:237] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:31.686836 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:31.687428 29459 raft_consensus.cc:3060] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:31.687338 30342 raft_consensus.cc:515] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:31.654428 30314 raft_consensus.cc:515] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:31.689960 29465 raft_consensus.cc:2468] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:31.673960 30340 raft_consensus.cc:2749] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627) with higher term. Message: Invalid argument: T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3.
I20260203 09:17:31.671978 30223 raft_consensus.cc:515] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:31.693302 30223 leader_election.cc:290] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:31.693527 30243 leader_election.cc:290] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:31.656031 30291 raft_consensus.cc:515] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:31.676175 30304 leader_election.cc:290] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:31.704366 30297 raft_consensus.cc:3055] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:31.704876 30297 raft_consensus.cc:740] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:31.704741 30314 leader_election.cc:290] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:31.516844 28701 leader_election.cc:304] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
W20260203 09:17:31.734272 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 153930us
I20260203 09:17:31.742283 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43626 (request call id 1319) took 1674 ms. Trace:
I20260203 09:17:31.742944 28729 rpcz_store.cc:276] 0203 09:17:30.067787 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:31.138189 (+1070402us) service_pool.cc:225] Handling call
0203 09:17:31.202071 (+ 63882us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b5800261098. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd0b478b1 00007f2cd0cc9db1 00007f2cd0cc9c62 00007f2cd9b74dd9 00007f2cd8cf4260 00007f2cd8dbcdbb 00007f2cd8dbce41 00007f2cd8d7eaf0 00007f2cd8d69459 00007f2cd8d68f02 00007f2cd22f5d34
0203 09:17:31.202325 (+ 254us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:31.202557 (+ 232us) raft_consensus.cc:1534] Early marking committed up to index 3
0203 09:17:31.575623 (+373066us) log.cc:844] Serialized 14 byte log entry
0203 09:17:31.741263 (+165640us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:31.741399 (+ 136us) raft_consensus.cc:1645] Marking committed up to 3
0203 09:17:31.741536 (+ 137us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:31.741712 (+ 176us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:31.742024 (+ 312us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":45903,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"spinlock_wait_cycles":3558784,"thread_start_us":537616,"threads_started":2,"wal-append.queue_time_us":114427}
I20260203 09:17:31.746163 28730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43626 (request call id 1314) took 1765 ms. Trace:
I20260203 09:17:31.751041 28700 leader_election.cc:304] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:31.758633 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:31.760247 28736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43626 (request call id 1316) took 1758 ms. Trace:
I20260203 09:17:31.760618 28736 rpcz_store.cc:276] 0203 09:17:30.001617 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:30.319333 (+317716us) service_pool.cc:225] Handling call
0203 09:17:31.758298 (+1438965us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b5800261098. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd0b478b1 00007f2cd0cc9db1 00007f2cd0cca12e 000000000035a3c9 00007f2cd8cf4560 00007f2cd8dbcdd4 00007f2cd8dbce41 00007f2cd8d6abd0 00007f2cd8d6a4b4 00007f2cd22fa834 00007f2cd22fa7c2
0203 09:17:31.760141 (+ 1843us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":923603328}
I20260203 09:17:31.776947 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.778844 28804 raft_consensus.cc:2468] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 1.
I20260203 09:17:31.622650 28809 raft_consensus.cc:2468] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:31.809381 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.810745 28810 raft_consensus.cc:2393] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:31.810469 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.817703 28811 raft_consensus.cc:2393] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 4: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:31.818241 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:31.670464 28851 leader_election.cc:304] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:31.837503 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.839107 28811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36404 (request call id 1127) took 1030 ms. Trace:
I20260203 09:17:31.840270 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:31.839592 28811 rpcz_store.cc:276] 0203 09:17:30.809211 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:30.944254 (+135043us) service_pool.cc:225] Handling call
0203 09:17:31.838838 (+894584us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b540013c4d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:31.839033 (+ 195us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1779491072}
W20260203 09:17:31.866093 28883 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40946 (request call id 1131) took 1864 ms (client timeout 2021 ms). Trace:
W20260203 09:17:31.866662 28883 rpcz_store.cc:269] 0203 09:17:30.014208 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:30.059608 (+ 45400us) service_pool.cc:225] Handling call
0203 09:17:31.865621 (+1806013us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540017b6d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:31.865891 (+ 270us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2408779520}
I20260203 09:17:31.868419 30183 raft_consensus.cc:2749] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:31.871335 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:31.872550 28881 raft_consensus.cc:2468] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 1.
I20260203 09:17:31.874112 30219 raft_consensus.cc:2749] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:31.885986 30341 raft_consensus.cc:515] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:31.705694 30297 consensus_queue.cc:260] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:31.705960 30291 leader_election.cc:290] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:31.889040 28731 raft_consensus.cc:1240] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Rejecting Update request from peer cf00f643e7da4a98a0a11ea92869c24a for earlier term 3. Current term is 4. Ops: []
W20260203 09:17:31.889479 30308 consensus_meta.cc:287] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc: Time spent flushing consensus metadata: real 0.591s user 0.012s sys 0.000s
I20260203 09:17:31.890313 30308 raft_consensus.cc:515] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:31.781793 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.746608 28730 rpcz_store.cc:276] 0203 09:17:29.980788 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:31.080152 (+1099364us) service_pool.cc:225] Handling call
0203 09:17:31.080514 (+ 362us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:31.080750 (+ 236us) raft_consensus.cc:1534] Early marking committed up to index 2
0203 09:17:31.165615 (+ 84865us) log.cc:844] Serialized 14 byte log entry
0203 09:17:31.745446 (+579831us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:31.745559 (+ 113us) raft_consensus.cc:1645] Marking committed up to 2
0203 09:17:31.745671 (+ 112us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:31.745777 (+ 106us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:31.745986 (+ 209us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":154870,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":76389,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":630103,"threads_started":3,"wal-append.queue_time_us":111705}
I20260203 09:17:31.892903 30341 leader_election.cc:290] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 election: Requested vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:31.904152 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.905246 30344 raft_consensus.cc:515] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:31.708141 30342 leader_election.cc:290] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:31.907091 30316 raft_consensus.cc:2804] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:31.909444 30316 raft_consensus.cc:493] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:31.910003 30316 raft_consensus.cc:3060] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:31.911185 30344 leader_election.cc:290] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:31.913719 30290 leader_election.cc:290] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:31.915894 30297 raft_consensus.cc:3060] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:17:31.917999 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 167238us
I20260203 09:17:31.919845 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:31.921104 28731 raft_consensus.cc:2393] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a in current term 3: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:31.921664 28733 raft_consensus.cc:1240] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Rejecting Update request from peer cf00f643e7da4a98a0a11ea92869c24a for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:31.919006 29459 raft_consensus.cc:2468] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:31.928952 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.929652 30290 raft_consensus.cc:2804] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:31.930143 30290 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:31.930262 30340 raft_consensus.cc:1064] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:31.930574 30290 raft_consensus.cc:3060] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:31.934713 28700 leader_election.cc:304] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:31.935947 30314 raft_consensus.cc:2749] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:31.934553 30340 consensus_queue.cc:237] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:31.924750 30342 consensus_queue.cc:1059] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260203 09:17:31.900297 30308 leader_election.cc:290] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:31.940059 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.944555 29426 leader_election.cc:304] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:31.951845 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:31.944854 30314 raft_consensus.cc:3055] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:31.954191 30314 raft_consensus.cc:740] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:31.957787 30225 raft_consensus.cc:2804] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:31.958388 30225 raft_consensus.cc:493] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:31.958797 30225 raft_consensus.cc:3060] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:31.959512 29426 leader_election.cc:304] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:31.960945 30338 raft_consensus.cc:2804] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:31.961342 30338 raft_consensus.cc:493] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:31.961719 30338 raft_consensus.cc:3060] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Advancing to term 2
W20260203 09:17:31.967526 28702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260203 09:17:31.957302 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 223607us
I20260203 09:17:31.969023 28700 leader_election.cc:304] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:31.970302 30342 raft_consensus.cc:2804] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:31.970927 30342 raft_consensus.cc:697] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:31.957129 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:31.972872 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:31.973752 28731 raft_consensus.cc:2393] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:31.972054 30342 consensus_queue.cc:237] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:31.969980 30338 raft_consensus.cc:515] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:31.980777 30338 leader_election.cc:290] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:31.981021 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:31.983258 28731 raft_consensus.cc:2393] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 2: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
W20260203 09:17:31.984710 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 422534us
I20260203 09:17:31.986896 28701 leader_election.cc:304] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:31.988459 30282 raft_consensus.cc:2804] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:31.988952 30282 raft_consensus.cc:493] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:31.989351 30282 raft_consensus.cc:3060] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:31.955765 30314 consensus_queue.cc:260] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:31.993016 30314 raft_consensus.cc:3060] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:32.001704 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:31.997644 28701 leader_election.cc:304] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:32.002691 28804 raft_consensus.cc:2368] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 2. Current term is 3.
I20260203 09:17:32.005445 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.006274 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:32.006956 28812 raft_consensus.cc:1240] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Rejecting Update request from peer 77541303e1934638ba82f0f43f707adc for earlier term 3. Current term is 4. Ops: []
I20260203 09:17:32.006842 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.013154 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:32.017211 28730 raft_consensus.cc:2393] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 2: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:32.018172 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:32.019840 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47301e2bbfc94767a9905b0e12141d6d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:32.021523 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:32.023281 29426 leader_election.cc:304] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
W20260203 09:17:32.024227 29425 leader_election.cc:336] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Timed out: RequestConsensusVote RPC to 127.26.232.66:41611 timed out after 1.580s (SENT)
I20260203 09:17:32.027177 29425 leader_election.cc:304] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:32.033362 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.002588 30282 raft_consensus.cc:515] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:32.033871 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:32.034178 30167 raft_consensus.cc:2749] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:32.034538 28729 raft_consensus.cc:3060] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:32.034664 30338 raft_consensus.cc:2804] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:32.035084 30338 raft_consensus.cc:493] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:32.035444 30338 raft_consensus.cc:3060] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:32.036048 30341 raft_consensus.cc:2804] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:32.036242 30167 consensus_queue.cc:1059] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260203 09:17:32.036849 30341 raft_consensus.cc:697] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:32.037546 30347 raft_consensus.cc:3055] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:32.037938 30347 raft_consensus.cc:740] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:32.035565 30282 leader_election.cc:290] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:32.044330 30347 consensus_queue.cc:260] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.046087 30347 raft_consensus.cc:3060] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:32.047578 30292 consensus_queue.cc:1059] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260203 09:17:32.048749 30255 consensus_queue.cc:1059] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260203 09:17:32.050057 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b2c469d7255413d9f61a7cbaa4481a7" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:32.050179 30338 raft_consensus.cc:515] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.050328 30361 raft_consensus.cc:3055] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:32.050848 28733 raft_consensus.cc:3060] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:32.051117 30361 raft_consensus.cc:740] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:32.052120 30361 consensus_queue.cc:260] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.054466 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.055292 28812 raft_consensus.cc:2393] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:32.056876 30338 leader_election.cc:290] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:32.058282 30344 consensus_queue.cc:1059] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260203 09:17:32.058710 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.059685 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.059971 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.060000 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.060456 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.060869 30358 raft_consensus.cc:3055] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:32.061342 30358 raft_consensus.cc:740] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:32.062093 30361 raft_consensus.cc:3060] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:32.062707 28701 leader_election.cc:400] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Vote denied by peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899) with higher term. Message: Invalid argument: T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3.
I20260203 09:17:32.070137 28729 raft_consensus.cc:2468] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:32.040925 30308 raft_consensus.cc:493] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:32.069156 28701 leader_election.cc:403] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260203 09:17:32.073343 28700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:32.075724 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.075594 30308 raft_consensus.cc:515] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:32.076686 28809 raft_consensus.cc:2393] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:32.062572 30358 consensus_queue.cc:260] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.081095 30225 raft_consensus.cc:515] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.029090 30316 raft_consensus.cc:515] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:32.089251 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:32.092213 28889 raft_consensus.cc:1275] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260203 09:17:32.092321 30223 raft_consensus.cc:2749] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899) with higher term. Message: Invalid argument: T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3.
I20260203 09:17:32.093477 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.037941 30341 consensus_queue.cc:237] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:32.097977 28729 raft_consensus.cc:3060] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:32.107182 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b2c469d7255413d9f61a7cbaa4481a7" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.108906 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:32.110641 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.111096 28731 raft_consensus.cc:3060] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:32.114418 28700 leader_election.cc:304] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:32.115039 30308 leader_election.cc:290] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:32.110040 30316 leader_election.cc:290] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:32.126459 29425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:32.124547 28806 raft_consensus.cc:2468] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:32.130344 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.124589 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.129907 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:32.137843 28883 raft_consensus.cc:1240] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:32.139685 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.140353 28810 raft_consensus.cc:3055] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:32.140777 28810 raft_consensus.cc:740] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:32.140916 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.142006 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.141808 28810 consensus_queue.cc:260] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.143458 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.143491 28810 raft_consensus.cc:3060] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:32.144263 28733 raft_consensus.cc:2468] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:32.144469 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.145542 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:32.133697 30250 raft_consensus.cc:2804] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:32.117805 30274 raft_consensus.cc:515] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:32.150691 28812 raft_consensus.cc:2368] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 3. Current term is 4.
I20260203 09:17:32.145622 28776 leader_election.cc:304] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:32.138674 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.165474 28729 raft_consensus.cc:2468] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:32.166703 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:32.157264 30250 raft_consensus.cc:697] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:32.158421 30358 raft_consensus.cc:3060] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:32.172096 30250 consensus_queue.cc:237] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.170938 30274 leader_election.cc:290] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:32.169159 28805 raft_consensus.cc:2468] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:32.167797 28884 raft_consensus.cc:1240] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:32.180073 30133 raft_consensus.cc:2764] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260203 09:17:32.180137 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:32.182163 29465 raft_consensus.cc:2393] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 2: Already voted for candidate cf00f643e7da4a98a0a11ea92869c24a in this term.
I20260203 09:17:32.184317 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:32.185343 28886 raft_consensus.cc:1240] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:32.186784 28631 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57772 (request call id 172) took 4860 ms. Trace:
I20260203 09:17:32.187269 28889 raft_consensus.cc:1240] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:32.187345 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:32.176023 30225 leader_election.cc:290] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:32.166975 28736 raft_consensus.cc:2468] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:32.186656 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:32.191363 28882 raft_consensus.cc:2468] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:32.192981 28809 raft_consensus.cc:2393] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:32.193154 29458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:32.194059 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
W20260203 09:17:32.194837 28703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:32.201169 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:32.180387 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:32.202764 29459 raft_consensus.cc:2393] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 2: Already voted for candidate cf00f643e7da4a98a0a11ea92869c24a in this term.
I20260203 09:17:32.196245 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:32.205084 28889 raft_consensus.cc:2468] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:32.192912 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "021e904a783c4cbc96e5aa625a34a2d8" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:32.197587 30255 consensus_queue.cc:1048] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260203 09:17:32.198740 28808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36404 (request call id 1131) took 1252 ms. Trace:
I20260203 09:17:32.207101 28883 raft_consensus.cc:1240] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:32.168810 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:32.191792 28633 catalog_manager.cc:5654] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:32.194006 29458 raft_consensus.cc:2393] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 4: Already voted for candidate cf00f643e7da4a98a0a11ea92869c24a in this term.
I20260203 09:17:32.213275 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:32.217160 29426 leader_election.cc:304] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:32.213212 28805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36404 (request call id 1138) took 1151 ms. Trace:
W20260203 09:17:32.209349 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 45676us
I20260203 09:17:32.217875 28805 rpcz_store.cc:276] 0203 09:17:31.029845 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:31.603017 (+573172us) service_pool.cc:225] Handling call
0203 09:17:32.178022 (+575005us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 09:17:32.219614 28700 leader_election.cc:304] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:32.220510 30282 raft_consensus.cc:3060] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:32.213755 28810 raft_consensus.cc:1275] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260203 09:17:32.223465 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:32.224031 28635 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56866 (request call id 289) took 7090 ms. Trace:
I20260203 09:17:32.224424 28635 rpcz_store.cc:276] 0203 09:17:25.133179 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:25.133347 (+ 168us) service_pool.cc:225] Handling call
0203 09:17:32.223848 (+7090501us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":64081,"reported_tablets":5}
I20260203 09:17:32.227521 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:32.228533 28731 raft_consensus.cc:2468] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 4.
I20260203 09:17:32.228914 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.229678 28810 raft_consensus.cc:2393] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:32.230599 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:32.207919 28808 rpcz_store.cc:276] 0203 09:17:30.949543 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:31.807708 (+858165us) service_pool.cc:225] Handling call
0203 09:17:31.808450 (+ 742us) raft_consensus.cc:1471] Updating replica for 1 ops
0203 09:17:31.938522 (+130072us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:31.939309 (+ 787us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0203 09:17:32.010291 (+ 70982us) log.cc:844] Serialized 26 byte log entry
0203 09:17:32.080355 (+ 70064us) raft_consensus.cc:1645] Marking committed up to 1
0203 09:17:32.080399 (+ 44us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:32.080475 (+ 76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0203 09:17:32.198299 (+117824us) raft_consensus.cc:1685] finished
0203 09:17:32.198325 (+ 26us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:32.198537 (+ 212us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4931,"raft.queue_time_us":34742,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":204,"spinlock_wait_cycles":176000,"thread_start_us":67289,"threads_started":1,"wal-append.queue_time_us":106040}
I20260203 09:17:32.223619 30255 raft_consensus.cc:2804] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:32.238797 29426 leader_election.cc:304] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:32.242569 29458 raft_consensus.cc:1275] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEARNER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260203 09:17:32.248881 30374 log.cc:927] Time spent T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.085s user 0.001s sys 0.000s
I20260203 09:17:32.249257 30255 raft_consensus.cc:697] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:32.250535 28806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36404 (request call id 1141) took 1130 ms. Trace:
I20260203 09:17:32.250483 30255 consensus_queue.cc:237] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.251034 28806 rpcz_store.cc:276] 0203 09:17:31.120930 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:31.589924 (+468994us) service_pool.cc:225] Handling call
0203 09:17:32.250327 (+660403us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54003656d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:32.250475 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":327190400}
I20260203 09:17:32.254741 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.258770 28776 leader_election.cc:304] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:32.259697 30133 raft_consensus.cc:2804] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:32.260154 30133 raft_consensus.cc:493] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:32.260530 30133 raft_consensus.cc:3060] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:32.258785 28736 raft_consensus.cc:1240] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Rejecting Update request from peer cf00f643e7da4a98a0a11ea92869c24a for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260203 09:17:32.246282 30347 raft_consensus.cc:2804] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:17:32.264591 30347 raft_consensus.cc:697] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:32.267679 28886 raft_consensus.cc:1275] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260203 09:17:32.267495 30347 consensus_queue.cc:237] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.271189 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47301e2bbfc94767a9905b0e12141d6d" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:32.273834 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47301e2bbfc94767a9905b0e12141d6d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.271044 30223 consensus_queue.cc:1048] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260203 09:17:32.270917 30338 consensus_queue.cc:1048] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260203 09:17:32.272951 30225 consensus_queue.cc:1059] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260203 09:17:32.287591 30254 raft_consensus.cc:3055] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:17:32.288076 30254 raft_consensus.cc:740] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:32.295655 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:32.306627 28881 raft_consensus.cc:2410] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260203 09:17:32.307174 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:32.312310 28776 leader_election.cc:304] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:32.313380 30291 raft_consensus.cc:2804] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:32.313822 30291 raft_consensus.cc:493] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:32.314244 30291 raft_consensus.cc:3060] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:32.257544 30290 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:32.319909 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:32.320914 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.323066 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.323901 28808 raft_consensus.cc:2393] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:32.323841 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.325088 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.325212 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.325111 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b2c469d7255413d9f61a7cbaa4481a7" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.325997 28804 raft_consensus.cc:2468] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 4.
I20260203 09:17:32.326437 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.327786 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.328166 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.328567 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.330513 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:32.326740 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:32.333226 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:32.334044 28887 raft_consensus.cc:2393] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 2: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:32.334887 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:32.336943 28889 raft_consensus.cc:2393] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 2: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:32.187155 28631 rpcz_store.cc:276] 0203 09:17:27.326349 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:27.387568 (+ 61219us) service_pool.cc:225] Handling call
0203 09:17:32.186546 (+4798978us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0203 09:17:31.122064 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0203 09:17:31.146056 (+ 23992us) write_op.cc:432] Acquiring schema lock in shared mode
0203 09:17:31.146097 (+ 41us) write_op.cc:435] Acquired schema lock
0203 09:17:31.146107 (+ 10us) tablet.cc:660] Decoding operations
0203 09:17:31.146419 (+ 312us) write_op.cc:620] Acquiring the partition lock for write op
0203 09:17:31.146481 (+ 62us) write_op.cc:641] Partition lock acquired for write op
0203 09:17:31.146516 (+ 35us) tablet.cc:683] Acquiring locks for 1 operations
0203 09:17:31.146718 (+ 202us) tablet.cc:699] Row locks acquired
0203 09:17:31.146731 (+ 13us) write_op.cc:260] PREPARE: finished
0203 09:17:31.146907 (+ 176us) write_op.cc:270] Start()
0203 09:17:31.147017 (+ 110us) write_op.cc:276] Timestamp: P: 1770110251146860 usec, L: 0
0203 09:17:31.147034 (+ 17us) op_driver.cc:348] REPLICATION: starting
0203 09:17:31.147671 (+ 637us) log.cc:844] Serialized 536 byte log entry
0203 09:17:31.707228 (+559557us) op_driver.cc:464] REPLICATION: finished
0203 09:17:32.098739 (+391511us) write_op.cc:301] APPLY: starting
0203 09:17:32.106216 (+ 7477us) tablet.cc:1365] starting BulkCheckPresence
0203 09:17:32.106361 (+ 145us) tablet.cc:1368] finished BulkCheckPresence
0203 09:17:32.106493 (+ 132us) tablet.cc:1370] starting ApplyRowOperation cycle
0203 09:17:32.106805 (+ 312us) tablet.cc:1381] finished ApplyRowOperation cycle
0203 09:17:32.107059 (+ 254us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0203 09:17:32.107113 (+ 54us) write_op.cc:312] APPLY: finished
0203 09:17:32.107453 (+ 340us) log.cc:844] Serialized 23 byte log entry
0203 09:17:32.107666 (+ 213us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:17:32.107813 (+ 147us) write_op.cc:454] Released schema lock
0203 09:17:32.107868 (+ 55us) write_op.cc:341] FINISH: Updating metrics
0203 09:17:32.108286 (+ 418us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:17:32.108329 (+ 43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":356824,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":360765,"apply.run_cpu_time_us":2400,"apply.run_wall_time_us":29855,"num_ops":1,"prepare.queue_time_us":1608702,"prepare.run_cpu_time_us":19159,"prepare.run_wall_time_us":95001,"raft.queue_time_us":432780,"raft.run_cpu_time_us":36234,"raft.run_wall_time_us":252435,"replication_time_us":559661,"thread_start_us":2008508,"threads_started":4,"wal-append.queue_time_us":52325}]]}
I20260203 09:17:32.331511 28880 raft_consensus.cc:2393] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 2: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:32.340381 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:32.345217 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:32.346199 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:32.352169 28736 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "298c016813da45bdbc537b5851b5e728"
dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
from {username='slave'} at 127.0.0.1:43612
I20260203 09:17:32.353093 28736 raft_consensus.cc:493] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:17:32.353536 28736 raft_consensus.cc:3060] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:32.360998 30290 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:32.361368 30341 raft_consensus.cc:493] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:32.361734 28729 raft_consensus.cc:3060] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:32.362349 30341 raft_consensus.cc:515] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.364607 30341 leader_election.cc:290] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:32.340425 30254 consensus_queue.cc:260] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.365914 29458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:32.366743 29458 raft_consensus.cc:2393] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 3: Already voted for candidate cf00f643e7da4a98a0a11ea92869c24a in this term.
I20260203 09:17:32.366943 30254 raft_consensus.cc:3060] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:32.369869 28730 raft_consensus.cc:1240] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:32.369972 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:32.372228 28733 raft_consensus.cc:1240] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 3. Current term is 4. Ops: []
I20260203 09:17:32.372457 28730 raft_consensus.cc:1240] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:32.374768 28730 raft_consensus.cc:1240] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 2. Current term is 3. Ops: []
W20260203 09:17:32.376434 30376 log.cc:927] Time spent T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.163s user 0.000s sys 0.001s
W20260203 09:17:32.377336 30322 consensus_meta.cc:287] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc: Time spent flushing consensus metadata: real 0.643s user 0.011s sys 0.004s
I20260203 09:17:32.377831 30322 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:32.379513 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:32.380256 28730 raft_consensus.cc:1240] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:32.380303 28733 raft_consensus.cc:2393] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 3: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:32.382402 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:32.382618 30322 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:32.387387 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:32.389376 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:32.393043 28701 leader_election.cc:304] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:32.394580 28701 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:32.395402 30341 raft_consensus.cc:2749] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:32.396104 30341 raft_consensus.cc:2749] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:32.396287 28701 leader_election.cc:304] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:32.397374 30341 raft_consensus.cc:2749] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:32.401767 28729 raft_consensus.cc:2468] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:32.341071 28776 leader_election.cc:304] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:32.374627 30282 raft_consensus.cc:2749] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:32.408617 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:32.410100 28889 raft_consensus.cc:2393] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 3: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:32.418985 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:32.419988 28737 raft_consensus.cc:2393] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:32.423830 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:32.424011 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:32.425539 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:32.426103 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:32.428071 28882 raft_consensus.cc:2393] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 2: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:32.428306 28888 raft_consensus.cc:2393] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 2: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:32.429491 28701 leader_election.cc:304] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:32.428154 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 125218us
I20260203 09:17:32.431725 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:32.433579 28887 raft_consensus.cc:2393] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 3: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:32.432669 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:32.437180 28883 raft_consensus.cc:1275] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260203 09:17:32.438239 28889 raft_consensus.cc:1275] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260203 09:17:32.440791 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:32.441624 28885 raft_consensus.cc:2393] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 3: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:32.437084 28880 raft_consensus.cc:2468] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:32.454905 30133 raft_consensus.cc:515] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.461805 30341 consensus_queue.cc:1048] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260203 09:17:32.455971 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 83945.7us
I20260203 09:17:32.456117 28633 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56844 (request call id 279) took 6134 ms. Trace:
I20260203 09:17:32.443496 30291 raft_consensus.cc:515] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.460350 30250 consensus_queue.cc:1048] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260203 09:17:32.460976 28702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:32.460805 28701 leader_election.cc:304] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters: cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:32.435513 30282 raft_consensus.cc:2749] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260203 09:17:32.469486 30341 raft_consensus.cc:2804] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:32.473083 30341 raft_consensus.cc:493] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:32.465022 28633 rpcz_store.cc:276] 0203 09:17:26.321375 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:26.321509 (+ 134us) service_pool.cc:225] Handling call
0203 09:17:27.018499 (+696990us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b540008d754. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1f0c0 00007f2cd3dbdbba 00007f2cd9b3eeac 00007f2cd9c3910e 00007f2cd81344a4 00007f2cd8134432 00007f2cd8134361 00007f2cd81342dc 00007f2cd8133592 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:32.456054 (+5437555us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0203 09:17:32.431138 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0203 09:17:32.438597 (+ 7459us) write_op.cc:432] Acquiring schema lock in shared mode
0203 09:17:32.438647 (+ 50us) write_op.cc:435] Acquired schema lock
0203 09:17:32.438664 (+ 17us) tablet.cc:660] Decoding operations
0203 09:17:32.439069 (+ 405us) write_op.cc:620] Acquiring the partition lock for write op
0203 09:17:32.439156 (+ 87us) write_op.cc:641] Partition lock acquired for write op
0203 09:17:32.439190 (+ 34us) tablet.cc:683] Acquiring locks for 1 operations
0203 09:17:32.439500 (+ 310us) tablet.cc:699] Row locks acquired
0203 09:17:32.439519 (+ 19us) write_op.cc:260] PREPARE: finished
0203 09:17:32.439708 (+ 189us) write_op.cc:270] Start()
0203 09:17:32.439880 (+ 172us) write_op.cc:276] Timestamp: P: 1770110252439643 usec, L: 0
0203 09:17:32.439900 (+ 20us) op_driver.cc:348] REPLICATION: starting
0203 09:17:32.444043 (+ 4143us) log.cc:844] Serialized 541 byte log entry
0203 09:17:32.450294 (+ 6251us) op_driver.cc:464] REPLICATION: finished
0203 09:17:32.450648 (+ 354us) write_op.cc:301] APPLY: starting
0203 09:17:32.450729 (+ 81us) tablet.cc:1365] starting BulkCheckPresence
0203 09:17:32.450837 (+ 108us) tablet.cc:1368] finished BulkCheckPresence
0203 09:17:32.450953 (+ 116us) tablet.cc:1370] starting ApplyRowOperation cycle
0203 09:17:32.451191 (+ 238us) tablet.cc:1381] finished ApplyRowOperation cycle
0203 09:17:32.451355 (+ 164us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0203 09:17:32.451407 (+ 52us) write_op.cc:312] APPLY: finished
0203 09:17:32.451582 (+ 175us) log.cc:844] Serialized 23 byte log entry
0203 09:17:32.451753 (+ 171us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:17:32.451852 (+ 99us) write_op.cc:454] Released schema lock
0203 09:17:32.451897 (+ 45us) write_op.cc:341] FINISH: Updating metrics
0203 09:17:32.464835 (+ 12938us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:17:32.464870 (+ 35us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"spinlock_wait_cycles":1159656960,"child_traces":[["op",{"apply.queue_time_us":138,"apply.run_cpu_time_us":1539,"apply.run_wall_time_us":1538,"num_ops":1,"prepare.queue_time_us":178785,"prepare.run_cpu_time_us":3496,"prepare.run_wall_time_us":17172,"replication_time_us":10251,"thread_start_us":45778,"threads_started":1}]]}
I20260203 09:17:32.473529 30341 raft_consensus.cc:3060] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:32.485747 28889 raft_consensus.cc:1275] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260203 09:17:32.489018 28736 raft_consensus.cc:515] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:32.490062 30282 consensus_queue.cc:1048] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:32.496589 30291 leader_election.cc:290] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Requested vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:32.496898 28736 leader_election.cc:290] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:32.497447 30291 raft_consensus.cc:2804] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:32.497869 30291 raft_consensus.cc:493] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
W20260203 09:17:32.501140 28776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 165068us
I20260203 09:17:32.508049 28851 leader_election.cc:304] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:32.507098 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:32.513509 30358 raft_consensus.cc:2749] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:32.517587 28884 raft_consensus.cc:3055] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:32.518024 28884 raft_consensus.cc:740] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:32.518440 30322 consensus_queue.cc:1059] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:17:32.519551 30358 raft_consensus.cc:3055] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:17:32.519001 28884 consensus_queue.cc:260] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:32.498219 30291 raft_consensus.cc:3060] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:32.519944 30358 raft_consensus.cc:740] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:32.521643 30358 consensus_queue.cc:260] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:32.523451 30358 raft_consensus.cc:3060] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:32.520568 28884 raft_consensus.cc:3060] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:32.527828 30133 leader_election.cc:290] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Requested vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:32.527984 28633 catalog_manager.cc:5654] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 2 to 3, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68). New cstate: current_term: 3 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:32.532297 28633 catalog_manager.cc:5654] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 2 to 3, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68). New cstate: current_term: 3 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:32.542268 29459 raft_consensus.cc:1240] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEADER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 3. Current term is 4. Ops: []
I20260203 09:17:32.541960 28633 catalog_manager.cc:5654] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 3 to 4, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68). New cstate: current_term: 4 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:32.543777 28633 catalog_manager.cc:5654] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 1 to 2, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68). New cstate: current_term: 2 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:32.545558 29459 raft_consensus.cc:1240] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 3 LEADER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:32.546206 28851 leader_election.cc:304] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:32.546804 28884 raft_consensus.cc:2468] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:32.509380 30341 raft_consensus.cc:515] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.555860 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:32.555920 28701 leader_election.cc:304] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:32.557158 30250 raft_consensus.cc:2804] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:32.557600 30250 raft_consensus.cc:697] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:32.558493 30250 consensus_queue.cc:237] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:32.555905 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:32.563079 30274 raft_consensus.cc:2749] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:32.563318 28886 raft_consensus.cc:2468] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:32.564510 29459 raft_consensus.cc:2393] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 3: Already voted for candidate cf00f643e7da4a98a0a11ea92869c24a in this term.
I20260203 09:17:32.554265 30341 leader_election.cc:290] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Requested vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:32.565408 28701 leader_election.cc:304] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:32.568261 30223 raft_consensus.cc:2804] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:32.568814 30223 raft_consensus.cc:697] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:32.569779 30223 consensus_queue.cc:237] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.579282 29458 raft_consensus.cc:1275] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260203 09:17:32.582508 29458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:32.583756 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:32.584565 29465 raft_consensus.cc:2393] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 3: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:32.584437 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:32.588124 30314 consensus_queue.cc:1048] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:32.589190 28851 leader_election.cc:304] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:32.590593 30322 raft_consensus.cc:2749] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:32.591073 28851 leader_election.cc:304] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:32.591777 30297 raft_consensus.cc:2749] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:32.592235 28851 leader_election.cc:304] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:32.597112 28851 leader_election.cc:304] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:32.594657 30297 raft_consensus.cc:2749] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:32.597930 30274 raft_consensus.cc:2749] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:32.600152 28851 leader_election.cc:304] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:32.600883 29465 raft_consensus.cc:3060] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 1 LEARNER]: Advancing to term 3
I20260203 09:17:32.597963 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
W20260203 09:17:32.602507 28777 connection.cc:232] RPC call timeout handler was delayed by -1.0603128630000356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
W20260203 09:17:32.602931 28777 connection.cc:232] RPC call timeout handler was delayed by -1.0603128630000356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
W20260203 09:17:32.603209 28777 connection.cc:232] RPC call timeout handler was delayed by -1.0603128630000356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
W20260203 09:17:32.603466 28777 connection.cc:232] RPC call timeout handler was delayed by -1.0603128630000356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
W20260203 09:17:32.603730 28777 connection.cc:232] RPC call timeout handler was delayed by -1.01351286299996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
W20260203 09:17:32.603978 28777 connection.cc:232] RPC call timeout handler was delayed by -1.0090128629999526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
I20260203 09:17:32.604698 28777 leader_election.cc:304] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:32.605468 30392 raft_consensus.cc:2749] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:32.605886 28777 leader_election.cc:304] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:32.606652 30392 raft_consensus.cc:2804] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:32.607085 30392 raft_consensus.cc:493] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:32.606817 28777 leader_election.cc:304] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:32.607841 30392 raft_consensus.cc:3060] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:32.608448 30133 raft_consensus.cc:2749] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:32.609936 28777 leader_election.cc:304] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:32.610916 30133 raft_consensus.cc:2804] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:32.611299 30133 raft_consensus.cc:493] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:32.611231 28777 leader_election.cc:304] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:32.611904 30133 raft_consensus.cc:3060] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:32.612740 28777 leader_election.cc:304] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:32.614449 30291 raft_consensus.cc:515] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.616577 28852 leader_election.cc:304] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:32.616808 29465 raft_consensus.cc:1275] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 3 LEARNER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:17:32.619459 30390 raft_consensus.cc:2804] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:32.619891 30390 raft_consensus.cc:493] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:32.620225 30390 raft_consensus.cc:3060] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:32.620317 30133 raft_consensus.cc:515] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:32.622450 30133 leader_election.cc:290] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:32.623023 30133 raft_consensus.cc:2804] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:32.623322 30133 raft_consensus.cc:493] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:32.623692 30133 raft_consensus.cc:3060] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:32.625712 30308 raft_consensus.cc:2749] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:32.609887 28881 raft_consensus.cc:1275] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:17:32.626394 30274 raft_consensus.cc:2804] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:32.626973 30274 raft_consensus.cc:697] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 3 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:32.627058 28851 leader_election.cc:304] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:32.628837 30308 raft_consensus.cc:2749] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:32.627975 30274 consensus_queue.cc:237] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:32.636052 30291 leader_election.cc:290] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Requested vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:32.636823 30342 raft_consensus.cc:2955] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:32.645457 28852 leader_election.cc:304] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:32.662498 28851 leader_election.cc:400] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Vote denied by peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611) with higher term. Message: Invalid argument: T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 3. Current term is 4.
I20260203 09:17:32.662879 28851 leader_election.cc:403] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260203 09:17:32.663971 28880 raft_consensus.cc:2955] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:32.665582 30390 raft_consensus.cc:515] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:32.668210 30390 leader_election.cc:290] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:32.636406 30341 consensus_queue.cc:1048] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260203 09:17:32.670784 30364 consensus_queue.cc:1048] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:32.671269 30358 raft_consensus.cc:2804] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:32.671945 30358 raft_consensus.cc:697] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:32.673564 30358 consensus_queue.cc:237] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:32.677515 28851 leader_election.cc:304] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:32.678177 30297 raft_consensus.cc:2749] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611) with higher term. Message: Invalid argument: T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 3. Current term is 4.
I20260203 09:17:32.678675 30322 raft_consensus.cc:2749] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:32.677516 28700 leader_election.cc:304] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:32.679915 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:32.680663 29465 raft_consensus.cc:2393] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 3: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:32.680531 30341 raft_consensus.cc:2804] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:32.681118 30341 raft_consensus.cc:493] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:32.682027 30341 raft_consensus.cc:3060] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:32.682807 28851 leader_election.cc:304] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:32.671357 28852 leader_election.cc:304] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters: cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:32.678186 30133 raft_consensus.cc:515] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:32.709056 28851 leader_election.cc:304] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:32.710918 30133 leader_election.cc:290] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:32.711659 30344 raft_consensus.cc:2804] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election won for term 3
W20260203 09:17:32.713682 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 101149us
I20260203 09:17:32.715925 30344 raft_consensus.cc:697] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 3 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:32.716913 30344 consensus_queue.cc:237] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.712288 30322 raft_consensus.cc:2749] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:32.728237 28633 catalog_manager.cc:5654] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 1 to 3, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 3 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
W20260203 09:17:32.736721 30398 log.cc:927] Time spent T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.102s user 0.001s sys 0.000s
I20260203 09:17:32.739449 28777 leader_election.cc:304] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:32.741009 30133 raft_consensus.cc:2804] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:32.741441 30133 raft_consensus.cc:493] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:32.741818 30133 raft_consensus.cc:3060] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:32.733274 30392 raft_consensus.cc:515] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.744217 30392 leader_election.cc:290] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:32.727519 30358 raft_consensus.cc:2749] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:32.750499 28736 raft_consensus.cc:1275] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260203 09:17:32.754181 30255 consensus_queue.cc:1048] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260203 09:17:32.756212 30341 raft_consensus.cc:515] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.761457 29459 raft_consensus.cc:1275] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260203 09:17:32.765133 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 56173.7us
W20260203 09:17:32.767992 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 56263.6us
I20260203 09:17:32.769085 28852 leader_election.cc:304] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:32.767630 28851 leader_election.cc:304] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:32.781960 28851 leader_election.cc:304] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:32.782250 29425 leader_election.cc:304] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:32.781112 30322 raft_consensus.cc:2804] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:32.782929 30405 raft_consensus.cc:2749] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:32.783450 30322 raft_consensus.cc:697] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:32.783654 30405 raft_consensus.cc:2749] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:32.795608 29456 raft_consensus.cc:2955] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:32.783082 30338 raft_consensus.cc:2749] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:32.802675 30397 consensus_queue.cc:1059] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260203 09:17:32.803942 30400 raft_consensus.cc:3055] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:32.804334 30400 raft_consensus.cc:740] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:32.805294 29464 raft_consensus.cc:1240] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [term 3 LEADER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:32.805042 30322 consensus_queue.cc:237] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:32.805352 30400 consensus_queue.cc:260] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:32.805761 29457 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:32.806708 30400 raft_consensus.cc:3060] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:32.812057 30341 leader_election.cc:290] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:32.822788 29458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:32.822793 29425 leader_election.cc:304] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:32.830349 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:32.831097 28883 raft_consensus.cc:1240] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:32.804394 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:32.833271 30400 consensus_queue.cc:1059] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:32.833869 29460 raft_consensus.cc:3060] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:32.834136 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:32.834816 28731 raft_consensus.cc:2393] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:32.835081 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:32.835626 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:32.836316 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:32.836604 30390 consensus_queue.cc:1059] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260203 09:17:32.836828 30219 consensus_queue.cc:1048] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260203 09:17:32.836998 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.834769 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:32.833509 28809 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22"
dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
mode: GRACEFUL
new_leader_uuid: "77541303e1934638ba82f0f43f707adc"
from {username='slave'} at 127.0.0.1:60448
I20260203 09:17:32.840106 28809 raft_consensus.cc:606] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Received request to transfer leadership to TS 77541303e1934638ba82f0f43f707adc
I20260203 09:17:32.832135 30392 consensus_queue.cc:1059] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
W20260203 09:17:32.841465 30404 log.cc:927] Time spent T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.133s user 0.001s sys 0.000s
I20260203 09:17:32.841742 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:32.842350 30397 raft_consensus.cc:3055] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:17:32.840586 28809 raft_consensus.cc:614] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260203 09:17:32.842834 30397 raft_consensus.cc:740] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:32.842284 30291 raft_consensus.cc:3055] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:32.843740 30291 raft_consensus.cc:740] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:32.844523 30392 raft_consensus.cc:3055] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:32.844786 30291 consensus_queue.cc:260] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.843792 30397 consensus_queue.cc:260] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.846102 30291 raft_consensus.cc:3060] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:32.855839 30392 raft_consensus.cc:740] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:32.850904 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.850582 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.851148 30338 raft_consensus.cc:2749] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:32.857263 30392 consensus_queue.cc:260] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:32.850144 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.858368 28811 raft_consensus.cc:3055] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:32.858613 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.858691 28811 raft_consensus.cc:740] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:32.848572 28880 consensus_queue.cc:237] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.851709 29425 leader_election.cc:304] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:32.858610 30392 raft_consensus.cc:3060] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:32.850661 28806 raft_consensus.cc:1275] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260203 09:17:32.860394 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.861454 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.849781 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.861370 28811 consensus_queue.cc:260] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.882675 28811 raft_consensus.cc:3060] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:32.872455 28805 raft_consensus.cc:1275] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260203 09:17:32.884200 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.880692 28631 catalog_manager.cc:5654] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index 3 to 4, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260203 09:17:32.887173 28778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:32.889788 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.890429 28813 raft_consensus.cc:2468] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:32.891227 30133 raft_consensus.cc:515] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.893241 30133 leader_election.cc:290] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:32.891141 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.898555 29460 raft_consensus.cc:2468] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
I20260203 09:17:32.899883 30341 raft_consensus.cc:1064] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:32.900568 30361 raft_consensus.cc:2749] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260203 09:17:32.900746 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 49137.2us
I20260203 09:17:32.911285 30341 consensus_queue.cc:237] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:32.915433 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:32.916283 28886 raft_consensus.cc:2410] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260203 09:17:32.914661 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.917189 28881 raft_consensus.cc:1240] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:32.916210 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.918623 28805 raft_consensus.cc:2393] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 4: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:32.922217 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "021e904a783c4cbc96e5aa625a34a2d8" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.899734 28631 catalog_manager.cc:5654] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:17:32.923327 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b6f1d6e275f4a8ba99a70dbb3ea3235" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.923781 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.924423 28807 raft_consensus.cc:2393] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:32.924536 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.925886 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.924283 28631 catalog_manager.cc:5654] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 3 to 4, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 4 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:17:32.916586 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.928160 28810 raft_consensus.cc:2376] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2. Re-sending same reply.
I20260203 09:17:32.927237 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.929253 28631 catalog_manager.cc:5654] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 2 to 3, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 3 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:32.930390 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.934872 28881 raft_consensus.cc:1275] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260203 09:17:32.935424 28631 catalog_manager.cc:5654] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 1 to 3, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 3 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:32.937688 30341 consensus_queue.cc:1048] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:32.934012 29457 raft_consensus.cc:1275] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 3 LEARNER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260203 09:17:32.942201 30219 consensus_queue.cc:1048] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:32.939774 28631 catalog_manager.cc:5654] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 2 to 3, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 3 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } }
I20260203 09:17:32.935842 29425 leader_election.cc:304] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:32.943698 28631 catalog_manager.cc:5654] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:32.948220 28631 catalog_manager.cc:5654] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 1 to 2, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 2 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:32.949111 30361 raft_consensus.cc:2749] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:32.950874 29425 leader_election.cc:304] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:32.951617 30219 raft_consensus.cc:2955] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:32.953250 29456 raft_consensus.cc:1240] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Rejecting Update request from peer 77541303e1934638ba82f0f43f707adc for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:32.957581 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.960223 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.961691 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.962036 30255 consensus_queue.cc:1048] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260203 09:17:32.962349 28807 raft_consensus.cc:2376] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4. Re-sending same reply.
I20260203 09:17:32.965065 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.965709 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.966362 28808 raft_consensus.cc:2468] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:32.967391 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.968279 28807 raft_consensus.cc:2393] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 4: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:32.970168 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.971463 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.972793 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.971999 28886 raft_consensus.cc:2955] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:32.973997 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.974846 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.975519 28809 raft_consensus.cc:1275] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260203 09:17:32.981652 28736 raft_consensus.cc:1275] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:32.988791 30361 raft_consensus.cc:2749] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:32.971520 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:32.996637 30361 consensus_queue.cc:1048] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:32.997641 28889 raft_consensus.cc:1275] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260203 09:17:32.999006 30250 consensus_queue.cc:1048] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260203 09:17:32.999089 30344 consensus_queue.cc:1059] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260203 09:17:33.000183 30344 raft_consensus.cc:3055] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:33.000528 30344 raft_consensus.cc:740] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:33.000505 29457 raft_consensus.cc:2955] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:33.001750 30344 consensus_queue.cc:260] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:33.002946 30344 raft_consensus.cc:3060] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:33.004802 28806 raft_consensus.cc:2376] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3. Re-sending same reply.
I20260203 09:17:33.015197 30397 raft_consensus.cc:3060] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
W20260203 09:17:33.021065 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 195970us
I20260203 09:17:33.022249 30390 consensus_queue.cc:1059] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:33.023161 30390 raft_consensus.cc:3055] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:33.023518 30390 raft_consensus.cc:740] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:33.022948 30411 consensus_queue.cc:1059] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:17:32.945644 28811 raft_consensus.cc:2468] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:33.033996 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b2c469d7255413d9f61a7cbaa4481a7" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:32.974064 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:33.038836 30291 raft_consensus.cc:3055] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:33.039345 30291 raft_consensus.cc:740] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:33.024320 30390 consensus_queue.cc:260] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:33.041581 30390 raft_consensus.cc:3060] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:33.040215 30291 consensus_queue.cc:260] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:33.044059 30291 raft_consensus.cc:3060] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:33.049356 28813 raft_consensus.cc:2468] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
W20260203 09:17:33.053193 28779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:33.061578 30133 consensus_queue.cc:1059] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:17:33.062815 30133 consensus_queue.cc:1059] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:33.063796 30400 raft_consensus.cc:3055] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:33.064044 30411 raft_consensus.cc:3055] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:33.064793 30411 raft_consensus.cc:740] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:33.064244 30400 raft_consensus.cc:740] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:33.065627 30411 consensus_queue.cc:260] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:33.066906 30400 consensus_queue.cc:260] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:33.068512 30400 raft_consensus.cc:3060] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:33.069468 30411 raft_consensus.cc:3060] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:33.070859 28777 leader_election.cc:304] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:33.076120 28806 raft_consensus.cc:1275] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260203 09:17:33.076264 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:33.077663 28804 raft_consensus.cc:1275] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260203 09:17:33.080622 30255 raft_consensus.cc:493] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:33.078574 28805 raft_consensus.cc:1275] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:17:33.081148 30255 raft_consensus.cc:515] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:33.079133 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:33.082098 28810 raft_consensus.cc:2376] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3. Re-sending same reply.
I20260203 09:17:33.079764 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:33.083043 30255 leader_election.cc:290] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:33.084100 28807 raft_consensus.cc:1275] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260203 09:17:33.085425 28779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:33.085711 28807 raft_consensus.cc:1275] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:33.085668 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:33.086717 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:33.087234 28811 raft_consensus.cc:2393] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 2: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:33.087383 28805 raft_consensus.cc:2393] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a in current term 2: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:33.087950 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:33.090309 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:33.091837 29459 raft_consensus.cc:1240] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:33.092233 28811 raft_consensus.cc:3060] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:33.092494 29456 raft_consensus.cc:1240] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:33.090665 29458 raft_consensus.cc:1240] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:33.088338 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:33.091014 28805 raft_consensus.cc:1275] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260203 09:17:33.094714 28807 raft_consensus.cc:1275] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260203 09:17:33.088759 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:33.096433 28810 raft_consensus.cc:1240] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Rejecting Update request from peer cf00f643e7da4a98a0a11ea92869c24a for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:33.097254 29458 raft_consensus.cc:1240] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
W20260203 09:17:33.097609 28700 leader_election.cc:336] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Timed out: RequestConsensusVote RPC to 127.26.232.66:41611 timed out after 1.516s (SENT)
I20260203 09:17:33.087837 28806 raft_consensus.cc:3055] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:33.098392 28806 raft_consensus.cc:740] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:33.099275 29458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:33.099157 28806 consensus_queue.cc:260] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:33.088148 28812 raft_consensus.cc:2468] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:33.101450 29458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:33.103343 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:33.103976 28736 raft_consensus.cc:2468] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 3.
I20260203 09:17:33.105512 29458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:33.105664 29426 leader_election.cc:304] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:33.107098 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:33.100548 28806 raft_consensus.cc:3060] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:33.107213 30255 raft_consensus.cc:2804] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:33.108305 30255 raft_consensus.cc:493] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:33.108814 30255 raft_consensus.cc:3060] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:33.086213 28813 raft_consensus.cc:2368] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3.
I20260203 09:17:33.111904 30390 raft_consensus.cc:2749] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:33.108896 28700 leader_election.cc:304] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:33.114207 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 46871us
I20260203 09:17:33.127641 28776 leader_election.cc:304] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:33.116376 28777 leader_election.cc:304] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:33.128432 28811 raft_consensus.cc:2468] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:33.130291 30390 raft_consensus.cc:2749] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:33.133270 28777 leader_election.cc:304] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:33.134212 30392 raft_consensus.cc:2804] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:33.134577 30392 raft_consensus.cc:493] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:33.134701 28777 leader_election.cc:304] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:33.130411 28776 leader_election.cc:304] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:33.134961 30392 raft_consensus.cc:3060] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:17:33.132472 28778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:33.137751 30250 raft_consensus.cc:3060] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:33.133209 30390 raft_consensus.cc:2804] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:33.144948 30390 raft_consensus.cc:493] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:33.145358 30390 raft_consensus.cc:3060] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:33.147198 28736 raft_consensus.cc:1240] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Rejecting Update request from peer cf00f643e7da4a98a0a11ea92869c24a for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:33.152495 30314 raft_consensus.cc:493] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:33.153175 30314 raft_consensus.cc:515] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:33.168853 28806 raft_consensus.cc:1275] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260203 09:17:33.169601 28700 leader_election.cc:336] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Timed out: RequestConsensusVote RPC to 127.26.232.66:41611 timed out after 1.531s (SENT)
I20260203 09:17:33.166083 28633 catalog_manager.cc:5654] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index 2 to 4, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:33.174583 28736 raft_consensus.cc:1275] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:33.177623 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:33.179175 28700 leader_election.cc:304] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:33.180356 28700 leader_election.cc:304] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:33.181754 28700 leader_election.cc:304] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:33.198729 30219 raft_consensus.cc:2749] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:33.198772 28700 leader_election.cc:304] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:33.183511 30274 consensus_queue.cc:1048] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:33.154855 30133 raft_consensus.cc:2749] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:33.184103 28804 raft_consensus.cc:2468] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 3.
I20260203 09:17:33.184864 30342 raft_consensus.cc:2749] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:33.185564 30341 raft_consensus.cc:2749] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:33.186007 30290 consensus_queue.cc:1048] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:33.186160 30255 raft_consensus.cc:515] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:33.170622 30361 consensus_queue.cc:1059] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260203 09:17:33.162151 30314 leader_election.cc:290] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:33.190268 30411 consensus_queue.cc:1059] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260203 09:17:33.196406 28881 raft_consensus.cc:1275] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:33.196736 29458 raft_consensus.cc:1275] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260203 09:17:33.180073 30392 raft_consensus.cc:515] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:33.220309 30392 leader_election.cc:290] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:33.197417 30344 raft_consensus.cc:493] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:33.220992 30344 raft_consensus.cc:515] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:33.223176 30344 leader_election.cc:290] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:33.223752 30344 consensus_queue.cc:1048] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:33.225333 30314 raft_consensus.cc:493] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:33.225876 30314 raft_consensus.cc:515] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:33.226613 30255 leader_election.cc:290] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:33.227332 30292 raft_consensus.cc:3055] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:33.193886 30291 consensus_queue.cc:1059] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260203 09:17:33.227758 30292 raft_consensus.cc:740] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:33.207181 30364 raft_consensus.cc:2749] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:33.169422 30397 raft_consensus.cc:2804] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:33.199445 30219 consensus_queue.cc:1048] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:33.183990 30250 raft_consensus.cc:2749] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:33.209136 28700 leader_election.cc:304] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:33.233174 28700 leader_election.cc:304] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:17:33.234931 28700 leader_election.cc:304] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:33.236025 30292 consensus_queue.cc:260] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:33.237177 30250 raft_consensus.cc:2804] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:33.237759 30250 raft_consensus.cc:697] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
W20260203 09:17:33.193699 28702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:33.230084 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:33.238662 30250 consensus_queue.cc:237] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:33.240801 30341 raft_consensus.cc:3060] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:33.240703 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:33.243129 28737 raft_consensus.cc:3060] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:33.245172 30133 raft_consensus.cc:1064] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:33.237301 30397 raft_consensus.cc:697] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:33.246348 30397 consensus_queue.cc:237] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:33.227830 30314 leader_election.cc:290] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:33.247608 30133 consensus_queue.cc:237] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:33.192530 28777 leader_election.cc:304] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:33.237624 30342 consensus_queue.cc:1048] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:33.249305 30411 raft_consensus.cc:2749] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:33.233053 30290 raft_consensus.cc:2749] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 09:17:33.229889 28776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 54219.3us
I20260203 09:17:33.236027 28700 leader_election.cc:304] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:17:33.249231 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 56767.4us
I20260203 09:17:33.232966 29458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:33.257896 28737 raft_consensus.cc:2468] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 4.
I20260203 09:17:33.236764 30291 raft_consensus.cc:3055] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:33.250923 29457 raft_consensus.cc:1240] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Rejecting Update request from peer 77541303e1934638ba82f0f43f707adc for earlier term 3. Current term is 4. Ops: []
I20260203 09:17:33.259759 29426 leader_election.cc:304] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
W20260203 09:17:33.260210 28853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:33.250700 30392 raft_consensus.cc:3055] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:33.259199 28777 leader_election.cc:304] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:33.270951 28736 consensus_queue.cc:237] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:33.279455 29425 leader_election.cc:304] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:33.260769 30342 raft_consensus.cc:2749] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:33.263414 29458 raft_consensus.cc:2468] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:33.281769 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:33.283466 28881 raft_consensus.cc:1275] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260203 09:17:33.285398 30290 consensus_queue.cc:1048] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:33.285914 28804 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72"
dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
mode: GRACEFUL
new_leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
from {username='slave'} at 127.0.0.1:60448
I20260203 09:17:33.287077 30341 raft_consensus.cc:2749] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:33.289984 28851 leader_election.cc:304] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:33.260720 30291 raft_consensus.cc:740] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:33.249542 30390 raft_consensus.cc:515] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:33.292197 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 56221.4us
I20260203 09:17:33.278645 30411 raft_consensus.cc:2749] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:33.293504 30255 raft_consensus.cc:2749] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:33.288831 30421 consensus_queue.cc:1059] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260203 09:17:33.293821 28777 leader_election.cc:304] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:33.262953 30392 raft_consensus.cc:740] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:33.288937 30338 raft_consensus.cc:2804] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:17:33.297873 28700 leader_election.cc:304] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:33.316046 28777 leader_election.cc:304] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:33.316339 29425 leader_election.cc:304] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:33.316828 30420 raft_consensus.cc:3055] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:33.317270 30420 raft_consensus.cc:740] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:33.317488 30292 raft_consensus.cc:3060] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:33.318130 28700 leader_election.cc:304] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:33.318053 30420 consensus_queue.cc:260] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:33.319442 30420 raft_consensus.cc:3060] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:33.320853 30219 raft_consensus.cc:2749] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:33.302381 30392 consensus_queue.cc:260] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:33.322875 30392 raft_consensus.cc:3060] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:33.323369 30254 raft_consensus.cc:2749] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:33.319986 30400 raft_consensus.cc:2749] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:33.295945 30405 consensus_queue.cc:1059] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260203 09:17:33.325301 30225 consensus_queue.cc:1048] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260203 09:17:33.324062 30254 consensus_queue.cc:1048] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260203 09:17:33.325654 30405 raft_consensus.cc:3055] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:17:33.325978 30411 raft_consensus.cc:2749] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:33.326186 30405 raft_consensus.cc:740] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:33.325733 28777 leader_election.cc:304] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:33.302843 30291 consensus_queue.cc:260] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:33.327991 30291 raft_consensus.cc:3060] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:33.327930 28777 leader_election.cc:304] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:33.328945 30400 raft_consensus.cc:2749] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:33.328220 30411 raft_consensus.cc:2749] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:33.330775 28777 leader_election.cc:304] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:33.331466 30411 raft_consensus.cc:2749] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:33.332607 28777 leader_election.cc:304] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:33.322901 29425 leader_election.cc:304] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:33.333469 30411 raft_consensus.cc:2749] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:33.309360 30358 raft_consensus.cc:2804] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:33.334268 30255 raft_consensus.cc:2749] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:33.334568 30358 raft_consensus.cc:493] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:33.335047 30358 raft_consensus.cc:3060] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:33.335289 30225 consensus_queue.cc:1059] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260203 09:17:33.336400 30361 raft_consensus.cc:3055] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:33.336773 30361 raft_consensus.cc:740] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:33.334573 28777 leader_election.cc:304] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:33.337698 30411 raft_consensus.cc:2749] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260203 09:17:33.338354 29425 leader_election.cc:304] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:33.337764 30361 consensus_queue.cc:260] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:33.339165 30338 raft_consensus.cc:697] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:33.341684 30405 consensus_queue.cc:260] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:33.343153 30405 raft_consensus.cc:3060] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:33.342968 30338 consensus_queue.cc:237] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:33.316994 30390 leader_election.cc:290] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:33.345862 30290 raft_consensus.cc:2749] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:33.347566 30225 raft_consensus.cc:2804] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:33.348348 30225 raft_consensus.cc:697] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:33.349345 30225 consensus_queue.cc:237] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:33.296437 28631 catalog_manager.cc:5654] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 1 to 3, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68). New cstate: current_term: 3 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:33.356078 28851 leader_election.cc:304] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:33.356107 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 141593us
I20260203 09:17:33.362147 30390 consensus_queue.cc:1059] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260203 09:17:33.366192 30390 raft_consensus.cc:3055] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:33.366580 30390 raft_consensus.cc:740] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:33.366878 28851 leader_election.cc:304] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:33.367720 30274 raft_consensus.cc:2749] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:33.368950 30408 raft_consensus.cc:2804] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:33.369263 28731 raft_consensus.cc:1275] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:33.369355 30408 raft_consensus.cc:493] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:33.369921 30408 raft_consensus.cc:3060] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:33.370371 28700 leader_election.cc:304] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:33.370980 28734 raft_consensus.cc:1275] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:33.372289 28733 raft_consensus.cc:1275] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260203 09:17:33.362239 30254 consensus_queue.cc:1048] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260203 09:17:33.368983 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:33.373363 28729 raft_consensus.cc:2468] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:33.368562 28851 leader_election.cc:304] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:33.374905 28851 leader_election.cc:304] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:33.375516 30364 raft_consensus.cc:2749] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:33.375864 30297 raft_consensus.cc:2749] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:33.355557 30361 raft_consensus.cc:3060] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:33.376582 30322 consensus_queue.cc:1048] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:33.379990 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:33.381867 28631 catalog_manager.cc:5654] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 1 to 2, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 2 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:17:33.385886 28631 catalog_manager.cc:5654] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:17:33.388617 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:33.388943 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:33.389477 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:33.390218 28812 raft_consensus.cc:2393] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:33.392086 28731 raft_consensus.cc:1240] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:33.392612 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:33.393297 28811 raft_consensus.cc:2393] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:33.395545 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:33.396250 28811 raft_consensus.cc:2368] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 2. Current term is 3.
I20260203 09:17:33.392088 28631 catalog_manager.cc:5654] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 1 to 2, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 2 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:17:33.397117 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:33.397953 28811 raft_consensus.cc:2468] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:33.400251 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:33.402577 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:33.404412 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:33.405248 28812 raft_consensus.cc:2393] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 2: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:33.404920 28631 catalog_manager.cc:5654] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:33.406234 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:33.408602 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:33.408818 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:33.409487 28806 raft_consensus.cc:2410] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260203 09:17:33.409703 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:33.410517 28808 raft_consensus.cc:2393] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:33.411568 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:33.412153 28810 raft_consensus.cc:2468] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:33.418723 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:33.421638 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:33.422750 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:33.427234 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 52395.4us
I20260203 09:17:33.429565 28807 raft_consensus.cc:2393] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:33.433110 28810 raft_consensus.cc:1240] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 LEADER]: Rejecting Update request from peer 77541303e1934638ba82f0f43f707adc for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:33.432253 28734 raft_consensus.cc:1240] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:33.436744 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:33.436914 28734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:33.438006 28734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:33.438186 28731 raft_consensus.cc:1240] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:33.439047 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:33.439401 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:33.440933 28700 leader_election.cc:304] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:33.442170 28700 leader_election.cc:304] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:33.441458 30290 raft_consensus.cc:2955] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:33.443130 28804 raft_consensus.cc:606] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Received request to transfer leadership to TS 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:33.443543 28804 raft_consensus.cc:614] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260203 09:17:33.443746 28700 leader_election.cc:304] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:17:33.445036 28779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:33.445559 30297 raft_consensus.cc:2749] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:33.446823 28813 raft_consensus.cc:2468] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:33.447595 28732 raft_consensus.cc:1240] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:33.450253 28729 raft_consensus.cc:1240] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:33.436630 28738 raft_consensus.cc:1240] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 2. Current term is 3. Ops: []
W20260203 09:17:33.458314 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 70063.2us
I20260203 09:17:33.400230 30344 consensus_queue.cc:1048] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260203 09:17:33.403484 30274 consensus_queue.cc:1048] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260203 09:17:33.461737 28730 raft_consensus.cc:1240] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:33.462057 28700 leader_election.cc:304] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:17:33.464380 28701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:33.485658 28807 raft_consensus.cc:1240] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Rejecting Update request from peer 77541303e1934638ba82f0f43f707adc for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:33.496083 28806 raft_consensus.cc:1275] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260203 09:17:33.490933 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:33.456923 30250 raft_consensus.cc:2764] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260203 09:17:33.500770 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:33.500980 28805 raft_consensus.cc:1240] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Rejecting Update request from peer 77541303e1934638ba82f0f43f707adc for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:33.502823 28889 raft_consensus.cc:1240] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:33.457329 30219 raft_consensus.cc:2749] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:33.504570 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:33.459013 30364 raft_consensus.cc:2749] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:33.505322 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:33.506253 28884 raft_consensus.cc:2410] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260203 09:17:33.490195 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:33.508006 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:33.508427 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:33.508846 28882 raft_consensus.cc:2393] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 3: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:33.511914 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:33.514012 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:33.517037 28886 raft_consensus.cc:1240] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:33.518146 28889 raft_consensus.cc:1240] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:33.519028 30358 raft_consensus.cc:515] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:33.500540 28806 raft_consensus.cc:1240] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Rejecting Update request from peer 77541303e1934638ba82f0f43f707adc for earlier term 3. Current term is 4. Ops: []
I20260203 09:17:33.451674 30390 consensus_queue.cc:260] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:33.520764 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 68548.8us
I20260203 09:17:33.521835 28851 leader_election.cc:304] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:33.522465 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:33.517174 28805 raft_consensus.cc:1240] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Rejecting Update request from peer 77541303e1934638ba82f0f43f707adc for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:33.486452 30292 raft_consensus.cc:493] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:33.493670 28804 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e"
dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
mode: GRACEFUL
new_leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
from {username='slave'} at 127.0.0.1:60448
W20260203 09:17:33.526034 28703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:33.538516 28804 raft_consensus.cc:606] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Received request to transfer leadership to TS 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:33.538923 28804 raft_consensus.cc:614] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260203 09:17:33.539726 29458 raft_consensus.cc:1275] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEARNER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260203 09:17:33.491994 30314 raft_consensus.cc:2749] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:33.541810 28887 raft_consensus.cc:2468] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
I20260203 09:17:33.526954 28777 leader_election.cc:304] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:33.543035 28700 leader_election.cc:304] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:33.537178 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:33.535107 30292 raft_consensus.cc:515] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:33.545342 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:33.547466 30392 raft_consensus.cc:2749] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:33.547943 30423 raft_consensus.cc:2749] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:33.548331 28851 leader_election.cc:304] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:33.549319 30322 raft_consensus.cc:2749] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:33.549832 28777 leader_election.cc:304] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:33.549510 28851 leader_election.cc:304] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:33.549340 30397 consensus_queue.cc:1059] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260203 09:17:33.548149 30392 consensus_queue.cc:1048] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260203 09:17:33.547382 30390 raft_consensus.cc:3060] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:33.490594 28880 raft_consensus.cc:2955] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:33.566956 30437 raft_consensus.cc:493] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:33.566669 30133 raft_consensus.cc:2749] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:33.589332 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:33.589964 28806 raft_consensus.cc:1275] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:33.590793 28700 leader_election.cc:304] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
W20260203 09:17:33.593073 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 43639.7us
I20260203 09:17:33.612943 28619 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 7e1bac12c6ee43d6901400e02b35d82f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260203 09:17:33.745589 28776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260203 09:17:33.745771 28702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:33.593793 30423 raft_consensus.cc:2749] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260203 09:17:33.728308 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 119497us
I20260203 09:17:33.756517 28777 leader_election.cc:304] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:33.591914 30364 raft_consensus.cc:2749] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260203 09:17:33.749761 28619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 157649us
W20260203 09:17:33.753551 28853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:33.595080 28804 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905"
dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
mode: GRACEFUL
new_leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
from {username='slave'} at 127.0.0.1:60448
I20260203 09:17:33.599653 30405 raft_consensus.cc:493] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:33.599961 30411 consensus_queue.cc:1059] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.196s
W20260203 09:17:33.798399 28777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:33.594792 30219 consensus_queue.cc:1048] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.165s
I20260203 09:17:33.597983 30437 raft_consensus.cc:515] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:33.797943 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 199431us
I20260203 09:17:33.796515 30392 raft_consensus.cc:2749] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:33.798638 30255 raft_consensus.cc:493] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:33.817822 28851 leader_election.cc:400] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 election: Vote denied by peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611) with higher term. Message: Invalid argument: T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 2. Current term is 3.
I20260203 09:17:33.824100 28777 leader_election.cc:304] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:33.826419 30432 raft_consensus.cc:493] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:33.810456 28804 raft_consensus.cc:606] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Received request to transfer leadership to TS 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:33.826436 30342 raft_consensus.cc:2804] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:33.843396 28777 leader_election.cc:304] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:33.863531 28777 leader_election.cc:304] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:33.839440 28804 raft_consensus.cc:614] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260203 09:17:33.871254 28805 raft_consensus.cc:3055] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:33.871722 28805 raft_consensus.cc:740] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:33.872957 28777 leader_election.cc:304] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:33.873965 30133 raft_consensus.cc:2749] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:33.815701 30405 raft_consensus.cc:515] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:33.874810 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 62386.3us
W20260203 09:17:33.875101 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 284333us
I20260203 09:17:33.823218 30255 raft_consensus.cc:515] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:33.881073 28700 leader_election.cc:304] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:33.839043 30392 raft_consensus.cc:2749] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:33.838423 30358 leader_election.cc:290] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:33.867479 30400 raft_consensus.cc:2749] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260203 09:17:33.867251 30292 leader_election.cc:290] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:33.898732 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:33.899941 28729 raft_consensus.cc:3060] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:33.875818 30411 raft_consensus.cc:2749] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:33.896430 28805 consensus_queue.cc:260] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:33.877915 30342 raft_consensus.cc:697] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:33.914283 28777 leader_election.cc:304] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:33.908409 28700 leader_election.cc:304] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:33.908823 28736 raft_consensus.cc:1240] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 2. Current term is 3. Ops: []
W20260203 09:17:33.894512 30410 log.cc:927] Time spent T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a: Append to log took a long time: real 0.069s user 0.001s sys 0.000s
I20260203 09:17:33.840620 30432 raft_consensus.cc:515] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:33.911067 30437 leader_election.cc:290] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:33.911541 28851 leader_election.cc:304] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:33.927390 28805 raft_consensus.cc:3060] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:33.931169 28729 raft_consensus.cc:2468] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:33.932330 28852 leader_election.cc:304] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:33.911954 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260203 09:17:33.911401 30290 raft_consensus.cc:493] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:33.939551 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:33.940245 28887 raft_consensus.cc:2468] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 3.
I20260203 09:17:33.943176 28700 leader_election.cc:304] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:33.927855 30400 raft_consensus.cc:2749] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:33.948009 28851 leader_election.cc:304] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:33.944892 28777 leader_election.cc:304] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:33.951668 28777 leader_election.cc:304] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:33.954125 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
W20260203 09:17:33.954613 30440 log.cc:927] Time spent T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.063s user 0.000s sys 0.001s
I20260203 09:17:33.955669 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:17:33.960616 28811 raft_consensus.cc:2468] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:33.960816 30431 raft_consensus.cc:2955] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:33.933856 30322 raft_consensus.cc:3060] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:17:33.965747 30436 log.cc:927] Time spent T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.146s user 0.001s sys 0.000s
I20260203 09:17:33.940740 30290 raft_consensus.cc:515] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:33.971489 30290 leader_election.cc:290] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:33.972793 30441 raft_consensus.cc:2804] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:17:33.973558 30420 raft_consensus.cc:2749] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:33.976027 28887 raft_consensus.cc:1275] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:33.981508 29426 leader_election.cc:304] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:33.982548 28851 leader_election.cc:304] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:33.982846 30225 raft_consensus.cc:2804] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:33.983224 30225 raft_consensus.cc:493] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:33.983392 30274 raft_consensus.cc:2749] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:33.983615 30225 raft_consensus.cc:3060] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:33.984066 30274 raft_consensus.cc:2804] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:33.984403 30274 raft_consensus.cc:493] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:33.984921 30274 raft_consensus.cc:3060] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:17:33.985219 30434 log.cc:927] Time spent T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a: Append to log took a long time: real 0.182s user 0.000s sys 0.001s
I20260203 09:17:33.987138 30342 consensus_queue.cc:237] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:33.989074 30421 raft_consensus.cc:3055] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:33.989462 30421 raft_consensus.cc:740] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:34.000502 28777 leader_election.cc:304] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:34.001752 28805 raft_consensus.cc:1275] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:34.002655 28851 leader_election.cc:304] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:34.002943 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:34.003582 30425 raft_consensus.cc:2749] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:33.940560 30358 raft_consensus.cc:2804] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election won for term 3
W20260203 09:17:34.007067 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 63954.1us
I20260203 09:17:34.010227 28700 leader_election.cc:304] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:34.015820 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 61114.6us
I20260203 09:17:33.972859 30405 leader_election.cc:290] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:34.017637 28701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:33.940168 30411 consensus_queue.cc:1059] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
W20260203 09:17:34.022702 28703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:34.023584 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:34.024412 28736 raft_consensus.cc:2393] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 4: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:34.009028 30400 raft_consensus.cc:2749] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:34.028340 28777 leader_election.cc:304] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:34.034085 30448 raft_consensus.cc:2764] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260203 09:17:34.034379 30446 raft_consensus.cc:2749] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:34.037760 28732 raft_consensus.cc:1275] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260203 09:17:34.010593 30291 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260203 09:17:34.019798 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:34.019448 30358 raft_consensus.cc:697] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 3 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:34.021489 30441 raft_consensus.cc:697] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
W20260203 09:17:34.063083 30408 consensus_meta.cc:287] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc: Time spent flushing consensus metadata: real 0.693s user 0.011s sys 0.000s
I20260203 09:17:34.068077 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:34.041195 30390 raft_consensus.cc:2749] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:34.077888 28700 leader_election.cc:304] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:17:34.100623 28729 raft_consensus.cc:2955] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:34.054266 30341 consensus_queue.cc:1048] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260203 09:17:34.094980 28733 raft_consensus.cc:2468] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 4.
I20260203 09:17:34.065344 30400 consensus_queue.cc:1059] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
W20260203 09:17:34.117344 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 51488.2us
I20260203 09:17:34.122704 28851 leader_election.cc:304] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:34.070505 30446 consensus_queue.cc:1048] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260203 09:17:34.071444 30448 consensus_queue.cc:1048] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260203 09:17:34.127678 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:34.140336 28737 raft_consensus.cc:2468] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 4.
I20260203 09:17:34.141621 28852 leader_election.cc:304] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:34.142191 28887 raft_consensus.cc:1275] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260203 09:17:34.111752 30255 leader_election.cc:290] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:34.144533 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 144155us
I20260203 09:17:34.097075 30408 raft_consensus.cc:515] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:34.149539 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 84802.5us
I20260203 09:17:34.150424 28700 leader_election.cc:304] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:34.126237 30219 raft_consensus.cc:2749] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:34.124449 30405 raft_consensus.cc:3060] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:34.124446 30290 raft_consensus.cc:2804] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:34.155684 28882 raft_consensus.cc:1240] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 2. Current term is 3. Ops: []
W20260203 09:17:34.165351 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 162132us
I20260203 09:17:34.167565 28812 raft_consensus.cc:1275] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260203 09:17:34.148926 30435 log.cc:927] Time spent T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a: Append to log took a long time: real 0.205s user 0.001s sys 0.000s
I20260203 09:17:34.146942 30422 raft_consensus.cc:2749] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:17:34.172852 28700 leader_election.cc:304] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:17:34.175999 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:34.153510 30423 raft_consensus.cc:2804] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:34.181488 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:34.182566 28737 raft_consensus.cc:2468] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 3.
I20260203 09:17:34.142607 30344 consensus_queue.cc:1048] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260203 09:17:34.164731 30449 raft_consensus.cc:2749] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:34.185206 28882 raft_consensus.cc:2468] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:34.195165 28732 raft_consensus.cc:1240] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:34.195389 28700 leader_election.cc:400] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Vote denied by peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611) with higher term. Message: Invalid argument: T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3.
I20260203 09:17:34.166025 30432 leader_election.cc:290] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:34.196179 28700 leader_election.cc:304] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:34.151162 30425 consensus_queue.cc:1059] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260203 09:17:34.193229 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:34.183964 28881 raft_consensus.cc:1240] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 4. Current term is 5. Ops: []
I20260203 09:17:34.155411 30420 consensus_queue.cc:1048] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260203 09:17:34.202227 28885 raft_consensus.cc:1275] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260203 09:17:34.206792 28885 pending_rounds.cc:85] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc: Aborting all ops after (but not including) 4
I20260203 09:17:34.175227 30290 raft_consensus.cc:697] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:34.180547 30423 raft_consensus.cc:493] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:34.146859 30358 consensus_queue.cc:237] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:34.169818 30400 consensus_queue.cc:1059] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260203 09:17:34.197543 30408 leader_election.cc:290] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:34.210041 28885 pending_rounds.cc:107] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260203 09:17:34.213644 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:34.214076 28885 raft_consensus.cc:2889] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260203 09:17:34.198411 30341 raft_consensus.cc:2749] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260203 09:17:34.230751 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 88373.1us
I20260203 09:17:34.252821 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:34.208693 30423 raft_consensus.cc:3060] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:34.258689 28812 raft_consensus.cc:2468] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:34.183393 30314 consensus_queue.cc:1048] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260203 09:17:34.198761 30342 raft_consensus.cc:2804] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:34.266101 28813 raft_consensus.cc:1240] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3. Ops: [2.4-2.4]
W20260203 09:17:34.263252 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 73144.2us
I20260203 09:17:34.197889 30459 consensus_queue.cc:1048] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260203 09:17:34.206507 30432 consensus_queue.cc:1059] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260203 09:17:34.271122 28700 leader_election.cc:304] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:34.272471 28700 leader_election.cc:304] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
W20260203 09:17:34.257372 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 46940.6us
W20260203 09:17:34.278872 30445 log.cc:927] Time spent T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.152s user 0.000s sys 0.001s
I20260203 09:17:34.262177 30458 consensus_queue.cc:1048] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260203 09:17:34.279299 28805 raft_consensus.cc:1275] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:17:34.176235 30441 consensus_queue.cc:237] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:34.280501 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:34.286892 28810 raft_consensus.cc:2468] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:34.269917 30425 raft_consensus.cc:3055] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:34.289060 28700 leader_election.cc:304] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:34.257695 30411 raft_consensus.cc:493] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:34.275547 30282 raft_consensus.cc:2749] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:34.276901 30254 raft_consensus.cc:493] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:34.287730 30342 raft_consensus.cc:697] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:34.324167 30342 consensus_queue.cc:237] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:34.331413 30254 raft_consensus.cc:515] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:34.333990 30254 leader_election.cc:290] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:34.318256 30449 raft_consensus.cc:2804] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:34.293982 30425 raft_consensus.cc:740] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
W20260203 09:17:34.348162 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 85386.2us
I20260203 09:17:34.289489 30250 consensus_queue.cc:1059] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260203 09:17:34.294682 30341 consensus_queue.cc:1048] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260203 09:17:34.297114 30411 raft_consensus.cc:515] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:34.378105 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 57139.8us
I20260203 09:17:34.354210 30449 raft_consensus.cc:493] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:34.346962 30322 raft_consensus.cc:2749] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:34.346014 30458 raft_consensus.cc:493] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:34.380257 29426 leader_election.cc:304] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:34.396663 29426 leader_election.cc:304] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:34.400858 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 44694.4us
I20260203 09:17:34.377166 29458 raft_consensus.cc:1275] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260203 09:17:34.399271 30458 raft_consensus.cc:515] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:34.409085 30461 consensus_queue.cc:1059] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260203 09:17:34.411083 30458 leader_election.cc:290] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:34.413750 30466 raft_consensus.cc:3055] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:34.414352 30466 raft_consensus.cc:740] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:34.417526 30462 consensus_queue.cc:1059] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260203 09:17:34.418412 30468 consensus_queue.cc:1048] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260203 09:17:34.419538 30457 log.cc:927] Time spent T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.201s user 0.002s sys 0.000s
W20260203 09:17:34.421627 28777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:34.424444 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:34.428872 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:34.392879 30449 raft_consensus.cc:3060] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:34.339062 30290 consensus_queue.cc:237] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:34.429661 28805 raft_consensus.cc:2468] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 4.
I20260203 09:17:34.445699 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:17:34.455416 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 110531us
I20260203 09:17:34.453055 28730 raft_consensus.cc:2468] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 3.
I20260203 09:17:34.468124 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:34.413805 30390 raft_consensus.cc:3055] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:34.429019 30255 raft_consensus.cc:2749] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:34.506786 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:34.510720 28885 raft_consensus.cc:2468] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:34.507536 28805 raft_consensus.cc:2393] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:34.510999 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:34.415709 30421 consensus_queue.cc:260] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:34.428719 30322 consensus_queue.cc:1048] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260203 09:17:34.525647 30465 consensus_queue.cc:1048] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260203 09:17:34.527006 29458 raft_consensus.cc:1275] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260203 09:17:34.527922 30468 raft_consensus.cc:493] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:34.528440 30468 raft_consensus.cc:515] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:34.525527 30460 raft_consensus.cc:2804] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260203 09:17:34.526042 30456 log.cc:927] Time spent T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.204s user 0.001s sys 0.001s
I20260203 09:17:34.530956 30468 leader_election.cc:290] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:34.531858 28880 consensus_meta.cc:287] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc: Time spent flushing consensus metadata: real 0.734s user 0.010s sys 0.000s
I20260203 09:17:34.510006 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:34.509598 30390 raft_consensus.cc:740] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:34.515910 30408 raft_consensus.cc:3055] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:17:34.566007 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:34.573480 28808 raft_consensus.cc:2468] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 3.
I20260203 09:17:34.576869 28889 raft_consensus.cc:1240] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260203 09:17:34.524008 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:34.530978 30460 raft_consensus.cc:493] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:34.514894 30291 consensus_queue.cc:1048] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260203 09:17:34.533670 30431 consensus_meta.cc:287] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc: Time spent flushing consensus metadata: real 0.571s user 0.012s sys 0.000s
I20260203 09:17:34.429097 30425 consensus_queue.cc:260] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:34.604120 29465 raft_consensus.cc:1275] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260203 09:17:34.573210 30408 raft_consensus.cc:740] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:34.416033 30466 consensus_queue.cc:260] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:34.613624 30254 raft_consensus.cc:493] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:34.578982 28735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43612 (request call id 1718) took 1023 ms. Trace:
I20260203 09:17:34.625865 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
W20260203 09:17:34.602455 30274 consensus_meta.cc:287] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc: Time spent flushing consensus metadata: real 0.617s user 0.011s sys 0.000s
I20260203 09:17:34.592618 30437 raft_consensus.cc:493] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:34.602113 30460 raft_consensus.cc:3060] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Advancing to term 4
W20260203 09:17:34.637235 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 209588us
I20260203 09:17:34.649435 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:34.605397 29458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:34.649821 29426 leader_election.cc:304] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:34.621690 30397 raft_consensus.cc:493] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:34.663842 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 63834.3us
I20260203 09:17:34.666476 29426 leader_election.cc:304] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:34.667974 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:34.645116 30411 leader_election.cc:290] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:34.759323 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:34.760208 28737 raft_consensus.cc:2393] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 3: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:34.629921 30254 raft_consensus.cc:515] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:34.664389 30425 raft_consensus.cc:3060] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:34.749682 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:34.625823 28735 rpcz_store.cc:276] 0203 09:17:33.555543 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:33.560456 (+ 4913us) service_pool.cc:225] Handling call
0203 09:17:33.560833 (+ 377us) raft_consensus.cc:1471] Updating replica for 1 ops
0203 09:17:33.612788 (+ 51955us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:33.755835 (+143047us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0203 09:17:33.868384 (+112549us) log.cc:844] Serialized 26 byte log entry
0203 09:17:34.113184 (+244800us) raft_consensus.cc:1645] Marking committed up to 1
0203 09:17:34.113576 (+ 392us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:34.124569 (+ 10993us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0203 09:17:34.532736 (+408167us) raft_consensus.cc:1685] finished
0203 09:17:34.565148 (+ 32412us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:34.576017 (+ 10869us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":46419,"raft.queue_time_us":257213,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":3955,"thread_start_us":171476,"threads_started":1,"wal-append.queue_time_us":265145}
W20260203 09:17:34.765529 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 99149.1us
I20260203 09:17:34.667649 29458 raft_consensus.cc:2468] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:34.744118 30462 raft_consensus.cc:493] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:34.654068 30274 raft_consensus.cc:515] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:34.659830 30437 raft_consensus.cc:515] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:34.666342 30397 raft_consensus.cc:515] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:34.762575 30291 raft_consensus.cc:493] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:34.794332 30291 raft_consensus.cc:515] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:34.795975 30397 leader_election.cc:290] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:34.756479 30408 consensus_queue.cc:260] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:34.774359 30225 consensus_meta.cc:287] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a: Time spent flushing consensus metadata: real 0.790s user 0.008s sys 0.004s
I20260203 09:17:34.779346 30254 leader_election.cc:290] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:34.784116 29426 leader_election.cc:304] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:34.790094 30479 raft_consensus.cc:493] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:34.779143 30475 log.cc:927] Time spent T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.114s user 0.000s sys 0.000s
I20260203 09:17:34.623438 30390 consensus_queue.cc:260] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:34.796484 30291 leader_election.cc:290] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:34.666677 30341 consensus_queue.cc:1048] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.108s
I20260203 09:17:34.805029 30254 raft_consensus.cc:2749] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:34.766201 30468 raft_consensus.cc:2804] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:34.811072 28884 raft_consensus.cc:1240] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:34.815676 29465 raft_consensus.cc:2468] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
W20260203 09:17:34.818436 30467 log.cc:927] Time spent T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.297s user 0.000s sys 0.001s
I20260203 09:17:34.805696 30479 raft_consensus.cc:515] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:34.799749 30470 consensus_queue.cc:1048] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.159s
I20260203 09:17:34.821807 30482 raft_consensus.cc:493] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:34.823172 30477 log.cc:927] Time spent T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.251s user 0.001s sys 0.000s
I20260203 09:17:34.809638 30225 raft_consensus.cc:515] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:34.821537 30486 raft_consensus.cc:493] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:34.825732 30469 raft_consensus.cc:3055] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:17:34.829634 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:34.826692 30408 raft_consensus.cc:3060] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:34.818003 30442 raft_consensus.cc:3060] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:17:34.825176 30474 log.cc:927] Time spent T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.069s user 0.000s sys 0.001s
I20260203 09:17:34.827971 30468 raft_consensus.cc:493] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:34.871353 30468 raft_consensus.cc:3060] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:34.877229 29460 raft_consensus.cc:2368] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 4. Current term is 5.
I20260203 09:17:34.785215 30462 raft_consensus.cc:515] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:34.855124 30484 log.cc:927] Time spent T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.076s user 0.000s sys 0.000s
I20260203 09:17:34.856174 30479 leader_election.cc:290] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:34.833163 30420 consensus_queue.cc:1059] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.052s
I20260203 09:17:34.843648 30482 raft_consensus.cc:515] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:34.939536 30423 consensus_meta.cc:287] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc: Time spent flushing consensus metadata: real 0.670s user 0.013s sys 0.000s
I20260203 09:17:34.942593 30482 leader_election.cc:290] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:34.871398 30397 raft_consensus.cc:493] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:34.945034 30274 leader_election.cc:290] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:34.948943 30449 raft_consensus.cc:515] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:34.950759 30437 leader_election.cc:290] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:34.863585 30469 raft_consensus.cc:740] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:35.013898 30397 raft_consensus.cc:515] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:35.014784 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:35.015563 30225 leader_election.cc:290] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:34.864949 30486 raft_consensus.cc:515] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:35.031023 29459 raft_consensus.cc:3060] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:35.033099 30486 leader_election.cc:290] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:34.887799 30462 leader_election.cc:290] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:35.042747 30446 raft_consensus.cc:3055] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:35.043300 30446 raft_consensus.cc:740] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:35.046787 30421 raft_consensus.cc:3060] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
W20260203 09:17:35.051205 30467 log.cc:927] Time spent T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.176s user 0.000s sys 0.001s
I20260203 09:17:35.044341 30446 consensus_queue.cc:260] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:35.077726 28881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40946 (request call id 1198) took 1123 ms. Trace:
I20260203 09:17:35.090737 28881 rpcz_store.cc:276] 0203 09:17:33.954101 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:33.997493 (+ 43392us) service_pool.cc:225] Handling call
0203 09:17:34.059683 (+ 62190us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:34.208341 (+148658us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:35.077432 (+869091us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54000ec4d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db5a81 00007f2cd3db44be 00007f2cd8d68f49 00007f2cd22f5d34 00007f2cd22f5cc2 00007f2cd22f5bf1 00007f2cd22f5b6c 00007f2cd22f4e22 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:35.077623 (+ 191us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":241367296}
I20260203 09:17:35.091667 30390 raft_consensus.cc:3060] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:35.089380 28732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43626 (request call id 1347) took 1022 ms. Trace:
I20260203 09:17:35.089542 30466 raft_consensus.cc:3060] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:35.090297 28738 raft_consensus.cc:1240] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Rejecting Update request from peer cf00f643e7da4a98a0a11ea92869c24a for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:35.027488 29457 raft_consensus.cc:2955] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:35.116408 30392 raft_consensus.cc:493] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:35.116526 30411 raft_consensus.cc:493] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:35.117061 30282 raft_consensus.cc:493] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:35.117807 30397 leader_election.cc:290] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:35.117658 30282 raft_consensus.cc:515] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:35.118561 30341 raft_consensus.cc:493] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:35.017531 30469 consensus_queue.cc:260] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:35.119071 30341 raft_consensus.cc:515] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:35.117174 30411 raft_consensus.cc:515] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:35.120074 30469 raft_consensus.cc:3060] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:35.092404 28732 rpcz_store.cc:276] 0203 09:17:34.067412 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:34.069780 (+ 2368us) service_pool.cc:225] Handling call
0203 09:17:34.189873 (+120093us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:34.195614 (+ 5741us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:35.089130 (+893516us) spinlock_profiling.cc:243] Waited 88.3 ms on lock 0x7b54002fb2d0. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db452d 00007f2cd8d68f49 00007f2cd22f5d34 00007f2cd22f5cc2 00007f2cd22f5bf1 00007f2cd22f5b6c 00007f2cd22f4e22 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:35.089310 (+ 180us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":203019008}
I20260203 09:17:35.117144 30392 raft_consensus.cc:515] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:35.056543 30405 consensus_meta.cc:287] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc: Time spent flushing consensus metadata: real 0.888s user 0.008s sys 0.006s
W20260203 09:17:35.126714 28702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260203 09:17:35.127565 28777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260203 09:17:35.129283 28702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:35.145819 30495 raft_consensus.cc:493] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:35.146487 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 212180us
I20260203 09:17:35.146669 30495 raft_consensus.cc:515] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:35.151990 30291 raft_consensus.cc:493] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:35.152791 30291 raft_consensus.cc:515] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:35.153344 28812 raft_consensus.cc:1275] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260203 09:17:35.154304 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 297065us
I20260203 09:17:35.125893 30444 raft_consensus.cc:493] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:35.154840 30291 leader_election.cc:290] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:35.155251 30444 raft_consensus.cc:515] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:35.155788 28811 raft_consensus.cc:1240] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:35.154879 28810 raft_consensus.cc:1240] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260203 09:17:35.157357 30481 raft_consensus.cc:493] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:35.119153 30400 raft_consensus.cc:493] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:35.189363 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b2c469d7255413d9f61a7cbaa4481a7" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:34.997342 30423 raft_consensus.cc:515] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:35.197225 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:35.199591 28883 raft_consensus.cc:2468] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
I20260203 09:17:35.200630 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:35.201277 28883 raft_consensus.cc:2468] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
I20260203 09:17:35.146557 30473 raft_consensus.cc:493] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:35.205457 28777 leader_election.cc:304] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:35.147742 30446 raft_consensus.cc:3060] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:35.157873 30133 raft_consensus.cc:493] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:35.148558 30405 raft_consensus.cc:2749] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260203 09:17:35.206987 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 57363us
W20260203 09:17:35.125970 28807 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s user 0.002s sys 0.050s
I20260203 09:17:35.185570 30411 leader_election.cc:290] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:35.157308 30444 leader_election.cc:290] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:35.194556 30291 raft_consensus.cc:493] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:35.195005 30422 raft_consensus.cc:493] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:35.256197 28889 raft_consensus.cc:1240] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:35.195339 30420 raft_consensus.cc:493] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:35.203905 30400 raft_consensus.cc:515] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:35.234637 30486 raft_consensus.cc:493] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:35.239187 30423 leader_election.cc:290] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:35.241041 30392 leader_election.cc:290] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:35.157864 30481 raft_consensus.cc:515] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:35.198504 30397 raft_consensus.cc:493] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:35.246047 30250 consensus_queue.cc:1048] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260203 09:17:35.258455 28852 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:35.282815 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:35.273703 30314 consensus_queue.cc:1059] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260203 09:17:35.257385 30341 leader_election.cc:290] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:35.232084 28807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s user 0.002s sys 0.050s
I20260203 09:17:35.262462 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:35.294605 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:35.288162 30465 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s user 0.009s sys 0.035s
W20260203 09:17:35.302585 30465 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s user 0.009s sys 0.035s
I20260203 09:17:35.259205 30291 raft_consensus.cc:515] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:35.308243 30291 leader_election.cc:290] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:35.312147 30470 raft_consensus.cc:493] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:35.312794 30470 raft_consensus.cc:515] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:35.315042 30470 leader_election.cc:290] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:35.315591 30470 raft_consensus.cc:493] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:35.316208 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:35.317083 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:35.317744 28732 raft_consensus.cc:2468] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:35.318856 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:35.319514 28738 raft_consensus.cc:2468] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:35.320461 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:35.321755 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:17:35.321731 28851 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s user 0.053s sys 0.091s
W20260203 09:17:35.323114 28851 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s user 0.053s sys 0.091s
I20260203 09:17:35.323395 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:35.324137 28735 raft_consensus.cc:3060] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:35.326654 30423 raft_consensus.cc:493] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:35.327214 30423 raft_consensus.cc:515] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:35.329120 28852 leader_election.cc:304] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:35.330389 30492 raft_consensus.cc:2804] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:35.330801 30492 raft_consensus.cc:493] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:35.331130 30492 raft_consensus.cc:3060] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:17:35.335515 29426 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s user 0.001s sys 0.010s
W20260203 09:17:35.335847 29426 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s user 0.001s sys 0.010s
I20260203 09:17:35.336078 28852 leader_election.cc:304] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
W20260203 09:17:35.336422 29425 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s user 0.004s sys 0.008s
W20260203 09:17:35.338073 29425 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s user 0.004s sys 0.008s
W20260203 09:17:35.338352 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 562681us
I20260203 09:17:35.339165 30496 raft_consensus.cc:2804] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:35.337608 30516 raft_consensus.cc:493] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:35.340529 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:35.344973 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:35.345423 28809 raft_consensus.cc:2468] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 3.
I20260203 09:17:35.345503 28812 raft_consensus.cc:2468] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:35.340606 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:35.343497 30494 raft_consensus.cc:493] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:35.340757 30496 raft_consensus.cc:493] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:35.350114 30494 raft_consensus.cc:515] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:35.352231 30494 leader_election.cc:290] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:35.343609 30432 raft_consensus.cc:493] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:35.352969 30496 raft_consensus.cc:3060] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:35.353420 30432 raft_consensus.cc:515] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:35.316087 30470 raft_consensus.cc:515] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:35.354569 30322 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s user 0.003s sys 0.007s
W20260203 09:17:35.354915 30322 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s user 0.003s sys 0.007s
I20260203 09:17:35.355423 30432 leader_election.cc:290] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:35.340003 30487 raft_consensus.cc:493] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:35.356660 30487 raft_consensus.cc:515] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:35.341565 30516 raft_consensus.cc:515] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:35.342700 28851 leader_election.cc:304] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:35.363387 30405 raft_consensus.cc:2749] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260203 09:17:35.362061 30487 leader_election.cc:290] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:35.366118 30516 leader_election.cc:290] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:35.367105 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:35.367931 28811 raft_consensus.cc:2393] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
W20260203 09:17:35.368428 30358 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.753s user 0.031s sys 0.045s
W20260203 09:17:35.369773 30358 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s user 0.031s sys 0.045s
I20260203 09:17:35.371737 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:35.372447 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:35.381507 28811 raft_consensus.cc:2393] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:35.375648 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:35.384574 28806 raft_consensus.cc:2468] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:35.383100 28735 raft_consensus.cc:2468] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 5.
I20260203 09:17:35.375260 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:35.383978 28812 raft_consensus.cc:2468] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:35.374850 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fabfb779b8894cf0b22204fe12768dc3" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:35.329504 30423 leader_election.cc:290] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:35.283052 30411 raft_consensus.cc:493] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:35.295061 30342 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s user 0.012s sys 0.027s
I20260203 09:17:35.388444 28729 raft_consensus.cc:2468] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:35.434888 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fabfb779b8894cf0b22204fe12768dc3" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:35.407387 28851 leader_election.cc:400] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Vote denied by peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627) with higher term. Message: Invalid argument: T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 4. Current term is 5.
I20260203 09:17:35.397785 28852 leader_election.cc:304] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:35.401304 28700 leader_election.cc:304] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:35.438215 28851 leader_election.cc:403] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260203 09:17:35.211340 30473 raft_consensus.cc:515] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:35.439739 28700 leader_election.cc:304] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
W20260203 09:17:35.403483 28885 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.879s user 0.013s sys 0.029s
I20260203 09:17:35.441004 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:35.435264 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
W20260203 09:17:35.441345 28885 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.920s user 0.013s sys 0.030s
I20260203 09:17:35.441674 28736 raft_consensus.cc:3060] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:35.404321 30470 leader_election.cc:290] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:35.445389 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:35.446038 28806 raft_consensus.cc:2468] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:35.297989 30392 raft_consensus.cc:2804] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260203 09:17:35.335309 28804 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.721s user 0.003s sys 0.008s
I20260203 09:17:35.444110 28730 raft_consensus.cc:2468] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:35.300292 30449 leader_election.cc:290] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:35.456817 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:17:35.436563 30342 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s user 0.012s sys 0.028s
I20260203 09:17:35.457440 28732 raft_consensus.cc:2468] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 3.
I20260203 09:17:35.386853 30492 raft_consensus.cc:515] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:35.427431 30408 consensus_meta.cc:287] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc: Time spent flushing consensus metadata: real 0.542s user 0.009s sys 0.000s
I20260203 09:17:35.255029 30133 raft_consensus.cc:515] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:35.449278 28852 leader_election.cc:304] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:35.454378 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:35.289729 30420 raft_consensus.cc:515] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:35.297670 30397 raft_consensus.cc:515] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:35.235296 30495 leader_election.cc:290] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:35.287868 30486 raft_consensus.cc:515] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:35.459865 29425 leader_election.cc:304] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:35.411303 28881 raft_consensus.cc:2468] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
I20260203 09:17:35.456287 30344 raft_consensus.cc:2804] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election won for term 5
I20260203 09:17:35.464509 28700 leader_election.cc:304] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:35.271735 30422 raft_consensus.cc:515] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:35.498059 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 48864.1us
I20260203 09:17:35.456751 30314 raft_consensus.cc:2804] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260203 09:17:35.462800 30460 consensus_meta.cc:287] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a: Time spent flushing consensus metadata: real 0.798s user 0.011s sys 0.000s
I20260203 09:17:35.550750 28810 raft_consensus.cc:2468] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
W20260203 09:17:35.555342 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 95555us
I20260203 09:17:35.450067 30392 raft_consensus.cc:493] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:35.484341 28736 raft_consensus.cc:2468] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 5.
W20260203 09:17:35.551609 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 87170.5us
W20260203 09:17:35.549152 28854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:35.452610 30516 raft_consensus.cc:493] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
W20260203 09:17:35.551981 28701 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.882s user 0.024s sys 0.028s
W20260203 09:17:35.554867 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 147817us
W20260203 09:17:35.452958 28804 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.838s user 0.004s sys 0.008s
I20260203 09:17:35.556524 29425 leader_election.cc:304] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
W20260203 09:17:35.576108 28701 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.906s user 0.027s sys 0.029s
W20260203 09:17:35.576508 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 906913us
W20260203 09:17:35.550980 28887 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s user 0.015s sys 0.009s
I20260203 09:17:35.462126 30470 raft_consensus.cc:2804] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:35.462337 30423 raft_consensus.cc:493] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:35.491161 30282 leader_election.cc:290] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:35.577838 28887 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s user 0.015s sys 0.009s
W20260203 09:17:35.477978 30425 consensus_meta.cc:287] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc: Time spent flushing consensus metadata: real 0.703s user 0.012s sys 0.000s
I20260203 09:17:35.554471 30314 raft_consensus.cc:493] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:35.585829 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:35.556331 30342 raft_consensus.cc:2804] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260203 09:17:35.562156 30254 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.607s user 0.005s sys 0.020s
I20260203 09:17:35.440138 30411 raft_consensus.cc:515] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:35.501780 30482 raft_consensus.cc:2804] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260203 09:17:35.556609 30452 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.443s user 0.010s sys 0.020s
I20260203 09:17:35.587749 30433 raft_consensus.cc:493] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:35.588286 30471 raft_consensus.cc:2804] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:35.588488 30489 raft_consensus.cc:493] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:35.588903 30358 raft_consensus.cc:493] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:35.589211 30400 leader_election.cc:290] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:35.619442 30471 raft_consensus.cc:493] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:35.559448 30460 raft_consensus.cc:515] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:35.589646 30463 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:35.588775 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:35.589658 30443 raft_consensus.cc:493] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:35.615520 30452 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.505s user 0.010s sys 0.020s
W20260203 09:17:35.612298 30442 consensus_meta.cc:287] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a: Time spent flushing consensus metadata: real 0.730s user 0.004s sys 0.007s
I20260203 09:17:35.598937 30478 raft_consensus.cc:493] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:35.619344 30397 leader_election.cc:290] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:35.451707 30496 raft_consensus.cc:515] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:35.606261 30254 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.654s user 0.006s sys 0.020s
I20260203 09:17:35.585664 30361 raft_consensus.cc:2804] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:35.588828 30219 raft_consensus.cc:3055] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:35.594164 30314 raft_consensus.cc:3060] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:35.561969 30392 raft_consensus.cc:3060] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:35.594792 30342 raft_consensus.cc:493] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260203 09:17:35.612743 30515 log.cc:927] Time spent T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.059s user 0.000s sys 0.001s
I20260203 09:17:35.568086 30344 raft_consensus.cc:697] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 5 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:35.610153 30481 leader_election.cc:290] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:35.629829 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:35.632186 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:35.619657 30498 raft_consensus.cc:493] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:35.723097 28732 raft_consensus.cc:3060] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:35.723060 29464 raft_consensus.cc:2468] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:35.681113 30250 raft_consensus.cc:493] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:35.582131 30516 raft_consensus.cc:515] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:35.609607 30482 raft_consensus.cc:493] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260203 09:17:35.623530 28880 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.091s user 0.029s sys 0.057s
I20260203 09:17:35.585386 30423 raft_consensus.cc:515] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:35.618192 30487 consensus_queue.cc:1059] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
W20260203 09:17:35.682546 30441 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.871s user 0.022s sys 0.043s
W20260203 09:17:35.727959 30518 log.cc:927] Time spent T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.127s user 0.000s sys 0.001s
I20260203 09:17:35.632344 30442 raft_consensus.cc:2749] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:35.686494 30492 leader_election.cc:290] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:35.727713 30504 raft_consensus.cc:476] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Not starting pre-election -- already a leader
I20260203 09:17:35.732049 30344 consensus_queue.cc:237] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:35.732796 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:35.732941 30397 raft_consensus.cc:493] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:35.733322 30486 leader_election.cc:290] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:35.622907 30358 raft_consensus.cc:515] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:35.733741 30517 log.cc:927] Time spent T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.152s user 0.000s sys 0.000s
I20260203 09:17:35.630136 30443 raft_consensus.cc:515] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:35.632845 30463 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:35.623181 30433 raft_consensus.cc:515] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:35.684301 30494 raft_consensus.cc:493] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:35.686571 28804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36404 (request call id 1209) took 1366 ms. Trace:
I20260203 09:17:35.687441 30361 raft_consensus.cc:493] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:35.691721 30219 raft_consensus.cc:740] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:35.619946 30471 raft_consensus.cc:3060] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:35.965162 29457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53326 (request call id 468) took 1515 ms. Trace:
I20260203 09:17:35.880357 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:35.965617 29457 rpcz_store.cc:276] 0203 09:17:34.449626 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:34.451362 (+ 1736us) service_pool.cc:225] Handling call
0203 09:17:35.026870 (+575508us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b580023f798. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd0b478b1 00007f2cd0cc9db1 00007f2cd0cca12e 000000000035a3c9 00007f2cd8cf4560 00007f2cd8dbcdd4 00007f2cd8dbce41 00007f2cd8d7eaf0 00007f2cd8d69459 00007f2cd8d68f02 00007f2cd22f5d34
0203 09:17:35.027081 (+ 211us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:35.027346 (+ 265us) raft_consensus.cc:1534] Early marking committed up to index 4
0203 09:17:35.720699 (+693353us) log.cc:844] Serialized 14 byte log entry
0203 09:17:35.880282 (+159583us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:35.926987 (+ 46705us) raft_consensus.cc:1645] Marking committed up to 4
0203 09:17:35.959943 (+ 32956us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:35.964818 (+ 4875us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:35.965024 (+ 206us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":180,"spinlock_wait_cycles":134117888,"thread_start_us":131464,"threads_started":1,"wal-append.queue_time_us":157391}
I20260203 09:17:35.741253 28732 raft_consensus.cc:2468] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
W20260203 09:17:35.741433 28777 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s user 0.000s sys 0.020s
W20260203 09:17:35.968922 28777 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s user 0.000s sys 0.021s
W20260203 09:17:35.969242 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 763827us
W20260203 09:17:35.743698 28702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260203 09:17:35.972766 29459 consensus_meta.cc:287] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a: Time spent flushing consensus metadata: real 0.941s user 0.011s sys 0.000s
I20260203 09:17:35.973196 29459 raft_consensus.cc:2468] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:35.973706 30282 raft_consensus.cc:493] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
W20260203 09:17:35.973961 29459 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53326 (request call id 470) took 1517 ms (client timeout 1677 ms). Trace:
I20260203 09:17:35.720129 30342 raft_consensus.cc:3060] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:17:35.752856 28852 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260203 09:17:35.745426 30431 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.112s user 0.044s sys 0.084s
W20260203 09:17:35.760978 29427 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.777s user 0.026s sys 0.042s
W20260203 09:17:35.741626 28880 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.209s user 0.030s sys 0.057s
I20260203 09:17:35.626188 30489 raft_consensus.cc:515] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:35.762205 28882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40958 (request call id 1262) took 1186 ms. Trace:
I20260203 09:17:35.764010 29426 leader_election.cc:304] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:17:35.745131 30441 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.936s user 0.023s sys 0.044s
I20260203 09:17:35.741806 30482 raft_consensus.cc:3060] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:35.738838 30519 raft_consensus.cc:493] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:35.745250 30420 leader_election.cc:290] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:35.761615 30476 raft_consensus.cc:3060] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 5
I20260203 09:17:35.750171 30133 leader_election.cc:290] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:35.978116 30133 raft_consensus.cc:493] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:35.978602 30133 raft_consensus.cc:515] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:35.979671 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:35.980402 28881 raft_consensus.cc:2468] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
I20260203 09:17:35.981083 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:35.981541 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b6f1d6e275f4a8ba99a70dbb3ea3235" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:35.982126 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:35.763473 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:35.799878 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:35.682337 30478 raft_consensus.cc:515] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:35.767464 30473 leader_election.cc:290] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:35.984562 28852 leader_election.cc:304] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:35.982715 28883 raft_consensus.cc:2468] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:17:35.785811 30495 raft_consensus.cc:493] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:35.741107 30250 raft_consensus.cc:515] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:35.872565 29465 raft_consensus.cc:2393] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 2: Already voted for candidate cf00f643e7da4a98a0a11ea92869c24a in this term.
I20260203 09:17:35.785635 30422 leader_election.cc:290] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:35.868225 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 65856.3us
W20260203 09:17:35.866824 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 280503us
W20260203 09:17:35.862897 30483 log.cc:927] Time spent T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.075s user 0.000s sys 0.001s
I20260203 09:17:35.960222 30361 raft_consensus.cc:3060] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:35.856232 30497 raft_consensus.cc:493] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
W20260203 09:17:35.682711 30477 log.cc:927] Time spent T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.063s user 0.000s sys 0.000s
I20260203 09:17:35.983507 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "021e904a783c4cbc96e5aa625a34a2d8" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:35.864713 30411 leader_election.cc:290] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:35.983665 29427 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.209s user 0.027s sys 0.043s
I20260203 09:17:35.983310 28812 raft_consensus.cc:2468] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:35.982787 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:35.993604 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:35.997339 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 233427us
I20260203 09:17:35.793006 30397 raft_consensus.cc:515] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:35.741897 30498 raft_consensus.cc:515] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.002558 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:36.064121 28732 raft_consensus.cc:3060] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:35.974640 30282 raft_consensus.cc:515] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:35.879623 30522 raft_consensus.cc:493] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:35.872900 30470 raft_consensus.cc:493] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:35.983949 28882 rpcz_store.cc:276] 0203 09:17:34.575623 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:34.575747 (+ 124us) service_pool.cc:225] Handling call
0203 09:17:34.576053 (+ 306us) raft_consensus.cc:1471] Updating replica for 1 ops
0203 09:17:34.668799 (+ 92746us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:34.668826 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0203 09:17:34.749347 (+ 80521us) log.cc:844] Serialized 26 byte log entry
0203 09:17:35.083703 (+334356us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b1800339d60. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd9b5bc91 00007f2cd9b68671 00007f2cd0ce9c67 00007f2cd9ad2709 00007f2cd0d0657b 00007f2cd0d0481f 00007f2cd0d06ae2 00007f2cd394e5ab 00007f2cd39540c3 00007f2cd3954471 00007f2cd3d7073f
0203 09:17:35.369686 (+285983us) raft_consensus.cc:1645] Marking committed up to 5
0203 09:17:35.369776 (+ 90us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:35.369859 (+ 83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0203 09:17:35.735686 (+365827us) raft_consensus.cc:1685] finished
0203 09:17:35.735708 (+ 22us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:35.762123 (+ 26415us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6966,"raft.queue_time_us":173765,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":10388,"spinlock_wait_cycles":5436800,"thread_start_us":378168,"threads_started":2,"wal-append.queue_time_us":695538}
I20260203 09:17:36.031148 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:35.985033 30431 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.352s user 0.044s sys 0.084s
I20260203 09:17:36.070663 28888 raft_consensus.cc:2468] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:36.070807 30431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:40930 (request call id 752) took 3255 ms. Trace:
W20260203 09:17:36.036033 28777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:35.980500 30133 leader_election.cc:290] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:35.960816 30492 raft_consensus.cc:493] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
W20260203 09:17:36.045717 30468 consensus_meta.cc:287] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a: Time spent flushing consensus metadata: real 1.174s user 0.008s sys 0.004s
I20260203 09:17:36.036106 30274 raft_consensus.cc:493] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:35.963148 30494 raft_consensus.cc:515] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:35.992342 30481 raft_consensus.cc:493] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:36.048005 28700 leader_election.cc:304] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:36.028318 30472 raft_consensus.cc:2749] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:36.050535 28884 raft_consensus.cc:1275] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260203 09:17:35.999899 30476 raft_consensus.cc:2749] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627) with higher term. Message: Invalid argument: T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 4. Current term is 5.
I20260203 09:17:36.000558 30460 leader_election.cc:290] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:36.045168 30390 consensus_meta.cc:287] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent flushing consensus metadata: real 0.953s user 0.011s sys 0.000s
I20260203 09:17:36.035173 30425 raft_consensus.cc:2804] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:36.035799 30422 raft_consensus.cc:493] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:36.031147 30408 raft_consensus.cc:493] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:36.078867 28777 leader_election.cc:304] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:36.042157 30420 raft_consensus.cc:493] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:36.082835 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:35.974078 30219 consensus_queue.cc:260] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:36.086516 28885 raft_consensus.cc:2468] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 3.
I20260203 09:17:36.056063 30491 raft_consensus.cc:493] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:36.028249 30495 raft_consensus.cc:515] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.052871 30496 leader_election.cc:290] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:36.089785 30506 consensus_queue.cc:1059] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260203 09:17:36.131286 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:36.083174 30468 raft_consensus.cc:515] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.089674 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:36.079044 28880 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40946 (request call id 1190) took 2606 ms. Trace:
W20260203 09:17:36.134927 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 56188.9us
I20260203 09:17:36.133039 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:36.066296 30461 raft_consensus.cc:493] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:36.044751 30500 raft_consensus.cc:493] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:36.054136 28733 raft_consensus.cc:2468] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:36.142403 28732 raft_consensus.cc:2468] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:36.203866 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b2c469d7255413d9f61a7cbaa4481a7" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:36.086874 30133 raft_consensus.cc:493] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:36.204342 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:17:35.974689 29459 rpcz_store.cc:269] 0203 09:17:34.456487 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:34.459249 (+ 2762us) service_pool.cc:225] Handling call
0203 09:17:35.014580 (+555331us) spinlock_profiling.cc:243] Waited 6.77 ms on lock 0x7b580023f798. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd0b478b1 00007f2cd0cc9db1 00007f2cd0cc9c62 00007f2cd9b74dd9 00007f2cd8cf4260 00007f2cd8dbcdbb 00007f2cd8dbce41 00007f2cd8d6abd0 00007f2cd8d6a4b4 00007f2cd22fa834 00007f2cd22fa7c2
0203 09:17:35.973802 (+959222us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":15563648}
I20260203 09:17:36.090319 28700 leader_election.cc:304] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
W20260203 09:17:36.205312 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 115085us
W20260203 09:17:36.091809 28851 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.232.68:40627 timed out after 1.677s (SENT) [suppressed 71 similar messages]
I20260203 09:17:35.996484 30519 raft_consensus.cc:515] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.208339 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:36.070530 30524 consensus_queue.cc:1059] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260203 09:17:36.137228 30425 raft_consensus.cc:697] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 3 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:36.090893 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:36.073966 30411 raft_consensus.cc:493] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:36.132218 30364 raft_consensus.cc:2804] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:36.193979 28776 leader_election.cc:304] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:36.194602 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:36.132040 30390 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:36.196349 30471 raft_consensus.cc:515] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.197288 30358 leader_election.cc:290] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:36.207391 30464 raft_consensus.cc:493] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:36.072436 30470 raft_consensus.cc:3060] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:36.208353 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:36.212085 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "021e904a783c4cbc96e5aa625a34a2d8" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:36.153051 30420 raft_consensus.cc:515] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:36.215178 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:36.215415 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:36.144863 30423 leader_election.cc:290] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:36.149333 30481 raft_consensus.cc:515] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.220500 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:36.044574 30497 raft_consensus.cc:515] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:36.226820 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:36.264312 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:36.264659 29462 raft_consensus.cc:2468] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:36.083371 30492 raft_consensus.cc:515] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:36.225891 28731 raft_consensus.cc:2468] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
I20260203 09:17:36.086879 30274 raft_consensus.cc:515] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.235293 28734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:36.237094 30441 raft_consensus.cc:493] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:36.237983 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b6f1d6e275f4a8ba99a70dbb3ea3235" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:36.215885 30506 raft_consensus.cc:493] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:36.186527 30422 raft_consensus.cc:515] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:36.239177 30489 leader_election.cc:290] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:36.216954 30133 raft_consensus.cc:515] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:36.263563 30507 log.cc:927] Time spent T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.394s user 0.000s sys 0.001s
I20260203 09:17:35.927421 28804 rpcz_store.cc:276] 0203 09:17:34.265765 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:34.269390 (+ 3625us) service_pool.cc:225] Handling call
0203 09:17:34.279207 (+ 9817us) raft_consensus.cc:1471] Updating replica for 1 ops
0203 09:17:34.279636 (+ 429us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:34.279681 (+ 45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0203 09:17:34.321320 (+ 41639us) log.cc:844] Serialized 26 byte log entry
0203 09:17:34.506256 (+184936us) raft_consensus.cc:1645] Marking committed up to 5
0203 09:17:35.585530 (+1079274us) log.cc:844] Serialized 14 byte log entry
0203 09:17:35.615238 (+ 29708us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:35.620565 (+ 5327us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0203 09:17:35.622941 (+ 2376us) raft_consensus.cc:1685] finished
0203 09:17:35.622961 (+ 20us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:35.632418 (+ 9457us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":102712,"prepare.queue_time_us":154678,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":6489,"raft.run_cpu_time_us":436,"raft.run_wall_time_us":22348,"thread_start_us":1039368,"threads_started":2,"wal-append.queue_time_us":228529}
W20260203 09:17:36.243065 30446 consensus_meta.cc:287] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent flushing consensus metadata: real 1.008s user 0.009s sys 0.003s
W20260203 09:17:36.244314 30421 consensus_meta.cc:287] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent flushing consensus metadata: real 1.160s user 0.007s sys 0.004s
I20260203 09:17:36.155973 30408 raft_consensus.cc:515] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.071228 30431 rpcz_store.cc:276] 0203 09:17:32.827254 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:32.846213 (+ 18959us) service_pool.cc:225] Handling call
0203 09:17:32.864017 (+ 17804us) log.cc:844] Serialized 501 byte log entry
0203 09:17:33.301854 (+437837us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b540021c198. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3d714ec 00007f2cd3d73ff0 00007f2cd3d73f78 00007f2cd3d73ef8 00007f2cd3d73eb3 00007f2cd3d7317c 00007f2cd9beba36 00007f2cd9be61e8 00007f2cd395bee1 00007f2cd394f2ca
0203 09:17:36.070714 (+2768860us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1285,"raft.run_cpu_time_us":1022,"raft.run_wall_time_us":1022,"spinlock_wait_cycles":47281024,"thread_start_us":282974,"threads_started":1,"wal-append.queue_time_us":343757,"wal-append.run_cpu_time_us":4672,"wal-append.run_wall_time_us":1094511}
I20260203 09:17:36.245723 30462 raft_consensus.cc:493] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:36.205965 30491 raft_consensus.cc:515] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:36.248921 30521 log.cc:927] Time spent T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.245s user 0.000s sys 0.001s
W20260203 09:17:36.249639 30510 log.cc:927] Time spent T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.254s user 0.000s sys 0.000s
I20260203 09:17:36.228770 30364 raft_consensus.cc:493] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:36.190032 28880 rpcz_store.cc:276] 0203 09:17:33.462471 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:33.465240 (+ 2769us) service_pool.cc:225] Handling call
0203 09:17:33.490275 (+ 25035us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:33.490463 (+ 188us) raft_consensus.cc:1534] Early marking committed up to index 5
0203 09:17:34.532329 (+1041866us) log.cc:844] Serialized 14 byte log entry
0203 09:17:36.026764 (+1494435us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:36.032470 (+ 5706us) raft_consensus.cc:1645] Marking committed up to 5
0203 09:17:36.039648 (+ 7178us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:36.044459 (+ 4811us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:36.065542 (+ 21083us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":30109,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":7493,"spinlock_wait_cycles":15616,"thread_start_us":1452395,"threads_started":1,"wal-append.queue_time_us":1240003}
I20260203 09:17:36.210320 30461 raft_consensus.cc:515] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.133461 30522 raft_consensus.cc:515] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:36.254191 29461 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:36.254825 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:36.257428 28888 raft_consensus.cc:2468] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
W20260203 09:17:36.266420 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 75661us
I20260203 09:17:36.361533 28777 leader_election.cc:304] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:36.262456 30390 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.273048 28889 raft_consensus.cc:2468] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 5.
I20260203 09:17:36.154479 30516 leader_election.cc:290] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:36.275573 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:36.278280 30411 raft_consensus.cc:515] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.286186 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:36.242915 30495 leader_election.cc:290] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:36.289363 28805 raft_consensus.cc:1240] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Rejecting Update request from peer 77541303e1934638ba82f0f43f707adc for earlier term 1. Current term is 2. Ops: []
I20260203 09:17:36.352094 30364 raft_consensus.cc:3060] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:36.305989 28852 leader_election.cc:304] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:36.260087 30443 leader_election.cc:290] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:36.318183 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:36.215785 30425 consensus_queue.cc:237] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:36.319620 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 227821us
W20260203 09:17:36.372205 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 66666.7us
W20260203 09:17:36.322010 28776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 128123us
I20260203 09:17:36.325333 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:36.281319 30423 raft_consensus.cc:493] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:36.329908 28809 raft_consensus.cc:3060] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:36.371268 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:36.332437 30509 log.cc:927] Time spent T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.326s user 0.001s sys 0.000s
I20260203 09:17:36.288388 30463 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:36.343143 28701 leader_election.cc:304] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:36.307183 30506 raft_consensus.cc:515] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.346145 30540 raft_consensus.cc:2804] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:36.346428 30494 leader_election.cc:290] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:36.358093 30536 raft_consensus.cc:493] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:36.308485 30496 raft_consensus.cc:493] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:36.210065 30500 raft_consensus.cc:515] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.352481 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:36.335440 30489 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:36.370476 30516 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:36.341584 30449 raft_consensus.cc:493] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:36.289958 30441 raft_consensus.cc:515] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:36.367024 28777 leader_election.cc:304] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:36.290109 29463 raft_consensus.cc:2368] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for earlier term 3. Current term is 4.
I20260203 09:17:36.287482 30464 raft_consensus.cc:515] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:36.373589 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:36.430688 28811 raft_consensus.cc:3060] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:36.357440 30519 leader_election.cc:290] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:36.345715 30433 leader_election.cc:290] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:36.379550 28813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36404 (request call id 1223) took 1044 ms. Trace:
I20260203 09:17:36.381618 28776 leader_election.cc:304] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
W20260203 09:17:36.383607 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 319267us
I20260203 09:17:36.343475 30462 raft_consensus.cc:515] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:36.402817 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:36.386118 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:36.389784 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:36.397325 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:36.346958 28734 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
W20260203 09:17:36.373196 30514 log.cc:927] Time spent T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.461s user 0.000s sys 0.001s
I20260203 09:17:36.369371 29461 raft_consensus.cc:2468] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:36.371205 30539 raft_consensus.cc:493] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
W20260203 09:17:36.482502 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 105513us
I20260203 09:17:36.372115 30421 raft_consensus.cc:2804] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:36.396512 28619 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 3a09fae92b37497d8efa250f727c0fd9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:36.378026 30344 raft_consensus.cc:2804] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:36.408674 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:36.394055 30468 leader_election.cc:290] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:36.414202 30533 raft_consensus.cc:493] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:36.414937 30529 log.cc:927] Time spent T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a: Append to log took a long time: real 0.302s user 0.001s sys 0.001s
I20260203 09:17:36.415455 30534 raft_consensus.cc:2804] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:36.415762 30461 leader_election.cc:290] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:36.416117 30538 raft_consensus.cc:493] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:36.426642 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 59701.4us
I20260203 09:17:36.504230 28777 leader_election.cc:304] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:36.505707 28777 leader_election.cc:304] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:36.507138 28777 leader_election.cc:304] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:36.380031 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:36.397877 30133 leader_election.cc:290] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:36.399143 30314 consensus_meta.cc:287] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e: Time spent flushing consensus metadata: real 0.662s user 0.005s sys 0.006s
I20260203 09:17:36.362455 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:17:36.386564 30465 raft_consensus.cc:493] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:36.386242 28806 raft_consensus.cc:2393] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 2: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
W20260203 09:17:36.467141 30528 log.cc:927] Time spent T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a: Append to log took a long time: real 0.216s user 0.000s sys 0.001s
I20260203 09:17:36.471241 29465 raft_consensus.cc:2468] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:36.471385 28888 raft_consensus.cc:2468] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:36.441215 28813 rpcz_store.cc:276] 0203 09:17:35.334786 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:35.334939 (+ 153us) service_pool.cc:225] Handling call
0203 09:17:35.335293 (+ 354us) raft_consensus.cc:1471] Updating replica for 1 ops
0203 09:17:35.335541 (+ 248us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:35.335566 (+ 25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0203 09:17:35.410384 (+ 74818us) log.cc:844] Serialized 26 byte log entry
0203 09:17:35.742762 (+332378us) raft_consensus.cc:1645] Marking committed up to 2
0203 09:17:35.742799 (+ 37us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:35.742874 (+ 75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0203 09:17:36.379348 (+636474us) raft_consensus.cc:1685] finished
0203 09:17:36.379370 (+ 22us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:36.379492 (+ 122us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":244428,"threads_started":1,"wal-append.queue_time_us":403229}
I20260203 09:17:36.135694 29458 raft_consensus.cc:2955] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:36.397961 30540 raft_consensus.cc:493] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:36.476814 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:36.398553 30497 leader_election.cc:290] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:36.426776 30525 raft_consensus.cc:2804] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:36.416280 30463 raft_consensus.cc:493] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
W20260203 09:17:36.481015 28776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 99468.7us
I20260203 09:17:36.392254 30423 raft_consensus.cc:515] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.484783 29426 leader_election.cc:304] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
W20260203 09:17:36.483843 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 140799us
I20260203 09:17:36.397687 30482 raft_consensus.cc:515] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:36.397408 30446 consensus_queue.cc:1048] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260203 09:17:36.411226 30496 raft_consensus.cc:515] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:36.491034 28619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 94535.7us
I20260203 09:17:36.471463 30397 leader_election.cc:290] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:36.414242 30470 raft_consensus.cc:515] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:36.406546 30536 raft_consensus.cc:515] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.485775 30519 raft_consensus.cc:2804] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:36.480779 30494 raft_consensus.cc:493] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:36.496204 28734 raft_consensus.cc:2393] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 3: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:36.476677 30358 raft_consensus.cc:493] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:36.556242 30411 leader_election.cc:290] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:36.558863 30358 raft_consensus.cc:515] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.428797 30489 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.482215 30420 leader_election.cc:290] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:36.465319 30449 raft_consensus.cc:515] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.565399 30464 leader_election.cc:290] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:36.481875 28880 raft_consensus.cc:2468] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:36.566776 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:36.567157 30361 consensus_meta.cc:287] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a: Time spent flushing consensus metadata: real 0.523s user 0.010s sys 0.001s
I20260203 09:17:36.567375 28880 raft_consensus.cc:2468] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:36.466336 30516 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:36.490748 30421 raft_consensus.cc:493] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:36.492156 30492 leader_election.cc:290] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:36.521908 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:36.441159 30544 raft_consensus.cc:2804] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:36.521106 28851 leader_election.cc:304] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:36.525664 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:36.530038 28776 leader_election.cc:304] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:36.531417 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:36.533355 30542 raft_consensus.cc:2804] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:36.503294 30344 raft_consensus.cc:697] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 3 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
W20260203 09:17:36.535434 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 50736.9us
I20260203 09:17:36.541543 28811 raft_consensus.cc:2468] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 5.
I20260203 09:17:36.542098 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:36.592999 28776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 63032.4us
I20260203 09:17:36.554792 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47301e2bbfc94767a9905b0e12141d6d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:36.549554 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:36.513554 30462 leader_election.cc:290] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:36.515677 30534 raft_consensus.cc:493] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:36.515964 28804 raft_consensus.cc:2468] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:36.553951 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:36.609347 28738 raft_consensus.cc:2468] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 4.
I20260203 09:17:36.525179 30540 raft_consensus.cc:3060] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:36.537519 30497 raft_consensus.cc:493] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:36.561059 28731 raft_consensus.cc:2468] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:36.561600 28884 raft_consensus.cc:2393] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 3: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:36.516172 30314 raft_consensus.cc:515] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:36.524426 30538 raft_consensus.cc:515] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:36.563946 30358 leader_election.cc:290] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:36.620090 28887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40946 (request call id 1203) took 2443 ms. Trace:
I20260203 09:17:36.570480 28737 raft_consensus.cc:2468] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:36.544744 30463 raft_consensus.cc:515] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.630653 30463 leader_election.cc:290] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:36.545168 30468 raft_consensus.cc:2804] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader election won for term 5
I20260203 09:17:36.567857 30361 raft_consensus.cc:515] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.632146 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:36.633984 30361 leader_election.cc:290] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
W20260203 09:17:36.634722 30392 consensus_meta.cc:287] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent flushing consensus metadata: real 0.899s user 0.011s sys 0.000s
I20260203 09:17:36.635426 30392 raft_consensus.cc:515] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:36.637621 28883 raft_consensus.cc:1275] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:17:36.620541 28887 rpcz_store.cc:276] 0203 09:17:34.176423 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:34.176703 (+ 280us) service_pool.cc:225] Handling call
0203 09:17:34.191390 (+ 14687us) raft_consensus.cc:1471] Updating replica for 1 ops
0203 09:17:35.016882 (+825492us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b180020afa0. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd9b5bc91 00007f2cd9b68671 00007f2cd395c85c 00007f2cd0cea2eb 00007f2cd9ad2709 00007f2cd0d0657b 00007f2cd0d0481f 00007f2cd0d04335 00007f2cd3dacce0 00007f2cd3dad87b 00007f2cd3db82cb
0203 09:17:35.017005 (+ 123us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:35.017030 (+ 25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0203 09:17:35.017480 (+ 450us) log.cc:844] Serialized 26 byte log entry
0203 09:17:35.585168 (+567688us) raft_consensus.cc:1645] Marking committed up to 1
0203 09:17:35.598799 (+ 13631us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:35.599212 (+ 413us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0203 09:17:36.612426 (+1013214us) raft_consensus.cc:1685] finished
0203 09:17:36.612450 (+ 24us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:36.620013 (+ 7563us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":65398,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":4489,"spinlock_wait_cycles":7764736,"thread_start_us":646046,"threads_started":2,"wal-append.queue_time_us":602520}
W20260203 09:17:36.555636 30466 consensus_meta.cc:287] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc: Time spent flushing consensus metadata: real 1.463s user 0.013s sys 0.000s
I20260203 09:17:36.493782 30539 raft_consensus.cc:515] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.577991 30532 raft_consensus.cc:2749] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260203 09:17:36.580717 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 59681us
I20260203 09:17:36.580942 29465 raft_consensus.cc:2468] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
W20260203 09:17:36.581463 30545 log.cc:927] Time spent T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.085s user 0.000s sys 0.000s
I20260203 09:17:36.550596 30408 leader_election.cc:290] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:36.582187 30506 leader_election.cc:290] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:36.585811 30489 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:36.578959 30421 raft_consensus.cc:3060] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:36.582804 30544 raft_consensus.cc:493] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:36.579769 28813 raft_consensus.cc:2468] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:36.607398 30542 raft_consensus.cc:493] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:36.578732 30516 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:36.589687 30482 leader_election.cc:290] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:36.509354 30422 leader_election.cc:290] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:36.679543 28807 raft_consensus.cc:1240] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 3. Current term is 4. Ops: []
I20260203 09:17:36.495846 30342 raft_consensus.cc:515] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:36.595602 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:36.681150 28811 raft_consensus.cc:2468] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:36.560256 30519 raft_consensus.cc:493] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:36.597864 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:36.584394 30449 leader_election.cc:290] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:36.602072 29462 raft_consensus.cc:1813] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Handling vote request from an unknown peer be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:36.524781 30533 raft_consensus.cc:515] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:36.615077 30531 log.cc:927] Time spent T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.116s user 0.000s sys 0.000s
I20260203 09:17:36.670035 30544 raft_consensus.cc:3060] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:36.686671 29462 raft_consensus.cc:2410] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260203 09:17:36.615443 30133 raft_consensus.cc:2804] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:36.615813 29461 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:36.690665 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:36.624543 30344 consensus_queue.cc:237] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:36.625279 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:36.693928 29459 raft_consensus.cc:2468] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:36.627571 30314 leader_election.cc:290] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:36.617108 30400 raft_consensus.cc:2804] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:36.591418 30464 raft_consensus.cc:2749] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:36.569350 30494 raft_consensus.cc:515] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.573592 28809 raft_consensus.cc:2468] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:36.612972 30534 raft_consensus.cc:3060] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:36.525322 30465 raft_consensus.cc:515] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.584426 30441 leader_election.cc:290] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:36.687065 30519 raft_consensus.cc:3060] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:36.657862 28888 raft_consensus.cc:2468] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:36.614650 30390 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:36.586915 28880 raft_consensus.cc:1275] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260203 09:17:36.627781 30525 raft_consensus.cc:493] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:36.678010 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:36.682408 30446 raft_consensus.cc:2749] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:36.722219 30478 leader_election.cc:290] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:36.692463 30542 raft_consensus.cc:3060] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:36.697355 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:36.728890 28806 raft_consensus.cc:3060] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:36.621528 30497 raft_consensus.cc:515] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.702142 28732 raft_consensus.cc:2393] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 3: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:36.644274 30491 leader_election.cc:290] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:36.705973 28882 raft_consensus.cc:1240] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:36.630852 30274 leader_election.cc:290] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:36.654516 28776 leader_election.cc:304] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
W20260203 09:17:36.738047 28776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 83616.9us
I20260203 09:17:36.708447 30494 leader_election.cc:290] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:36.715452 30322 raft_consensus.cc:493] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:36.705687 30291 raft_consensus.cc:493] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:36.656251 30468 raft_consensus.cc:697] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 5 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
W20260203 09:17:36.731066 28703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:36.695943 30533 leader_election.cc:290] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:36.696237 30400 raft_consensus.cc:493] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:36.663352 30522 leader_election.cc:290] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:36.708887 30444 raft_consensus.cc:493] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:36.726666 30525 raft_consensus.cc:3060] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:36.745234 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:36.749035 28810 raft_consensus.cc:2468] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 2.
I20260203 09:17:36.750451 29425 leader_election.cc:304] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:36.757030 30547 raft_consensus.cc:2804] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:36.757555 30547 raft_consensus.cc:493] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:36.757925 30547 raft_consensus.cc:3060] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:36.744484 30390 raft_consensus.cc:2804] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:36.753016 30400 raft_consensus.cc:3060] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:36.734011 30550 raft_consensus.cc:493] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:36.755020 30444 raft_consensus.cc:515] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.743713 30496 leader_election.cc:290] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:36.771147 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:36.747373 30423 leader_election.cc:290] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:36.735877 30536 leader_election.cc:290] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:36.781495 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:36.787333 28806 raft_consensus.cc:2468] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:36.786238 30468 consensus_queue.cc:237] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.773432 28804 raft_consensus.cc:2393] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a in current term 4: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:36.751466 30291 raft_consensus.cc:515] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:36.746049 30322 raft_consensus.cc:515] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:36.810014 28886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:40930 (request call id 755) took 2892 ms. Trace:
I20260203 09:17:36.810487 28886 rpcz_store.cc:276] 0203 09:17:33.917188 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:33.918678 (+ 1490us) service_pool.cc:225] Handling call
0203 09:17:36.809472 (+2890794us) spinlock_profiling.cc:243] Waited 2.4 s on lock 0x7b540030f7d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1f0c0 00007f2cd3dbdbba 00007f2cd8d6e58e 00007f2cd230d437 00007f2cd230d3c2 00007f2cd230d2f1 00007f2cd230d26c 00007f2cd230c522 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:36.809910 (+ 438us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5520102784}
I20260203 09:17:36.772377 30390 raft_consensus.cc:493] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:36.832898 28885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59280 (request call id 275) took 1245 ms. Trace:
I20260203 09:17:36.833338 28885 rpcz_store.cc:276] 0203 09:17:35.587704 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:35.588531 (+ 827us) service_pool.cc:225] Handling call
0203 09:17:36.832683 (+1244152us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54001da6d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:36.832828 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1065408768}
I20260203 09:17:36.845150 28729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43612 (request call id 1746) took 1394 ms. Trace:
I20260203 09:17:36.846031 30444 leader_election.cc:290] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:36.845839 28729 rpcz_store.cc:276] 0203 09:17:35.441168 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:35.441331 (+ 163us) service_pool.cc:225] Handling call
0203 09:17:35.460682 (+ 19351us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:35.578162 (+117480us) raft_consensus.cc:1534] Early marking committed up to index 2
0203 09:17:35.773512 (+195350us) log.cc:844] Serialized 14 byte log entry
0203 09:17:35.869970 (+ 96458us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:35.870054 (+ 84us) raft_consensus.cc:1645] Marking committed up to 2
0203 09:17:35.870121 (+ 67us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:36.835788 (+965667us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54002fb2d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db5a81 00007f2cd3db44be 00007f2cd8d68f49 00007f2cd22f5d34 00007f2cd22f5cc2 00007f2cd22f5bf1 00007f2cd22f5b6c 00007f2cd22f4e22 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:36.835835 (+ 47us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:36.835953 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12148,"prepare.queue_time_us":40792,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":777,"raft.queue_time_us":15234,"raft.run_cpu_time_us":4904,"raft.run_wall_time_us":78006,"spinlock_wait_cycles":288754688,"thread_start_us":262758,"threads_started":2,"wal-append.queue_time_us":278131}
I20260203 09:17:36.831139 30536 raft_consensus.cc:493] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:36.865540 30536 raft_consensus.cc:515] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:36.868148 30536 leader_election.cc:290] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:36.799479 30550 raft_consensus.cc:515] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.828995 30390 raft_consensus.cc:3060] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:36.974777 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:36.843598 30342 leader_election.cc:290] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:36.997434 30392 leader_election.cc:290] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:36.994683 28733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43612 (request call id 1750) took 1258 ms. Trace:
I20260203 09:17:37.043552 29462 raft_consensus.cc:2468] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
I20260203 09:17:36.996824 30497 leader_election.cc:290] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:37.036801 30290 raft_consensus.cc:3055] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:37.050559 30254 raft_consensus.cc:3055] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Stepping down as leader of term 2
W20260203 09:17:37.036842 28776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 174499us
I20260203 09:17:37.059032 30422 raft_consensus.cc:493] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
W20260203 09:17:37.063387 28852 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s user 0.019s sys 0.037s
W20260203 09:17:37.038677 30364 consensus_meta.cc:287] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent flushing consensus metadata: real 0.650s user 0.004s sys 0.009s
I20260203 09:17:37.060180 30550 leader_election.cc:290] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:37.071185 28852 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s user 0.019s sys 0.037s
I20260203 09:17:36.974697 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:37.074522 28731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:37.074930 28776 leader_election.cc:304] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:37.057241 30532 raft_consensus.cc:493] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:37.060585 30522 raft_consensus.cc:493] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:37.078665 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:37.079927 28732 raft_consensus.cc:2468] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:37.069072 30290 raft_consensus.cc:740] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:37.068498 30254 raft_consensus.cc:740] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:37.071800 30364 raft_consensus.cc:515] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:37.090045 28852 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:37.069747 30342 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:37.075917 30532 raft_consensus.cc:515] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:37.093259 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:37.093484 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:37.076150 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:37.061645 28733 rpcz_store.cc:276] 0203 09:17:35.736766 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:35.739234 (+ 2468us) service_pool.cc:225] Handling call
0203 09:17:36.994193 (+1254959us) spinlock_profiling.cc:243] Waited 51.4 ms on lock 0x7b540034e754. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:36.994599 (+ 406us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":118322048}
I20260203 09:17:37.086380 30540 raft_consensus.cc:515] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:37.100409 30342 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:37.101543 28730 raft_consensus.cc:2468] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:37.101897 30540 leader_election.cc:290] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:37.086673 30497 raft_consensus.cc:493] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:37.102519 28735 raft_consensus.cc:2393] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:37.074154 30422 raft_consensus.cc:515] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:37.103431 28852 leader_election.cc:304] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:37.103132 30290 consensus_queue.cc:260] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:37.104216 30290 raft_consensus.cc:3060] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:37.105099 30422 leader_election.cc:290] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:37.083716 30444 raft_consensus.cc:493] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:37.106745 28813 raft_consensus.cc:3060] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:36.965029 30536 raft_consensus.cc:493] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:37.078847 30392 raft_consensus.cc:2804] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:37.115828 28852 leader_election.cc:304] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:37.065714 30421 raft_consensus.cc:515] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:36.964633 30504 raft_consensus.cc:493] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:37.112788 30464 raft_consensus.cc:493] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:37.112969 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:37.113620 30491 raft_consensus.cc:493] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:37.132550 30491 raft_consensus.cc:515] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:37.114341 30486 raft_consensus.cc:2804] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:37.141674 30486 raft_consensus.cc:493] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting leader election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:37.142344 30486 raft_consensus.cc:3060] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:36.997576 30400 raft_consensus.cc:515] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:36.975762 30539 leader_election.cc:290] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:37.150182 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:37.119436 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:37.120891 28736 raft_consensus.cc:2393] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 3: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:37.115552 30392 raft_consensus.cc:493] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:37.102648 30497 raft_consensus.cc:515] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:37.069833 30519 raft_consensus.cc:515] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:37.126597 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:37.127571 28813 raft_consensus.cc:2468] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 4.
I20260203 09:17:37.094624 30495 raft_consensus.cc:493] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:37.131217 30478 raft_consensus.cc:2804] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:37.122813 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:37.123214 30536 raft_consensus.cc:515] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:37.114794 30342 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:37.142513 30534 raft_consensus.cc:515] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:37.106276 30444 raft_consensus.cc:515] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:37.118542 30254 consensus_queue.cc:260] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:37.150288 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:37.090772 30522 raft_consensus.cc:515] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:37.150821 28887 raft_consensus.cc:2468] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:37.204077 28885 raft_consensus.cc:2468] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
I20260203 09:17:37.129002 30364 leader_election.cc:290] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:37.162675 28735 raft_consensus.cc:2393] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:37.222025 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:37.223294 28883 raft_consensus.cc:2410] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260203 09:17:37.206961 30392 raft_consensus.cc:3060] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:37.206399 29457 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:37.235422 28738 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:37.239538 28738 raft_consensus.cc:2468] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:17:37.239745 30444 leader_election.cc:290] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:37.149919 30464 raft_consensus.cc:515] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:37.242303 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:37.243028 28810 raft_consensus.cc:2468] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 3.
I20260203 09:17:37.244726 30536 leader_election.cc:290] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:37.247552 30534 leader_election.cc:290] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:37.250682 29425 leader_election.cc:304] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:37.252890 30444 raft_consensus.cc:2804] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:37.253479 30444 raft_consensus.cc:493] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:37.253958 30444 raft_consensus.cc:3060] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:37.220114 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:37.214484 30478 raft_consensus.cc:493] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:37.220340 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:37.260425 29460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53326 (request call id 472) took 1826 ms. Trace:
W20260203 09:17:37.300437 28700 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.809s user 0.012s sys 0.026s
W20260203 09:17:37.301993 28700 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.812s user 0.013s sys 0.026s
W20260203 09:17:37.303905 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 814114us
I20260203 09:17:37.252251 30547 raft_consensus.cc:515] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:37.237704 30491 leader_election.cc:290] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:37.214892 30495 raft_consensus.cc:515] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:37.137722 30504 raft_consensus.cc:515] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:37.262764 30522 leader_election.cc:290] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:37.296384 29458 consensus_meta.cc:287] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a: Time spent flushing consensus metadata: real 0.699s user 0.003s sys 0.010s
W20260203 09:17:37.299444 30542 consensus_meta.cc:287] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent flushing consensus metadata: real 0.560s user 0.003s sys 0.010s
I20260203 09:17:37.294615 30478 raft_consensus.cc:3060] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:37.346552 28852 leader_election.cc:304] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:37.347524 29461 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:37.348403 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:37.348723 30400 leader_election.cc:290] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Requested vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:37.288787 30532 leader_election.cc:290] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:37.294909 29460 rpcz_store.cc:276] 0203 09:17:35.433619 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:35.449254 (+ 15635us) service_pool.cc:225] Handling call
0203 09:17:35.981124 (+531870us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:36.041269 (+ 60145us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:36.044213 (+ 2944us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:36.064699 (+ 20486us) raft_consensus.cc:1645] Marking committed up to 4
0203 09:17:36.072041 (+ 7342us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:36.082247 (+ 10206us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:37.260097 (+1177850us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b54003354d0. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db452d 00007f2cd8d68f49 00007f2cd22f5d34 00007f2cd22f5cc2 00007f2cd22f5bf1 00007f2cd22f5b6c 00007f2cd22f4e22 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:37.260319 (+ 222us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":19297,"raft.queue_time_us":56722,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":19111,"spinlock_wait_cycles":1094809856}
I20260203 09:17:37.360669 30494 raft_consensus.cc:2804] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:37.361124 30494 raft_consensus.cc:493] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:37.361449 30494 raft_consensus.cc:3060] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:37.362984 28732 raft_consensus.cc:1275] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260203 09:17:37.350013 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:37.318089 29457 raft_consensus.cc:2368] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 3. Current term is 4.
I20260203 09:17:37.352355 28733 raft_consensus.cc:2393] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:37.356101 28880 raft_consensus.cc:2393] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 5: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:37.335242 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
W20260203 09:17:37.356817 30525 consensus_meta.cc:287] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent flushing consensus metadata: real 0.600s user 0.002s sys 0.010s
I20260203 09:17:37.363907 28729 raft_consensus.cc:2468] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:37.381955 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:37.317709 30390 raft_consensus.cc:515] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:37.372339 30532 raft_consensus.cc:493] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:37.358053 30542 raft_consensus.cc:515] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:37.433917 28808 raft_consensus.cc:1240] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:37.386659 30500 leader_election.cc:290] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:37.384032 30421 leader_election.cc:290] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:37.425325 30544 consensus_meta.cc:287] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent flushing consensus metadata: real 0.740s user 0.002s sys 0.014s
I20260203 09:17:37.441638 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:37.468568 28806 raft_consensus.cc:3060] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:37.384402 30525 raft_consensus.cc:515] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:37.515146 30525 leader_election.cc:290] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:37.527472 28701 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.985s user 0.014s sys 0.084s
W20260203 09:17:37.527921 28701 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.986s user 0.014s sys 0.084s
I20260203 09:17:37.512490 30544 raft_consensus.cc:515] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:37.535234 30544 leader_election.cc:290] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:37.536170 28811 raft_consensus.cc:2393] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 4: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
W20260203 09:17:37.528214 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 992018us
W20260203 09:17:37.466449 30425 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.876s user 0.047s sys 0.068s
I20260203 09:17:37.452072 30519 leader_election.cc:290] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:37.556233 28812 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.004s user 0.021s sys 0.110s
W20260203 09:17:37.556804 28812 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.005s user 0.021s sys 0.111s
W20260203 09:17:37.556119 28854 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.029s user 0.015s sys 0.029s
W20260203 09:17:37.585472 28854 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.059s user 0.016s sys 0.029s
W20260203 09:17:37.540122 30425 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.950s user 0.047s sys 0.069s
W20260203 09:17:37.598747 28777 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.078s user 0.007s sys 0.041s
I20260203 09:17:37.602988 30504 leader_election.cc:290] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:37.604179 30558 raft_consensus.cc:493] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:37.604316 30469 raft_consensus.cc:493] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:37.607270 28777 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.087s user 0.007s sys 0.041s
W20260203 09:17:37.624297 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 1.10391e+06us
I20260203 09:17:37.537637 30421 raft_consensus.cc:493] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:37.461120 30532 raft_consensus.cc:515] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:37.622049 30558 raft_consensus.cc:515] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:37.976514 28889 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59280 (request call id 274) took 2391 ms (client timeout 2221 ms). Trace:
I20260203 09:17:37.677701 30498 leader_election.cc:290] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:37.949201 30538 leader_election.cc:290] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
W20260203 09:17:37.946169 28809 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36388 (request call id 1784) took 1868 ms (client timeout 1535 ms). Trace:
I20260203 09:17:37.970444 30254 raft_consensus.cc:3060] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:17:37.977149 28888 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40946 (request call id 1222) took 1649 ms (client timeout 2106 ms). Trace:
I20260203 09:17:37.959797 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:37.688823 28811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36388 (request call id 1783) took 1611 ms. Trace:
I20260203 09:17:37.994001 28811 rpcz_store.cc:276] 0203 09:17:36.077829 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:36.681813 (+603984us) service_pool.cc:225] Handling call
0203 09:17:37.688557 (+1006744us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b54001cc0d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:37.688748 (+ 191us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1942589184}
W20260203 09:17:37.938578 28852 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260203 09:17:37.933748 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 395489us
W20260203 09:17:37.933614 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 308502us
I20260203 09:17:37.995572 28701 leader_election.cc:304] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:37.995774 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:37.996688 28811 raft_consensus.cc:2393] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:37.691298 28882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40946 (request call id 1221) took 1458 ms. Trace:
I20260203 09:17:37.583482 30544 raft_consensus.cc:493] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:37.968955 30481 leader_election.cc:290] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:37.638378 30530 log.cc:927] Time spent T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 1.485s user 0.008s sys 0.004s
I20260203 09:17:37.958626 30282 leader_election.cc:290] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:37.942210 30497 leader_election.cc:290] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:37.912796 30558 leader_election.cc:290] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:37.645834 30469 raft_consensus.cc:515] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:37.997154 28882 rpcz_store.cc:276] 0203 09:17:36.232617 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:36.658895 (+426278us) service_pool.cc:225] Handling call
0203 09:17:36.659243 (+ 348us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:36.735996 (+ 76753us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:37.691063 (+955067us) spinlock_profiling.cc:243] Waited 46.5 ms on lock 0x7b540024ca54. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db5a81 00007f2cd3db44be 00007f2cd8d68f49 00007f2cd22f5d34 00007f2cd22f5cc2 00007f2cd22f5bf1 00007f2cd22f5b6c 00007f2cd22f4e22 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:37.691236 (+ 173us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":106984704}
W20260203 09:17:37.993194 28888 rpcz_store.cc:269] 0203 09:17:36.328191 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:36.527109 (+198918us) service_pool.cc:225] Handling call
0203 09:17:37.976982 (+1449873us) spinlock_profiling.cc:243] Waited 64.4 ms on lock 0x7b540017b1d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:37.977091 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":148086656}
I20260203 09:17:38.002929 30469 leader_election.cc:290] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:37.626415 30547 leader_election.cc:290] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:37.994414 28736 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43626 (request call id 1359) took 1730 ms (client timeout 2035 ms). Trace:
W20260203 09:17:37.992336 28809 rpcz_store.cc:269] 0203 09:17:36.078100 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:36.082558 (+ 4458us) service_pool.cc:225] Handling call
0203 09:17:37.945873 (+1863315us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b5400365bd4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:37.946046 (+ 173us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":438203776}
I20260203 09:17:37.685050 28808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36404 (request call id 1244) took 1305 ms. Trace:
I20260203 09:17:37.936282 30219 raft_consensus.cc:3060] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:37.995731 28777 leader_election.cc:304] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:37.936949 30532 leader_election.cc:290] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:37.767860 30390 leader_election.cc:290] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:38.008955 30497 raft_consensus.cc:2749] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260203 09:17:37.978610 29463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53340 (request call id 264) took 2255 ms (client timeout 2385 ms). Trace:
W20260203 09:17:37.991663 28889 rpcz_store.cc:269] 0203 09:17:35.585435 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:35.585611 (+ 176us) service_pool.cc:225] Handling call
0203 09:17:37.976249 (+2390638us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b54000eb0d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:37.976400 (+ 151us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1139718912}
I20260203 09:17:38.010735 30544 raft_consensus.cc:515] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:38.004323 28736 rpcz_store.cc:269] 0203 09:17:36.263921 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:36.264041 (+ 120us) service_pool.cc:225] Handling call
0203 09:17:37.994250 (+1730209us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b540018b5d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:37.994359 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1967964416}
I20260203 09:17:37.996498 28852 leader_election.cc:304] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:37.687047 30133 raft_consensus.cc:493] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:37.982859 30322 leader_election.cc:290] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:38.005512 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:37.590296 30464 leader_election.cc:290] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:37.679833 30250 leader_election.cc:290] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:37.985819 28737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43612 (request call id 1757) took 1694 ms. Trace:
I20260203 09:17:38.015548 28737 rpcz_store.cc:276] 0203 09:17:36.291691 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:36.291968 (+ 277us) service_pool.cc:225] Handling call
0203 09:17:37.985650 (+1693682us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b540028c654. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:37.985760 (+ 110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":446293760}
I20260203 09:17:37.666424 30421 raft_consensus.cc:515] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:37.765211 30542 leader_election.cc:290] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:37.984963 28805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36388 (request call id 1771) took 1909 ms. Trace:
I20260203 09:17:38.008481 28777 leader_election.cc:304] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:38.027101 28805 rpcz_store.cc:276] 0203 09:17:36.075249 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:36.076776 (+ 1527us) service_pool.cc:225] Handling call
0203 09:17:36.082332 (+ 5556us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:36.369936 (+287604us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:37.984662 (+1614726us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b5400203354. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db5a81 00007f2cd3db44be 00007f2cd8d68f49 00007f2cd22f5d34 00007f2cd22f5cc2 00007f2cd22f5bf1 00007f2cd22f5b6c 00007f2cd22f4e22 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:37.984868 (+ 206us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":475684736}
I20260203 09:17:37.987623 28813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50256 (request call id 214) took 1342 ms. Trace:
I20260203 09:17:38.028100 30542 raft_consensus.cc:2749] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:38.028349 28813 rpcz_store.cc:276] 0203 09:17:36.645667 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:36.677723 (+ 32056us) service_pool.cc:225] Handling call
0203 09:17:37.987436 (+1309713us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b54000361d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:37.987563 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":894147328}
I20260203 09:17:38.029861 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:38.030580 28813 raft_consensus.cc:2468] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:38.031525 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:38.078611 28813 raft_consensus.cc:2393] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:37.983317 28807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36404 (request call id 1235) took 2184 ms. Trace:
I20260203 09:17:37.960706 30471 leader_election.cc:290] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:38.014644 28809 raft_consensus.cc:2410] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260203 09:17:37.690608 30291 leader_election.cc:290] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:37.765504 30495 leader_election.cc:290] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:37.970266 28804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50256 (request call id 213) took 1376 ms. Trace:
I20260203 09:17:38.013495 30133 raft_consensus.cc:3060] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:37.986721 30465 leader_election.cc:290] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:38.010169 29463 rpcz_store.cc:269] 0203 09:17:35.723548 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:35.772543 (+ 48995us) service_pool.cc:225] Handling call
0203 09:17:37.978334 (+2205791us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b5400374954. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:37.978475 (+ 141us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":729702784}
I20260203 09:17:37.958914 30470 leader_election.cc:290] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:37.977734 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:38.042112 28777 leader_election.cc:304] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:38.083540 30468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.288s user 0.006s sys 0.005s
W20260203 09:17:38.043475 30486 consensus_meta.cc:287] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc: Time spent flushing consensus metadata: real 0.900s user 0.010s sys 0.003s
I20260203 09:17:37.973209 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:38.046412 28806 consensus_meta.cc:287] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent flushing consensus metadata: real 0.577s user 0.008s sys 0.000s
W20260203 09:17:38.046569 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 50137us
I20260203 09:17:38.104118 28806 raft_consensus.cc:2468] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
W20260203 09:17:37.934942 28703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260203 09:17:38.106913 28703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:38.052433 30464 raft_consensus.cc:2804] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:38.071162 28633 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56858 (request call id 301) took 4789 ms. Trace:
W20260203 09:17:38.100473 29462 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.978s user 0.026s sys 0.048s
I20260203 09:17:38.018503 28808 rpcz_store.cc:276] 0203 09:17:36.379774 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:36.790078 (+410304us) service_pool.cc:225] Handling call
0203 09:17:36.790324 (+ 246us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:37.452900 (+662576us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:37.684770 (+231870us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b540013b5d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db5a81 00007f2cd3db44be 00007f2cd8d68f49 00007f2cd22f5d34 00007f2cd22f5cc2 00007f2cd22f5bf1 00007f2cd22f5b6c 00007f2cd22f4e22 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:37.684971 (+ 201us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1479634176}
W20260203 09:17:38.108944 28703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260203 09:17:38.109404 29462 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.987s user 0.026s sys 0.048s
I20260203 09:17:38.012939 30544 leader_election.cc:290] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:38.126442 28852 leader_election.cc:304] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:38.127789 28852 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:38.128633 28852 leader_election.cc:304] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:38.079167 28807 rpcz_store.cc:276] 0203 09:17:35.798847 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:35.798985 (+ 138us) service_pool.cc:225] Handling call
0203 09:17:35.799310 (+ 325us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:36.683725 (+884415us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:37.982974 (+1299249us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b54003656d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db5a81 00007f2cd3db44be 00007f2cd8d68f49 00007f2cd22f5d34 00007f2cd22f5cc2 00007f2cd22f5bf1 00007f2cd22f5b6c 00007f2cd22f4e22 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:37.983171 (+ 197us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2022650624}
I20260203 09:17:38.090281 28635 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57772 (request call id 177) took 4878 ms. Trace:
W20260203 09:17:38.097124 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 101639us
I20260203 09:17:38.131764 28635 rpcz_store.cc:276] 0203 09:17:33.211578 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:33.211721 (+ 143us) service_pool.cc:225] Handling call
0203 09:17:38.090198 (+4878477us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1410746,"reported_tablets":7}
I20260203 09:17:38.042200 30421 leader_election.cc:290] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:37.957969 28881 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40958 (request call id 1277) took 1979 ms (client timeout 1901 ms). Trace:
I20260203 09:17:38.107447 28633 rpcz_store.cc:276] 0203 09:17:33.281831 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:33.294275 (+ 12444us) service_pool.cc:225] Handling call
0203 09:17:38.071080 (+4776805us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":255084,"reported_tablets":1}
I20260203 09:17:38.132037 28701 leader_election.cc:304] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
W20260203 09:17:38.099684 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 57655.5us
I20260203 09:17:38.135556 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:38.136246 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:38.137292 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:38.139340 28807 raft_consensus.cc:2393] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:38.139426 28806 raft_consensus.cc:2410] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
W20260203 09:17:38.053793 30444 consensus_meta.cc:287] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a: Time spent flushing consensus metadata: real 0.799s user 0.010s sys 0.001s
W20260203 09:17:38.101456 30468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.307s user 0.006s sys 0.005s
W20260203 09:17:38.110867 29426 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.452s user 0.026s sys 0.043s
I20260203 09:17:38.152904 28631 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56866 (request call id 290) took 4962 ms. Trace:
W20260203 09:17:38.158638 29426 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.500s user 0.026s sys 0.043s
W20260203 09:17:38.159171 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 1.50515e+06us
I20260203 09:17:38.099825 30282 raft_consensus.cc:2804] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:38.161053 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:38.166659 29426 leader_election.cc:304] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:38.168434 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:38.174618 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:38.175319 28889 raft_consensus.cc:3060] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 4
I20260203 09:17:38.163664 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:38.158694 28631 rpcz_store.cc:276] 0203 09:17:33.190724 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:33.191298 (+ 574us) service_pool.cc:225] Handling call
0203 09:17:38.152823 (+4961525us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0203 09:17:33.458575 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0203 09:17:33.538131 (+ 79556us) write_op.cc:432] Acquiring schema lock in shared mode
0203 09:17:33.538168 (+ 37us) write_op.cc:435] Acquired schema lock
0203 09:17:33.538184 (+ 16us) tablet.cc:660] Decoding operations
0203 09:17:33.538885 (+ 701us) write_op.cc:620] Acquiring the partition lock for write op
0203 09:17:33.538951 (+ 66us) write_op.cc:641] Partition lock acquired for write op
0203 09:17:33.538981 (+ 30us) tablet.cc:683] Acquiring locks for 5 operations
0203 09:17:33.539504 (+ 523us) tablet.cc:699] Row locks acquired
0203 09:17:33.539520 (+ 16us) write_op.cc:260] PREPARE: finished
0203 09:17:33.539661 (+ 141us) write_op.cc:270] Start()
0203 09:17:33.539775 (+ 114us) write_op.cc:276] Timestamp: P: 1770110253539612 usec, L: 0
0203 09:17:33.539794 (+ 19us) op_driver.cc:348] REPLICATION: starting
0203 09:17:33.600101 (+ 60307us) log.cc:844] Serialized 2084 byte log entry
0203 09:17:34.070270 (+470169us) op_driver.cc:464] REPLICATION: finished
0203 09:17:34.994875 (+924605us) spinlock_profiling.cc:243] Waited 38.3 ms on lock 0x7b440002304c. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd0b478b1 00007f2cd0c16005 00007f2cd0c16a22 00007f2cd396057b 00007f2cd395be4f 00007f2cd0ce9f0c 00007f2cd9ad2709 00007f2cd0d0657b 00007f2cd0d0481f 00007f2cd0d06ae2 00007f2cd77ede40
0203 09:17:35.745088 (+750213us) write_op.cc:301] APPLY: starting
0203 09:17:35.762639 (+ 17551us) tablet.cc:1365] starting BulkCheckPresence
0203 09:17:35.792670 (+ 30031us) tablet.cc:1368] finished BulkCheckPresence
0203 09:17:35.797781 (+ 5111us) tablet.cc:1370] starting ApplyRowOperation cycle
0203 09:17:36.159266 (+361485us) tablet.cc:1381] finished ApplyRowOperation cycle
0203 09:17:36.217149 (+ 57883us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0203 09:17:36.231141 (+ 13992us) write_op.cc:312] APPLY: finished
0203 09:17:36.254433 (+ 23292us) log.cc:844] Serialized 47 byte log entry
0203 09:17:36.469810 (+215377us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:17:36.470133 (+ 323us) write_op.cc:454] Released schema lock
0203 09:17:36.470718 (+ 585us) write_op.cc:341] FINISH: Updating metrics
0203 09:17:36.496186 (+ 25468us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:17:36.496220 (+ 34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":138062,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":1643938,"apply.run_cpu_time_us":115764,"apply.run_wall_time_us":749742,"num_ops":5,"prepare.queue_time_us":123,"prepare.run_cpu_time_us":7372,"prepare.run_wall_time_us":287055,"replication_time_us":489140,"spinlock_wait_cycles":88047872,"thread_start_us":1733263,"threads_started":2,"wal-append.queue_time_us":368755,"wal-append.run_cpu_time_us":1626,"wal-append.run_wall_time_us":1002234}]]}
I20260203 09:17:38.102849 30495 raft_consensus.cc:2749] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:38.187412 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47301e2bbfc94767a9905b0e12141d6d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:38.146652 30469 raft_consensus.cc:493] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:38.197940 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:38.257863 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:38.258759 28811 raft_consensus.cc:2393] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:38.262387 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:38.262868 28729 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:38.263809 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:38.264423 28884 raft_consensus.cc:2468] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 1.
I20260203 09:17:38.163316 30444 raft_consensus.cc:515] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:38.109221 30464 raft_consensus.cc:493] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:38.185887 30425 raft_consensus.cc:2804] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:38.293944 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:38.167023 29458 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s user 0.009s sys 0.005s
I20260203 09:17:38.251010 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:38.094375 28804 rpcz_store.cc:276] 0203 09:17:36.594236 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:36.631810 (+ 37574us) service_pool.cc:225] Handling call
0203 09:17:37.969801 (+1337991us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54002db9d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:37.970109 (+ 308us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":254513024}
W20260203 09:17:38.146976 28881 rpcz_store.cc:269] 0203 09:17:35.978744 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:35.982525 (+ 3781us) service_pool.cc:225] Handling call
0203 09:17:37.957705 (+1975180us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54003c7b54. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:37.957884 (+ 179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3627110144}
I20260203 09:17:38.319671 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:38.320463 28881 raft_consensus.cc:2468] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:38.321838 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:38.266796 28882 raft_consensus.cc:2410] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260203 09:17:38.322530 28880 raft_consensus.cc:2468] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/auto_leader_rebalancer-test.cc:439: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 2
I20260203 09:17:38.323861 27553 tablet_server.cc:178] TabletServer@127.26.232.65:0 shutting down...
I20260203 09:17:38.328260 28730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:38.329067 28730 raft_consensus.cc:3060] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:38.278508 28736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:38.167697 30481 raft_consensus.cc:2804] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:38.170149 30504 raft_consensus.cc:2804] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:38.167840 30558 raft_consensus.cc:2804] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:38.185655 30282 raft_consensus.cc:493] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting leader election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:38.290448 28737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:38.140206 30486 raft_consensus.cc:515] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:38.297420 30425 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:38.317380 30397 raft_consensus.cc:493] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:38.340541 30504 raft_consensus.cc:493] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:38.295154 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:38.350986 28813 raft_consensus.cc:2468] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:38.295349 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:38.352167 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:38.187812 28807 raft_consensus.cc:2468] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
W20260203 09:17:38.296120 29458 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.918s user 0.009s sys 0.005s
I20260203 09:17:38.297812 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:38.299388 30494 consensus_meta.cc:287] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc: Time spent flushing consensus metadata: real 0.938s user 0.010s sys 0.003s
I20260203 09:17:38.355417 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:38.356123 28813 raft_consensus.cc:2468] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:38.299836 28733 raft_consensus.cc:1240] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Rejecting Update request from peer 77541303e1934638ba82f0f43f707adc for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:38.266916 30314 raft_consensus.cc:493] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:38.300132 30478 consensus_meta.cc:287] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc: Time spent flushing consensus metadata: real 0.927s user 0.003s sys 0.010s
I20260203 09:17:38.267117 30469 raft_consensus.cc:515] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:38.302484 28735 raft_consensus.cc:2468] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 1.
I20260203 09:17:38.303128 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:38.365144 28811 raft_consensus.cc:2393] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:38.305792 30421 raft_consensus.cc:493] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:38.358376 29461 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:38.361470 30494 raft_consensus.cc:515] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:38.367590 29461 raft_consensus.cc:2468] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:38.367449 30421 raft_consensus.cc:515] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:38.211931 30450 raft_consensus.cc:2804] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:38.371117 30486 leader_election.cc:290] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:38.371961 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:38.196158 28889 raft_consensus.cc:2468] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 4.
I20260203 09:17:38.308980 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:38.310703 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:38.361397 30405 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.621s user 0.043s sys 0.085s
W20260203 09:17:38.373504 28851 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.158s user 0.021s sys 0.067s
I20260203 09:17:38.157485 30538 consensus_queue.cc:1048] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.131s
I20260203 09:17:38.317230 28732 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e"
I20260203 09:17:38.331804 28736 raft_consensus.cc:3060] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:38.338896 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:38.322098 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:38.317768 30464 raft_consensus.cc:3060] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:38.341511 28737 raft_consensus.cc:3060] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:38.373391 28733 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:38.378299 28732 raft_consensus.cc:3060] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 4
I20260203 09:17:38.345043 28886 raft_consensus.cc:1240] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Rejecting Update request from peer cf00f643e7da4a98a0a11ea92869c24a for earlier term 4. Current term is 5. Ops: []
I20260203 09:17:38.336571 30481 raft_consensus.cc:493] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:38.294763 28806 raft_consensus.cc:2468] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:38.316390 30495 raft_consensus.cc:493] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:38.342311 30282 raft_consensus.cc:3060] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:38.340472 30558 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
W20260203 09:17:38.345890 30392 consensus_meta.cc:287] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent flushing consensus metadata: real 1.056s user 0.007s sys 0.005s
I20260203 09:17:38.352150 28810 raft_consensus.cc:2468] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:38.353766 30397 raft_consensus.cc:515] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:38.359793 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:38.393596 28807 raft_consensus.cc:2468] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 2.
I20260203 09:17:38.345764 30425 raft_consensus.cc:3060] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:38.360908 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:38.388765 30495 raft_consensus.cc:515] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:38.399649 29464 raft_consensus.cc:2376] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3. Re-sending same reply.
I20260203 09:17:38.400763 28735 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "847a7af9f0e2497cbb9025cc2c62557e" is_pre_election: true
I20260203 09:17:38.401469 30495 leader_election.cc:290] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:38.382773 30481 raft_consensus.cc:3060] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:38.350124 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:38.390331 29458 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53340 (request call id 259) took 2885 ms. Trace:
I20260203 09:17:38.354298 30504 raft_consensus.cc:3060] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:38.370775 30421 leader_election.cc:290] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:38.364208 30133 raft_consensus.cc:515] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:38.373566 28887 raft_consensus.cc:2468] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
W20260203 09:17:38.374749 28851 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.160s user 0.021s sys 0.067s
I20260203 09:17:38.375110 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
W20260203 09:17:38.443199 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 1.22844e+06us
W20260203 09:17:38.375798 30405 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.636s user 0.043s sys 0.085s
I20260203 09:17:38.376184 28731 raft_consensus.cc:2468] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:38.291710 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:38.343319 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:38.376607 28882 raft_consensus.cc:2468] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
W20260203 09:17:38.315899 28777 connection.cc:232] RPC call timeout handler was delayed by -1.5512800260003132s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
I20260203 09:17:38.371281 30450 raft_consensus.cc:493] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:38.371205 29457 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
W20260203 09:17:38.385533 29427 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.036s user 0.026s sys 0.071s
I20260203 09:17:38.369026 30494 leader_election.cc:290] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:38.369484 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:38.372807 30361 raft_consensus.cc:493] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:38.376746 30486 raft_consensus.cc:493] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:38.353675 28888 raft_consensus.cc:2468] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 4.
I20260203 09:17:38.362834 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:38.403174 28806 raft_consensus.cc:1275] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260203 09:17:38.390079 30392 raft_consensus.cc:515] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:38.417054 28880 raft_consensus.cc:3060] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:38.393980 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:38.364245 30478 raft_consensus.cc:515] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:38.405076 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:38.386895 30558 raft_consensus.cc:3060] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:38.382227 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:38.385143 30469 leader_election.cc:290] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:38.410579 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:38.375509 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:38.456528 30450 raft_consensus.cc:3060] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:38.453063 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:38.512545 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:38.513716 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:38.514264 28887 raft_consensus.cc:2468] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:38.515043 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:38.515576 28887 raft_consensus.cc:3060] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:38.455786 28737 raft_consensus.cc:2468] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 4.
I20260203 09:17:38.456907 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:38.456962 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:38.456475 28736 raft_consensus.cc:2468] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 4.
W20260203 09:17:38.457005 29427 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.108s user 0.026s sys 0.071s
I20260203 09:17:38.457998 28777 leader_election.cc:304] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:38.467162 28732 raft_consensus.cc:2468] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 4.
W20260203 09:17:38.519315 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 61420us
I20260203 09:17:38.521090 28777 leader_election.cc:304] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:38.522449 28777 leader_election.cc:304] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:38.525938 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:38.526736 29463 raft_consensus.cc:2368] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 3. Current term is 4.
I20260203 09:17:38.527616 28777 leader_election.cc:304] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:38.469789 28851 connection.cc:232] RPC call timeout handler was delayed by -1.0163021849998586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
I20260203 09:17:38.402601 28735 raft_consensus.cc:1240] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Rejecting Update request from peer cf00f643e7da4a98a0a11ea92869c24a for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260203 09:17:38.471012 28731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43612 (request call id 1765) took 1397 ms. Trace:
W20260203 09:17:38.417450 28734 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.801s user 0.040s sys 0.075s
I20260203 09:17:38.364382 30314 raft_consensus.cc:515] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:38.403982 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:38.486101 28889 raft_consensus.cc:3060] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:38.445773 28884 raft_consensus.cc:3060] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 4
I20260203 09:17:38.538753 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:38.487104 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:38.539475 28882 raft_consensus.cc:2393] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 3: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:38.530886 28731 rpcz_store.cc:276] 0203 09:17:37.073215 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:37.074261 (+ 1046us) service_pool.cc:225] Handling call
0203 09:17:38.470821 (+1396560us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400279cd4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:38.470945 (+ 124us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2992161152}
W20260203 09:17:38.489899 28852 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:38.490772 29461 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:38.483541 30486 raft_consensus.cc:515] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:38.491392 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:38.542198 28888 raft_consensus.cc:3060] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:38.493002 29457 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:38.497611 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:38.498934 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:38.501125 30558 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:38.524680 30495 raft_consensus.cc:2804] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260203 09:17:38.461449 30344 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.329s user 0.031s sys 0.078s
I20260203 09:17:38.481119 30361 raft_consensus.cc:515] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:38.454046 30444 leader_election.cc:290] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:38.485273 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:38.510280 30133 leader_election.cc:290] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Requested vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:38.537943 30390 raft_consensus.cc:2804] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:38.524818 30425 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:38.537882 28880 raft_consensus.cc:2468] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 4.
I20260203 09:17:38.545076 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:38.566062 28882 raft_consensus.cc:3060] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:38.555316 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:38.566975 28889 raft_consensus.cc:2468] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 4.
W20260203 09:17:38.538017 28734 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.927s user 0.041s sys 0.076s
I20260203 09:17:38.539428 28886 raft_consensus.cc:2468] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
W20260203 09:17:38.448868 30446 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.676s user 0.030s sys 0.083s
I20260203 09:17:38.570878 28776 leader_election.cc:400] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Vote denied by peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627) with higher term. Message: Invalid argument: T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 3. Current term is 4.
I20260203 09:17:38.551860 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fabfb779b8894cf0b22204fe12768dc3" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:38.553437 28733 raft_consensus.cc:1275] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260203 09:17:38.553712 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
W20260203 09:17:38.571075 29425 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.205s user 0.029s sys 0.033s
I20260203 09:17:38.571544 29464 raft_consensus.cc:3060] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:17:38.571681 29425 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.209s user 0.029s sys 0.033s
I20260203 09:17:38.559383 30486 leader_election.cc:290] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:38.537977 30544 raft_consensus.cc:2749] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:38.552570 29461 raft_consensus.cc:2368] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 3. Current term is 4.
I20260203 09:17:38.553460 30495 raft_consensus.cc:493] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260203 09:17:38.555042 30344 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.435s user 0.031s sys 0.078s
I20260203 09:17:38.559703 30558 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:38.554713 30565 consensus_queue.cc:1059] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260203 09:17:38.572077 28776 leader_election.cc:403] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260203 09:17:38.570179 29427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:38.535704 28809 raft_consensus.cc:2393] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 5: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:38.573762 28884 raft_consensus.cc:2468] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 4.
I20260203 09:17:38.542825 28852 leader_election.cc:304] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:38.574499 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:38.547623 28730 raft_consensus.cc:2468] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 4.
I20260203 09:17:38.584466 29465 raft_consensus.cc:2468] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:38.585453 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:38.577890 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 50376.1us
I20260203 09:17:38.586053 28886 raft_consensus.cc:2468] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
W20260203 09:17:38.578450 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 48206.4us
W20260203 09:17:38.573536 30446 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.803s user 0.031s sys 0.083s
I20260203 09:17:38.579478 28883 raft_consensus.cc:2393] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 4: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:38.559764 29457 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:38.562357 30390 raft_consensus.cc:493] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:38.580271 28881 raft_consensus.cc:2393] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 4: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:38.580508 30495 raft_consensus.cc:3060] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:17:38.589135 29456 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.716s user 0.029s sys 0.052s
I20260203 09:17:38.591776 28886 raft_consensus.cc:1240] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Rejecting Update request from peer cf00f643e7da4a98a0a11ea92869c24a for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:38.582197 30542 raft_consensus.cc:2804] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:38.593726 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:38.573531 30494 raft_consensus.cc:493] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:38.604282 28851 leader_election.cc:304] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:38.604847 29463 raft_consensus.cc:2393] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 3: Already voted for candidate cf00f643e7da4a98a0a11ea92869c24a in this term.
I20260203 09:17:38.570902 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:38.594645 30133 raft_consensus.cc:493] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:38.608917 28889 raft_consensus.cc:3060] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 3
I20260203 09:17:38.594584 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:38.610177 28806 raft_consensus.cc:2393] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:38.585248 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:38.595491 30473 raft_consensus.cc:493] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
W20260203 09:17:38.596227 30568 log.cc:927] Time spent T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a: Append to log took a long time: real 0.113s user 0.000s sys 0.000s
I20260203 09:17:38.596689 30544 raft_consensus.cc:2749] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627) with higher term. Message: Invalid argument: T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 3. Current term is 4.
I20260203 09:17:38.596310 30390 raft_consensus.cc:3060] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:38.593154 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:38.594550 29461 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:38.592679 30405 raft_consensus.cc:2804] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:38.585477 30254 raft_consensus.cc:493] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:38.617477 28851 leader_election.cc:304] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:38.600490 28852 leader_election.cc:304] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:38.595292 28734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43612 (request call id 1763) took 2128 ms. Trace:
I20260203 09:17:38.605020 28777 leader_election.cc:304] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
W20260203 09:17:38.620599 30524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.335s user 0.022s sys 0.097s
I20260203 09:17:38.622258 28887 raft_consensus.cc:2468] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 4.
I20260203 09:17:38.597566 30486 raft_consensus.cc:3055] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:38.625861 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:38.614315 30558 raft_consensus.cc:2749] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:38.641029 28813 raft_consensus.cc:3060] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:38.632030 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
W20260203 09:17:38.605149 29456 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.736s user 0.029s sys 0.052s
I20260203 09:17:38.629935 29465 raft_consensus.cc:2393] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 4: Already voted for candidate cf00f643e7da4a98a0a11ea92869c24a in this term.
I20260203 09:17:38.621311 28883 raft_consensus.cc:1240] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Rejecting Update request from peer cf00f643e7da4a98a0a11ea92869c24a for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:38.612283 30314 leader_election.cc:290] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:38.603449 30542 raft_consensus.cc:493] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:38.623137 29460 raft_consensus.cc:2468] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
I20260203 09:17:38.626493 30561 raft_consensus.cc:493] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:38.620465 30219 raft_consensus.cc:493] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:38.644119 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:38.620627 30397 leader_election.cc:290] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:38.614311 30494 raft_consensus.cc:515] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:38.641930 29463 raft_consensus.cc:2468] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:38.648479 29425 leader_election.cc:304] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:38.628145 30405 raft_consensus.cc:493] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260203 09:17:38.638548 30524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.375s user 0.023s sys 0.097s
I20260203 09:17:38.635047 28851 leader_election.cc:304] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:38.657400 28889 raft_consensus.cc:2468] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 3.
I20260203 09:17:38.631808 28777 leader_election.cc:304] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:38.680227 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 48498.1us
I20260203 09:17:38.682747 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:38.683415 28889 raft_consensus.cc:2468] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 4.
I20260203 09:17:38.641111 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:38.613973 30133 raft_consensus.cc:515] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:38.641026 30544 raft_consensus.cc:2804] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:38.668076 29465 raft_consensus.cc:2468] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
I20260203 09:17:38.654959 30478 leader_election.cc:290] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:38.647316 30423 raft_consensus.cc:2804] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:38.640799 30486 raft_consensus.cc:740] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:38.620353 30473 raft_consensus.cc:515] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:38.678913 30405 raft_consensus.cc:3060] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:38.648048 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:38.678383 28776 leader_election.cc:304] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:38.654098 30542 raft_consensus.cc:3060] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:38.689481 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:38.688889 30397 raft_consensus.cc:2804] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:38.408448 29458 rpcz_store.cc:276] 0203 09:17:35.497825 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:35.505167 (+ 7342us) service_pool.cc:225] Handling call
0203 09:17:35.610534 (+105367us) raft_consensus.cc:1471] Updating replica for 1 ops
0203 09:17:35.683425 (+ 72891us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:35.685844 (+ 2419us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0203 09:17:35.983778 (+297934us) log.cc:844] Serialized 501 byte log entry
0203 09:17:36.087767 (+103989us) raft_consensus.cc:1645] Marking committed up to 5
0203 09:17:37.364206 (+1276439us) log.cc:844] Serialized 14 byte log entry
0203 09:17:38.364693 (+1000487us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:38.372765 (+ 8072us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0203 09:17:38.374172 (+ 1407us) raft_consensus.cc:1685] finished
0203 09:17:38.376041 (+ 1869us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:38.382926 (+ 6885us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3289,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":3994,"thread_start_us":1024511,"threads_started":2,"wal-append.queue_time_us":223086,"wal-append.run_cpu_time_us":1672,"wal-append.run_wall_time_us":1020719}
W20260203 09:17:38.688184 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 53238us
I20260203 09:17:38.646600 30392 leader_election.cc:290] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 election: Requested vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:38.699424 29464 raft_consensus.cc:2468] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
I20260203 09:17:38.705008 28889 raft_consensus.cc:3060] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:38.641992 30254 raft_consensus.cc:515] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:38.723850 28888 raft_consensus.cc:2468] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 4.
I20260203 09:17:38.676146 30561 raft_consensus.cc:515] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:38.693864 29459 raft_consensus.cc:3060] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:38.709295 28851 leader_election.cc:304] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:38.727685 28851 leader_election.cc:304] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:38.694553 30468 raft_consensus.cc:2804] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader election won for term 4
W20260203 09:17:38.715142 28703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:38.690642 30544 raft_consensus.cc:493] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:38.694262 30469 raft_consensus.cc:2749] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:38.690470 29461 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:38.676498 30219 raft_consensus.cc:515] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:38.692895 30423 raft_consensus.cc:493] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:38.715929 30425 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:38.720523 28813 raft_consensus.cc:2468] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 4.
I20260203 09:17:38.728598 28851 leader_election.cc:304] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:38.708525 28804 raft_consensus.cc:3060] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:38.744937 30504 raft_consensus.cc:515] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:38.747073 30504 leader_election.cc:290] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:38.729439 30392 raft_consensus.cc:2804] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:38.637495 28734 rpcz_store.cc:276] 0203 09:17:36.467356 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:36.577755 (+110399us) service_pool.cc:225] Handling call
0203 09:17:36.578166 (+ 411us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:36.578392 (+ 226us) raft_consensus.cc:1534] Early marking committed up to index 5
0203 09:17:36.578745 (+ 353us) log.cc:844] Serialized 14 byte log entry
0203 09:17:38.579142 (+2000397us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:38.581851 (+ 2709us) raft_consensus.cc:1645] Marking committed up to 5
0203 09:17:38.587133 (+ 5282us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:38.595121 (+ 7988us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:38.595237 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":902,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":118,"raft.queue_time_us":133929,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":12043,"thread_start_us":1962432,"threads_started":1}
I20260203 09:17:38.733351 30544 raft_consensus.cc:3060] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:38.759305 30561 leader_election.cc:290] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:38.760119 30361 leader_election.cc:290] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:38.737530 28703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:38.741441 30133 leader_election.cc:290] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:38.730469 30558 raft_consensus.cc:2749] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:38.713204 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:38.714264 30397 raft_consensus.cc:493] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:38.713896 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:38.761525 29456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53340 (request call id 260) took 3199 ms. Trace:
I20260203 09:17:38.741540 30219 leader_election.cc:290] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:38.741714 28851 leader_election.cc:304] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:38.742033 30469 raft_consensus.cc:2804] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260203 09:17:38.790309 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 48674.1us
I20260203 09:17:38.733623 28889 raft_consensus.cc:2468] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 5.
I20260203 09:17:38.733186 30431 raft_consensus.cc:2804] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:38.736820 30423 raft_consensus.cc:3060] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:38.756996 30468 raft_consensus.cc:697] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:38.757086 30392 raft_consensus.cc:493] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:38.708870 30433 raft_consensus.cc:493] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:38.736464 29461 raft_consensus.cc:3060] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Advancing to term 5
I20260203 09:17:38.789026 30397 raft_consensus.cc:3060] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:38.800253 30392 raft_consensus.cc:3060] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:38.806823 30341 raft_consensus.cc:3055] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 LEADER]: Stepping down as leader of term 4
I20260203 09:17:38.790874 29456 rpcz_store.cc:276] 0203 09:17:35.538518 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:35.549386 (+ 10868us) service_pool.cc:225] Handling call
0203 09:17:35.582926 (+ 33540us) raft_consensus.cc:1471] Updating replica for 1 ops
0203 09:17:35.628978 (+ 46052us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:35.632479 (+ 3501us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0203 09:17:35.744988 (+112509us) log.cc:844] Serialized 26 byte log entry
0203 09:17:37.698389 (+1953401us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b440002304c. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd0b478b1 00007f2cd0c16005 00007f2cd0c16a22 00007f2cd396057b 00007f2cd395be4f 00007f2cd0ce9f0c 00007f2cd9ad2709 00007f2cd0d0657b 00007f2cd0d0481f 00007f2cd0d06ae2 00007f2cd394e5ab
0203 09:17:38.656427 (+958038us) raft_consensus.cc:1645] Marking committed up to 6
0203 09:17:38.692557 (+ 36130us) log.cc:844] Serialized 14 byte log entry
0203 09:17:38.706514 (+ 13957us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:38.716120 (+ 9606us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0203 09:17:38.723957 (+ 7837us) raft_consensus.cc:1685] finished
0203 09:17:38.726723 (+ 2766us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:38.737823 (+ 11100us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4118,"prepare.queue_time_us":21399,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":34488,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":61766,"spinlock_wait_cycles":9952512,"thread_start_us":2781123,"threads_started":1,"wal-append.queue_time_us":2803468}
I20260203 09:17:38.807289 30341 raft_consensus.cc:740] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:38.790387 30469 raft_consensus.cc:493] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:38.792733 30431 raft_consensus.cc:493] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:38.804872 29460 raft_consensus.cc:2393] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 4: Already voted for candidate cf00f643e7da4a98a0a11ea92869c24a in this term.
I20260203 09:17:38.800722 28882 raft_consensus.cc:2468] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
I20260203 09:17:38.794001 30478 raft_consensus.cc:2749] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:38.729221 30486 consensus_queue.cc:260] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:38.793228 28851 leader_election.cc:304] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:38.815994 28851 leader_election.cc:304] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:38.817308 28851 leader_election.cc:304] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:38.810791 28880 raft_consensus.cc:2393] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 3: Already voted for candidate cf00f643e7da4a98a0a11ea92869c24a in this term.
I20260203 09:17:38.822431 30495 raft_consensus.cc:515] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:38.823649 30282 raft_consensus.cc:515] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:38.827440 28851 leader_election.cc:304] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:38.812039 30469 raft_consensus.cc:3060] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:38.812211 30538 raft_consensus.cc:2749] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:38.812963 30431 raft_consensus.cc:3060] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:38.830889 28851 leader_election.cc:304] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:38.808156 30341 consensus_queue.cc:260] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:38.803669 30433 raft_consensus.cc:515] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:38.825243 30322 raft_consensus.cc:2804] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:38.826881 30425 raft_consensus.cc:2804] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260203 09:17:38.837386 28812 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.765s user 0.001s sys 0.051s
I20260203 09:17:38.839949 28729 raft_consensus.cc:1240] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Rejecting Update request from peer cf00f643e7da4a98a0a11ea92869c24a for earlier term 4. Current term is 5. Ops: []
I20260203 09:17:38.828444 30558 raft_consensus.cc:2804] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:38.826810 30254 leader_election.cc:290] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:38.837132 30411 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.737s user 0.035s sys 0.052s
W20260203 09:17:38.847155 28812 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.778s user 0.002s sys 0.052s
I20260203 09:17:38.831826 30500 raft_consensus.cc:2749] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:38.851643 28812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36388 (request call id 1768) took 2777 ms. Trace:
I20260203 09:17:38.853219 28812 rpcz_store.cc:276] 0203 09:17:36.074354 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:36.076726 (+ 2372us) service_pool.cc:225] Handling call
0203 09:17:36.132116 (+ 55390us) raft_consensus.cc:1471] Updating replica for 1 ops
0203 09:17:36.489902 (+357786us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:36.490024 (+ 122us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0203 09:17:36.503789 (+ 13765us) log.cc:844] Serialized 26 byte log entry
0203 09:17:37.557239 (+1053450us) raft_consensus.cc:1645] Marking committed up to 2
0203 09:17:38.850695 (+1293456us) log.cc:844] Serialized 14 byte log entry
0203 09:17:38.851056 (+ 361us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:38.851383 (+ 327us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0203 09:17:38.851441 (+ 58us) raft_consensus.cc:1685] finished
0203 09:17:38.851454 (+ 13us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:38.851588 (+ 134us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":176331,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":199,"thread_start_us":2125888,"threads_started":3,"wal-append.queue_time_us":2061875}
W20260203 09:17:38.850351 30411 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.753s user 0.035s sys 0.052s
I20260203 09:17:38.845938 30322 raft_consensus.cc:493] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:38.830732 30478 consensus_queue.cc:1048] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260203 09:17:38.846050 30425 raft_consensus.cc:493] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260203 09:17:38.863072 28805 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.717s user 0.009s sys 0.037s
I20260203 09:17:38.849220 30558 raft_consensus.cc:493] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting leader election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:38.834136 30481 raft_consensus.cc:515] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:38.851187 30421 raft_consensus.cc:493] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:38.861459 30565 raft_consensus.cc:2749] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:38.848191 30450 raft_consensus.cc:515] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:38.864495 29462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s user 0.022s sys 0.025s
I20260203 09:17:38.837265 30468 consensus_queue.cc:237] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:38.878500 29462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s user 0.023s sys 0.025s
I20260203 09:17:38.865705 30322 raft_consensus.cc:3060] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:17:38.884747 28738 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s user 0.018s sys 0.011s
I20260203 09:17:38.867879 30425 raft_consensus.cc:3060] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
W20260203 09:17:38.880791 28700 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s user 0.014s sys 0.025s
W20260203 09:17:38.881093 28701 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s user 0.000s sys 0.039s
I20260203 09:17:38.867247 30494 leader_election.cc:290] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
W20260203 09:17:38.875080 28805 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.728s user 0.010s sys 0.038s
I20260203 09:17:38.886453 29462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53310 (request call id 431) took 1778 ms. Trace:
I20260203 09:17:38.886615 28884 raft_consensus.cc:1240] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:38.876335 30558 raft_consensus.cc:3060] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:17:38.912544 28852 consensus_peers.cc:597] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:38.905709 28808 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.720s user 0.026s sys 0.068s
I20260203 09:17:38.895586 29457 raft_consensus.cc:3060] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:38.886204 30464 raft_consensus.cc:515] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:38.904244 30473 leader_election.cc:290] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:38.923355 28852 leader_election.cc:336] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:38.896482 28700 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s user 0.014s sys 0.025s
W20260203 09:17:38.926216 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 763652us
W20260203 09:17:38.915311 28885 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.589s user 0.017s sys 0.018s
W20260203 09:17:38.927156 28885 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.601s user 0.018s sys 0.018s
I20260203 09:17:38.878145 30421 raft_consensus.cc:515] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:38.914045 29462 rpcz_store.cc:276] 0203 09:17:37.107932 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:37.108078 (+ 146us) service_pool.cc:225] Handling call
0203 09:17:37.121937 (+ 13859us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:37.122141 (+ 204us) raft_consensus.cc:1534] Early marking committed up to index 6
0203 09:17:38.146851 (+1024710us) log.cc:844] Serialized 14 byte log entry
0203 09:17:38.879627 (+732776us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:38.886156 (+ 6529us) raft_consensus.cc:1645] Marking committed up to 6
0203 09:17:38.886214 (+ 58us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:38.886279 (+ 65us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:38.886399 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":1468975,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":322,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":9433,"thread_start_us":1719730,"threads_started":2}
W20260203 09:17:38.926379 28852 leader_election.cc:336] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:38.922364 28808 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.736s user 0.026s sys 0.068s
I20260203 09:17:38.913318 30282 leader_election.cc:290] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 election: Requested vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:38.932493 28852 leader_election.cc:336] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:38.915601 28738 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s user 0.019s sys 0.011s
I20260203 09:17:38.927416 30450 leader_election.cc:290] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:38.913837 28701 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s user 0.000s sys 0.039s
W20260203 09:17:38.915172 30470 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.549s user 0.011s sys 0.012s
W20260203 09:17:38.938653 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 767958us
W20260203 09:17:38.938056 28852 consensus_peers.cc:597] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:38.948788 28700 leader_election.cc:304] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
W20260203 09:17:38.949996 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 265708us
W20260203 09:17:38.940577 30570 log.cc:927] Time spent T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.078s user 0.000s sys 0.001s
W20260203 09:17:38.952553 28619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 350164us
I20260203 09:17:38.936589 30495 leader_election.cc:290] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:38.949646 28852 consensus_peers.cc:597] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:38.947585 30470 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.583s user 0.012s sys 0.012s
W20260203 09:17:38.956744 28852 leader_election.cc:336] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:38.964265 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 464054us
W20260203 09:17:38.963802 28852 leader_election.cc:336] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:38.969642 30481 leader_election.cc:290] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:38.973706 29461 raft_consensus.cc:2468] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 5.
I20260203 09:17:38.968715 30504 raft_consensus.cc:2804] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:38.975613 30473 consensus_queue.cc:1059] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:38.975921 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:38.976718 30473 raft_consensus.cc:3055] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:38.977128 30473 raft_consensus.cc:740] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:38.977566 30423 raft_consensus.cc:515] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:38.979658 30423 leader_election.cc:290] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:38.939188 30405 raft_consensus.cc:515] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:38.980734 30583 consensus_queue.cc:1048] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260203 09:17:38.982168 30397 raft_consensus.cc:515] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:38.983096 30473 consensus_queue.cc:260] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:38.989244 30473 raft_consensus.cc:3060] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:38.990131 30562 consensus_queue.cc:1059] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:38.966818 29426 leader_election.cc:304] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:38.982586 30405 leader_election.cc:290] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:38.991708 30450 raft_consensus.cc:2804] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:17:38.991801 29426 leader_election.cc:304] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:38.992214 30450 raft_consensus.cc:697] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:38.992282 28804 raft_consensus.cc:2468] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 4.
I20260203 09:17:38.993575 30574 raft_consensus.cc:2804] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:17:38.989442 30464 leader_election.cc:290] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:38.994599 30464 raft_consensus.cc:493] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:38.991050 30562 raft_consensus.cc:3055] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:17:38.993160 30450 consensus_queue.cc:237] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:38.998044 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:38.998803 28812 raft_consensus.cc:2393] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 4: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:38.992691 29426 leader_election.cc:304] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:38.994094 30574 raft_consensus.cc:697] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:38.955168 30133 raft_consensus.cc:493] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:38.982354 30392 raft_consensus.cc:515] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:38.989670 30469 raft_consensus.cc:515] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:38.984551 30397 leader_election.cc:290] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Requested vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:38.975559 30504 raft_consensus.cc:697] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:38.995111 30464 raft_consensus.cc:515] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:39.010515 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 323549us
W20260203 09:17:39.013717 28852 consensus_peers.cc:597] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:38.996479 30562 raft_consensus.cc:740] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:38.996526 29457 raft_consensus.cc:2468] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 4.
I20260203 09:17:38.988103 30322 raft_consensus.cc:515] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:39.000836 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 45605.1us
I20260203 09:17:38.984357 30544 raft_consensus.cc:515] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:38.975514 29459 raft_consensus.cc:2468] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
I20260203 09:17:39.007858 30574 consensus_queue.cc:237] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:39.008720 30444 raft_consensus.cc:2804] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:17:39.014782 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:39.017522 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:39.015548 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:39.017513 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:39.023517 28807 raft_consensus.cc:2393] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 4: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:39.023543 28809 raft_consensus.cc:2393] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 4: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:39.024416 28812 raft_consensus.cc:2468] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 4.
I20260203 09:17:39.025837 30392 leader_election.cc:290] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:39.025909 30544 leader_election.cc:290] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:39.026227 30322 leader_election.cc:290] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:39.027938 28810 raft_consensus.cc:2393] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:39.010694 30133 raft_consensus.cc:515] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:39.029841 30431 raft_consensus.cc:515] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:39.019073 30219 consensus_queue.cc:1048] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:39.030359 30133 leader_election.cc:290] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:39.000991 28776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 322685us
I20260203 09:17:39.031693 30504 consensus_queue.cc:237] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:39.033847 29425 leader_election.cc:304] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:39.034097 29461 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:39.035202 30361 raft_consensus.cc:2804] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:17:39.035773 30361 raft_consensus.cc:697] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:39.034106 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:39.036783 30361 consensus_queue.cc:237] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:39.038116 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:39.038282 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:39.038539 28805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36404 (request call id 1250) took 1715 ms. Trace:
I20260203 09:17:39.038877 28806 raft_consensus.cc:2393] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 4: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:39.035673 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:39.015477 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:39.041709 30431 leader_election.cc:290] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:39.020344 28701 leader_election.cc:304] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:38.975546 30390 raft_consensus.cc:515] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:39.021462 29465 raft_consensus.cc:1240] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:39.028714 30558 raft_consensus.cc:515] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:39.011101 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 180307us
I20260203 09:17:39.045378 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:39.052891 28884 raft_consensus.cc:2393] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 4: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:39.047271 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:39.053756 28851 leader_election.cc:304] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:39.014353 28852 consensus_peers.cc:597] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:39.054419 28882 raft_consensus.cc:2393] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 4: Already voted for candidate cf00f643e7da4a98a0a11ea92869c24a in this term.
W20260203 09:17:39.054669 28852 leader_election.cc:336] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:39.055160 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:39.020131 28777 leader_election.cc:304] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:39.047549 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:39.057147 28777 leader_election.cc:304] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:39.050340 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:39.058023 28888 raft_consensus.cc:2393] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 3: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:39.058125 28777 leader_election.cc:304] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:39.050959 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:39.058830 30133 raft_consensus.cc:2749] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:39.057088 28889 raft_consensus.cc:2368] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3.
I20260203 09:17:39.058913 28887 raft_consensus.cc:2393] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 3: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:39.059939 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:39.060107 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fabfb779b8894cf0b22204fe12768dc3" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:39.055932 28882 raft_consensus.cc:2393] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 3: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:39.060539 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:39.061419 28888 raft_consensus.cc:2393] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 4: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:39.061519 28777 leader_election.cc:304] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:39.062256 30133 raft_consensus.cc:2804] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:39.063138 30133 raft_consensus.cc:493] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:39.038909 28805 rpcz_store.cc:276] 0203 09:17:37.322942 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:38.045171 (+722229us) service_pool.cc:225] Handling call
0203 09:17:38.045513 (+ 342us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:17:38.045728 (+ 215us) raft_consensus.cc:1534] Early marking committed up to index 2
0203 09:17:38.914917 (+869189us) log.cc:844] Serialized 14 byte log entry
0203 09:17:39.037624 (+122707us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:17:39.037680 (+ 56us) raft_consensus.cc:1645] Marking committed up to 2
0203 09:17:39.037721 (+ 41us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:39.038371 (+ 650us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:39.038488 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":65658,"prepare.queue_time_us":890300,"prepare.run_cpu_time_us":2613,"prepare.run_wall_time_us":6130,"raft.queue_time_us":20509,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":870290,"threads_started":2}
I20260203 09:17:39.063570 30133 raft_consensus.cc:3060] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:39.062350 28777 leader_election.cc:304] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:39.065179 28777 leader_election.cc:304] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:39.065790 28777 leader_election.cc:304] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:39.055917 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:39.070044 28807 raft_consensus.cc:3060] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:39.070569 28851 leader_election.cc:304] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:39.071707 28851 leader_election.cc:304] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:39.055238 28852 leader_election.cc:336] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:39.028581 30464 leader_election.cc:290] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:39.074074 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:39.039589 30444 raft_consensus.cc:697] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:39.078599 28777 leader_election.cc:304] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
W20260203 09:17:39.079730 28701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:39.080590 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:39.074538 28852 consensus_peers.cc:597] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:39.083305 28777 leader_election.cc:304] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:39.080456 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:39.085470 28806 raft_consensus.cc:2393] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 4: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:39.089231 30558 leader_election.cc:290] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:39.072749 30481 raft_consensus.cc:2764] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260203 09:17:39.090559 28683 auto_rebalancer.cc:726] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:39.090931 28683 auto_rebalancer.cc:266] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:39.091163 30397 raft_consensus.cc:2804] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:39.091555 30397 raft_consensus.cc:493] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:39.091943 30397 raft_consensus.cc:3060] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:39.093194 28776 leader_election.cc:304] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:39.094053 28776 leader_election.cc:304] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:39.072942 30592 raft_consensus.cc:2804] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:17:39.094597 30469 leader_election.cc:290] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:39.072702 30411 raft_consensus.cc:2804] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:17:39.052121 30486 raft_consensus.cc:3060] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:39.013322 30542 raft_consensus.cc:515] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:39.096963 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:39.102579 28889 raft_consensus.cc:2393] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 4: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:39.103577 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:39.106421 30390 leader_election.cc:290] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:39.022567 30471 consensus_queue.cc:1059] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.062s
I20260203 09:17:39.107270 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:39.108026 28888 raft_consensus.cc:2393] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 5: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:39.108794 30411 raft_consensus.cc:697] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:39.109671 30411 consensus_queue.cc:237] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:39.070343 30392 raft_consensus.cc:2749] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:39.051659 30577 raft_consensus.cc:2804] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:39.107118 30390 raft_consensus.cc:2804] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:39.093478 30561 raft_consensus.cc:2804] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:17:39.104629 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:39.111673 28888 raft_consensus.cc:1240] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260203 09:17:39.083770 28852 consensus_peers.cc:597] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:39.073022 30544 raft_consensus.cc:2804] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:39.072779 30494 raft_consensus.cc:2749] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:39.072908 30423 raft_consensus.cc:2749] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:39.120605 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:39.143424 28811 raft_consensus.cc:1240] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Rejecting Update request from peer cf00f643e7da4a98a0a11ea92869c24a for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:39.107928 30471 raft_consensus.cc:3055] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEADER]: Stepping down as leader of term 4
I20260203 09:17:39.121490 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:39.085047 30495 raft_consensus.cc:2804] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:39.081712 30470 raft_consensus.cc:493] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
W20260203 09:17:39.136121 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 142672us
W20260203 09:17:39.148295 28700 connection.cc:232] RPC call timeout handler was delayed by -1.4726690540001073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2385s for a response
I20260203 09:17:39.090574 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:39.095641 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:39.148716 28700 connection.cc:232] RPC call timeout handler was delayed by -1.2804237380000814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27130000000000004s for a response
I20260203 09:17:39.149369 28813 raft_consensus.cc:2393] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 4: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:39.044708 30573 consensus_queue.cc:1048] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.125s
I20260203 09:17:39.144022 28806 raft_consensus.cc:2468] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 5.
I20260203 09:17:39.175386 30425 raft_consensus.cc:515] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:39.182178 28887 raft_consensus.cc:2393] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 4: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:39.121994 30390 raft_consensus.cc:493] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:39.183768 30390 raft_consensus.cc:3060] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:39.119310 30577 raft_consensus.cc:493] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:39.133549 30544 raft_consensus.cc:493] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:39.188372 30577 raft_consensus.cc:3060] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:39.175931 28700 leader_election.cc:400] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Vote denied by peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627) with higher term. Message: Invalid argument: T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for earlier term 3. Current term is 4.
I20260203 09:17:39.192175 28700 leader_election.cc:403] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260203 09:17:39.145004 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 127900us
I20260203 09:17:39.148036 30392 raft_consensus.cc:2804] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:39.192852 30504 raft_consensus.cc:2749] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627) with higher term. Message: Invalid argument: T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for earlier term 3. Current term is 4.
I20260203 09:17:39.149003 30561 raft_consensus.cc:697] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:39.194401 30561 consensus_queue.cc:237] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:39.156313 30495 raft_consensus.cc:493] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:39.196316 30495 raft_consensus.cc:3060] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:39.147856 30471 raft_consensus.cc:740] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:39.197431 30471 consensus_queue.cc:260] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:39.175837 30470 raft_consensus.cc:515] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:39.198642 30471 raft_consensus.cc:3060] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:39.198845 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:39.199672 28886 raft_consensus.cc:2393] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:39.200927 30392 raft_consensus.cc:697] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:39.201049 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:39.191072 30444 consensus_queue.cc:237] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:39.202023 28884 raft_consensus.cc:2410] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260203 09:17:39.177314 30421 leader_election.cc:290] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:39.191730 30544 raft_consensus.cc:3060] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:39.192973 30542 leader_election.cc:290] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Requested vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:39.201871 30392 consensus_queue.cc:237] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:39.240546 28852 consensus_peers.cc:597] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:39.241084 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 119551us
I20260203 09:17:39.258693 30562 consensus_queue.cc:260] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:39.260210 30562 raft_consensus.cc:3060] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:39.229074 30592 raft_consensus.cc:697] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:39.265244 30592 consensus_queue.cc:237] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:39.278599 28776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 184596us
W20260203 09:17:39.159332 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 76094.7us
I20260203 09:17:39.308130 28777 leader_election.cc:304] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:39.279995 28776 leader_election.cc:304] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:39.318428 30606 raft_consensus.cc:2804] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader election won for term 5
I20260203 09:17:39.318596 28776 leader_election.cc:304] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:39.319355 30607 raft_consensus.cc:2804] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:39.319849 30607 raft_consensus.cc:697] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:39.320101 30341 raft_consensus.cc:3060] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:39.320740 30607 consensus_queue.cc:237] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:39.322633 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 128825us
I20260203 09:17:39.323351 29426 leader_election.cc:304] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:39.324038 30254 raft_consensus.cc:2749] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:39.325846 29426 leader_election.cc:304] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:17:39.326629 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 150837us
I20260203 09:17:39.330129 30470 leader_election.cc:290] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:39.333634 30425 leader_election.cc:290] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:39.334424 28885 raft_consensus.cc:1240] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260203 09:17:39.337265 30596 log.cc:927] Time spent T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.152s user 0.003s sys 0.000s
W20260203 09:17:39.241719 28852 leader_election.cc:336] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:39.338617 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 96940.2us
W20260203 09:17:39.342209 30598 log.cc:927] Time spent T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a: Append to log took a long time: real 0.158s user 0.002s sys 0.000s
W20260203 09:17:39.343101 30601 log.cc:927] Time spent T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.148s user 0.001s sys 0.001s
I20260203 09:17:39.343060 30433 leader_election.cc:290] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:39.343773 30593 log.cc:927] Time spent T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.159s user 0.000s sys 0.002s
W20260203 09:17:39.342095 30600 log.cc:927] Time spent T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a: Append to log took a long time: real 0.161s user 0.002s sys 0.001s
W20260203 09:17:39.344806 30597 log.cc:927] Time spent T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.159s user 0.002s sys 0.001s
I20260203 09:17:39.347554 30254 raft_consensus.cc:2764] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260203 09:17:39.347977 30605 log.cc:927] Time spent T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.164s user 0.000s sys 0.002s
I20260203 09:17:39.331413 28700 leader_election.cc:304] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:39.351298 29426 leader_election.cc:304] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:39.353240 28777 leader_election.cc:304] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:39.358937 28777 leader_election.cc:304] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:39.270483 28631 catalog_manager.cc:5654] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index 3 to 4, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New cstate: current_term: 1 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
W20260203 09:17:39.361261 28852 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260203 09:17:39.361718 28700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:39.362588 28807 raft_consensus.cc:2468] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:39.364144 30421 raft_consensus.cc:2804] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:39.350915 30606 raft_consensus.cc:697] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:39.365118 30603 raft_consensus.cc:2749] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:39.365528 30606 consensus_queue.cc:237] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:39.358770 30542 raft_consensus.cc:2804] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:17:39.367571 30542 raft_consensus.cc:697] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:39.365787 30603 consensus_queue.cc:1059] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:39.370003 28700 leader_election.cc:304] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:39.374117 30133 raft_consensus.cc:515] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:39.371662 28852 leader_election.cc:336] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:39.374975 28631 catalog_manager.cc:5654] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 1 to 2, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 2 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:39.376904 28631 catalog_manager.cc:5654] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: config changed from index 4 to 5, VOTER be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) evicted. New cstate: current_term: 3 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:39.379323 30133 leader_election.cc:290] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:39.382589 28809 raft_consensus.cc:1240] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 LEADER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 3. Current term is 4. Ops: []
I20260203 09:17:39.381073 28631 catalog_manager.cc:5654] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 1 to 2, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 2 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:39.384591 28631 catalog_manager.cc:5654] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:39.386154 28631 catalog_manager.cc:5654] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e reported cstate change: term changed from 1 to 3, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 3 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:39.391016 28813 raft_consensus.cc:1240] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 3. Current term is 4. Ops: []
I20260203 09:17:39.396138 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:39.396862 29426 leader_election.cc:304] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:39.399012 30282 consensus_queue.cc:1059] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260203 09:17:39.400012 30282 raft_consensus.cc:3055] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:17:39.400339 30282 raft_consensus.cc:740] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:39.400864 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:39.401113 30282 consensus_queue.cc:260] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:39.402318 30282 raft_consensus.cc:3060] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:39.404292 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:39.405059 28889 raft_consensus.cc:2393] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 3: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:39.369834 30473 raft_consensus.cc:2804] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260203 09:17:39.408136 28851 leader_election.cc:304] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:39.411440 30450 raft_consensus.cc:2804] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:39.413439 28851 leader_election.cc:304] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:39.414489 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:39.425328 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47301e2bbfc94767a9905b0e12141d6d" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:39.425977 28885 raft_consensus.cc:2393] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 3: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:39.379830 30250 raft_consensus.cc:2804] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:39.427057 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:39.427783 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:39.427884 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:39.429008 28887 raft_consensus.cc:3060] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:39.414103 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:39.434191 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:39.434639 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:39.434816 28884 raft_consensus.cc:3060] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:39.435716 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:39.436007 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:39.436514 28807 raft_consensus.cc:2368] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 3. Current term is 4.
I20260203 09:17:39.437276 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:39.437948 28807 raft_consensus.cc:2393] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:39.438609 28777 leader_election.cc:304] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:39.439635 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:39.406113 30254 raft_consensus.cc:2749] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:39.442909 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:39.444072 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:39.454087 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:39.447546 28887 raft_consensus.cc:2468] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 4.
I20260203 09:17:39.449169 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:39.451196 30133 raft_consensus.cc:2749] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:39.452329 28851 leader_election.cc:304] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:39.455639 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:39.456158 28808 raft_consensus.cc:3060] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:39.456288 28851 leader_election.cc:304] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:39.406893 30421 raft_consensus.cc:697] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:39.368400 30542 consensus_queue.cc:237] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:39.459149 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:39.373360 30495 raft_consensus.cc:515] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:39.412586 30473 raft_consensus.cc:493] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260203 09:17:39.453177 28852 leader_election.cc:336] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:39.461717 28851 leader_election.cc:304] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:39.380223 30433 consensus_queue.cc:1059] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260203 09:17:39.473709 30433 raft_consensus.cc:3055] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:39.474120 30433 raft_consensus.cc:740] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:39.474984 30433 consensus_queue.cc:260] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:39.476330 30433 raft_consensus.cc:3060] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:39.463420 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:39.412417 29457 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:39.477198 28812 raft_consensus.cc:2368] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 2. Current term is 3.
I20260203 09:17:39.478112 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:39.478829 28812 raft_consensus.cc:2393] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:39.479568 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:39.480243 28812 raft_consensus.cc:2393] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 4: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:39.448396 30606 raft_consensus.cc:493] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:39.481020 30606 raft_consensus.cc:515] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:39.483451 30606 leader_election.cc:290] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:39.484910 29461 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:39.486208 29461 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:39.487303 29461 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:39.458277 30250 raft_consensus.cc:697] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:39.489336 30250 consensus_queue.cc:237] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:39.395154 30397 raft_consensus.cc:515] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:39.466969 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:39.497593 28806 raft_consensus.cc:3060] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:39.497913 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:39.467666 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:39.406136 30468 consensus_queue.cc:1059] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260203 09:17:39.468207 28884 raft_consensus.cc:2468] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
I20260203 09:17:39.468506 28851 leader_election.cc:400] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Vote denied by peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611) with higher term. Message: Invalid argument: T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 3. Current term is 4.
I20260203 09:17:39.499442 28851 leader_election.cc:403] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260203 09:17:39.469220 28777 leader_election.cc:304] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:39.422595 30423 raft_consensus.cc:2749] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:39.501895 28851 leader_election.cc:304] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:39.504266 28810 raft_consensus.cc:1240] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:39.503383 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:39.458397 30494 raft_consensus.cc:2749] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:39.488384 29461 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fabfb779b8894cf0b22204fe12768dc3" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:39.464046 29458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:39.465839 30425 raft_consensus.cc:2749] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260203 09:17:39.462683 30405 raft_consensus.cc:2804] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260203 09:17:39.493549 30473 raft_consensus.cc:3060] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:39.505647 30558 raft_consensus.cc:2749] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611) with higher term. Message: Invalid argument: T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 3. Current term is 4.
I20260203 09:17:39.492446 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:39.496948 30322 raft_consensus.cc:2749] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:39.539301 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:39.540536 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:39.511175 28777 leader_election.cc:304] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:39.542312 28777 leader_election.cc:304] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
W20260203 09:17:39.542537 28702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:39.536046 30421 consensus_queue.cc:237] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:39.535418 28852 leader_election.cc:336] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:39.545704 28810 raft_consensus.cc:1240] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 4. Current term is 5. Ops: []
I20260203 09:17:39.525658 30464 raft_consensus.cc:2749] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:39.570786 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:39.545454 30606 raft_consensus.cc:2749] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260203 09:17:39.530607 30405 raft_consensus.cc:493] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:39.561924 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:39.576110 29463 raft_consensus.cc:2468] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:39.528578 30411 raft_consensus.cc:2804] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:17:39.548804 30612 raft_consensus.cc:2804] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:39.553589 30602 consensus_queue.cc:1059] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.147s
W20260203 09:17:39.581036 28852 leader_election.cc:336] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:39.587940 28852 leader_election.cc:304] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:39.589360 28806 raft_consensus.cc:2410] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260203 09:17:39.585866 30449 consensus_queue.cc:1059] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260203 09:17:39.593395 30562 consensus_queue.cc:1059] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:39.594588 30449 raft_consensus.cc:3055] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:39.595149 30449 raft_consensus.cc:740] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:39.595919 30464 raft_consensus.cc:2749] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:39.607751 28882 raft_consensus.cc:2468] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
W20260203 09:17:39.586607 30610 log.cc:927] Time spent T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.128s user 0.001s sys 0.000s
I20260203 09:17:39.600342 30282 raft_consensus.cc:3055] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 4 LEADER]: Stepping down as leader of term 4
W20260203 09:17:39.610980 28852 leader_election.cc:336] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:39.613385 28852 leader_election.cc:304] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:39.582304 30405 raft_consensus.cc:3060] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:39.574151 30583 consensus_queue.cc:1059] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260203 09:17:39.569795 30544 raft_consensus.cc:515] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:39.600242 30473 raft_consensus.cc:515] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:39.631590 28852 leader_election.cc:336] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:39.647495 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:39.611603 30612 raft_consensus.cc:697] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:39.633556 30583 consensus_queue.cc:1243] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer be3b58b70fd74625a8ae8dfd7db7f6ee log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260203 09:17:39.638091 29427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:39.603101 30411 raft_consensus.cc:697] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:39.613217 30282 raft_consensus.cc:740] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:39.624907 29457 raft_consensus.cc:2468] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
I20260203 09:17:39.592163 30577 raft_consensus.cc:515] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:39.650655 28851 leader_election.cc:400] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Vote denied by peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611) with higher term. Message: Invalid argument: T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 2. Current term is 3.
I20260203 09:17:39.656821 28884 raft_consensus.cc:1275] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260203 09:17:39.639308 30495 leader_election.cc:290] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:39.621263 30431 raft_consensus.cc:2749] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:39.671770 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:39.682766 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:39.683426 28884 raft_consensus.cc:2468] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 3.
I20260203 09:17:39.676409 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:39.684348 28886 raft_consensus.cc:2368] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a for earlier term 3. Current term is 4.
I20260203 09:17:39.596124 30449 consensus_queue.cc:260] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:39.685771 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:39.686389 29465 raft_consensus.cc:2468] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:39.687160 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:39.687664 29465 raft_consensus.cc:3060] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Advancing to term 4
W20260203 09:17:39.659879 28852 leader_election.cc:336] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:39.660276 28889 raft_consensus.cc:1240] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Rejecting Update request from peer cf00f643e7da4a98a0a11ea92869c24a for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:39.679710 28851 leader_election.cc:403] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260203 09:17:39.674587 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:39.690423 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
W20260203 09:17:39.692585 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 110928us
I20260203 09:17:39.692842 28884 raft_consensus.cc:3060] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:39.693053 28851 leader_election.cc:304] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:39.657842 30397 leader_election.cc:290] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:39.697157 28889 raft_consensus.cc:1240] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Rejecting Update request from peer cf00f643e7da4a98a0a11ea92869c24a for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:39.660778 30450 raft_consensus.cc:697] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 3 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:39.645329 30390 raft_consensus.cc:515] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:39.705775 28812 raft_consensus.cc:1240] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:39.707723 28851 leader_election.cc:304] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:39.710399 29465 raft_consensus.cc:2468] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 4.
I20260203 09:17:39.712149 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:39.717285 28810 raft_consensus.cc:1275] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260203 09:17:39.713389 28886 raft_consensus.cc:1275] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260203 09:17:39.716675 28811 raft_consensus.cc:1275] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260203 09:17:39.724377 29426 leader_election.cc:304] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:39.725960 28851 leader_election.cc:304] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:39.726359 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:39.727809 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:39.730739 28851 leader_election.cc:304] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:39.697458 30464 raft_consensus.cc:2749] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611) with higher term. Message: Invalid argument: T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for earlier term 2. Current term is 3.
I20260203 09:17:39.750761 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:39.731905 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:39.756008 29465 raft_consensus.cc:2410] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260203 09:17:39.734805 28700 leader_election.cc:304] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:39.711871 30486 raft_consensus.cc:2749] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:39.717276 30250 raft_consensus.cc:493] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:39.718847 30449 raft_consensus.cc:3060] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:39.711697 30617 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:39.763016 28851 leader_election.cc:304] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:39.772107 28851 leader_election.cc:304] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:39.742156 30341 raft_consensus.cc:3055] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:17:39.779636 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:39.732689 30558 raft_consensus.cc:2749] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260203 09:17:39.780406 28884 raft_consensus.cc:2468] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 5.
I20260203 09:17:39.759263 30322 raft_consensus.cc:2749] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260203 09:17:39.813668 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 89355.4us
I20260203 09:17:39.814468 29426 leader_election.cc:400] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 election: Vote denied by peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899) with higher term. Message: Invalid argument: T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a for earlier term 3. Current term is 4.
I20260203 09:17:39.814755 29426 leader_election.cc:403] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260203 09:17:39.732578 30538 raft_consensus.cc:2749] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260203 09:17:39.750619 30583 raft_consensus.cc:493] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:39.742874 29458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:39.740483 29461 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:39.783527 30486 raft_consensus.cc:2749] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260203 09:17:39.803233 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 82992.4us
I20260203 09:17:39.804168 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:39.785265 30603 raft_consensus.cc:493] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:39.781353 30341 raft_consensus.cc:740] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:39.783316 30617 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:39.778785 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:39.772631 30250 raft_consensus.cc:515] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:39.769505 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:39.810024 30473 leader_election.cc:290] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 6 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:39.810384 30633 raft_consensus.cc:2804] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:39.782541 28851 leader_election.cc:304] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:39.781948 30504 raft_consensus.cc:2749] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:39.777256 30612 consensus_queue.cc:237] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:39.779001 30464 raft_consensus.cc:2749] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:39.743970 30444 consensus_queue.cc:1048] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260203 09:17:39.811939 28777 leader_election.cc:304] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:39.806473 30450 consensus_queue.cc:237] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:39.727912 30282 consensus_queue.cc:260] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:39.834156 29461 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:39.829944 30583 raft_consensus.cc:515] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:39.830322 30619 log.cc:927] Time spent T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.052s user 0.000s sys 0.001s
I20260203 09:17:39.832177 29458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:39.860754 30544 leader_election.cc:290] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:39.762044 30411 consensus_queue.cc:237] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:39.832307 30625 consensus_queue.cc:1048] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260203 09:17:39.861129 30631 raft_consensus.cc:493] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:39.867051 28808 raft_consensus.cc:2468] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 4.
W20260203 09:17:39.880242 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 97882.4us
I20260203 09:17:39.881337 29456 raft_consensus.cc:2468] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 5.
I20260203 09:17:39.865850 30603 raft_consensus.cc:515] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:39.892747 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 106135us
I20260203 09:17:39.883395 30486 raft_consensus.cc:2749] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:39.881703 30577 leader_election.cc:290] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:39.899158 28851 leader_election.cc:304] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:39.876046 29457 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:39.879729 30633 raft_consensus.cc:493] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:39.896533 29459 raft_consensus.cc:2393] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 4: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:39.914410 28884 raft_consensus.cc:1240] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 4. Current term is 5. Ops: []
I20260203 09:17:39.927455 28851 leader_election.cc:304] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:39.899731 30282 raft_consensus.cc:3060] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:39.917371 28889 raft_consensus.cc:1240] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 3. Current term is 4. Ops: []
W20260203 09:17:39.921156 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 150205us
I20260203 09:17:39.925006 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:39.925697 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:39.883283 30405 raft_consensus.cc:515] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:39.896795 30397 raft_consensus.cc:2804] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader election won for term 5
I20260203 09:17:39.915436 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:39.908448 30390 leader_election.cc:290] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:39.930873 30620 raft_consensus.cc:2749] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260203 09:17:39.973554 28700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:39.932101 28701 leader_election.cc:304] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:39.933020 30250 leader_election.cc:290] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:39.933830 30464 raft_consensus.cc:2749] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:39.927328 30633 raft_consensus.cc:3060] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Advancing to term 4
W20260203 09:17:39.934754 30628 log.cc:927] Time spent T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.053s user 0.000s sys 0.000s
I20260203 09:17:39.936554 30583 leader_election.cc:290] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:39.947569 28887 raft_consensus.cc:2368] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3.
I20260203 09:17:39.950358 28882 raft_consensus.cc:2393] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 3: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:39.929126 28851 leader_election.cc:304] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:39.922042 30471 consensus_queue.cc:1059] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260203 09:17:39.952236 30397 raft_consensus.cc:697] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:39.952407 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:39.952708 28806 raft_consensus.cc:1240] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 3. Current term is 4. Ops: []
I20260203 09:17:39.963303 28811 raft_consensus.cc:1217] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 LEADER]: Deduplicated request from leader. Original: 2.2->[3.3-3.3] Dedup: 3.3->[]
I20260203 09:17:39.945334 29458 raft_consensus.cc:2393] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 4: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
W20260203 09:17:39.982700 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 50679.2us
I20260203 09:17:40.000547 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:39.945638 30632 raft_consensus.cc:2749] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899) with higher term. Message: Invalid argument: T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a for earlier term 3. Current term is 4.
I20260203 09:17:40.001956 28813 raft_consensus.cc:1240] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 3. Current term is 4. Ops: []
I20260203 09:17:40.002110 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:40.010854 30627 raft_consensus.cc:493] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:40.008186 30504 raft_consensus.cc:2749] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:40.016199 30397 consensus_queue.cc:237] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:40.008441 30250 raft_consensus.cc:493] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:40.017453 30250 raft_consensus.cc:515] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:39.926234 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:40.019742 30627 raft_consensus.cc:515] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:40.020387 30444 raft_consensus.cc:3055] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:40.020804 30444 raft_consensus.cc:740] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:40.003559 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:40.021183 30583 consensus_queue.cc:1059] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:39.911846 30631 raft_consensus.cc:515] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:40.022717 30627 leader_election.cc:290] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:40.010941 30464 raft_consensus.cc:2749] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:40.019402 30250 leader_election.cc:290] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:40.000924 28777 leader_election.cc:336] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:40.008905 28811 raft_consensus.cc:1240] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 LEADER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260203 09:17:40.008870 28805 raft_consensus.cc:2368] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3.
W20260203 09:17:40.007225 30392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s user 0.040s sys 0.035s
W20260203 09:17:40.027372 30392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s user 0.040s sys 0.036s
I20260203 09:17:40.014514 28701 leader_election.cc:400] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899) with higher term. Message: Invalid argument: T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3.
I20260203 09:17:40.028746 28701 leader_election.cc:403] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260203 09:17:40.029215 30583 raft_consensus.cc:3055] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:40.028740 30449 consensus_queue.cc:1048] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:17:40.029639 30583 raft_consensus.cc:740] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:40.025475 29460 raft_consensus.cc:1275] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260203 09:17:40.014572 30405 leader_election.cc:290] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:40.030609 30583 consensus_queue.cc:260] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:40.032063 30392 consensus_queue.cc:1048] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260203 09:17:40.033010 30583 raft_consensus.cc:3060] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:40.033740 30617 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:40.002789 30577 raft_consensus.cc:493] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
W20260203 09:17:40.037796 28777 leader_election.cc:336] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:40.006438 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 77422.2us
I20260203 09:17:40.040122 28851 leader_election.cc:304] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:40.039208 28777 leader_election.cc:304] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:40.017959 30604 log.cc:927] Time spent T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.751s user 0.000s sys 0.004s
W20260203 09:17:40.049045 28777 leader_election.cc:336] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:40.049665 28777 leader_election.cc:304] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:40.051075 28777 leader_election.cc:336] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:40.051469 28777 leader_election.cc:304] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:40.051887 28701 leader_election.cc:304] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:17:40.052598 28777 leader_election.cc:336] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:40.053138 28777 leader_election.cc:304] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:40.054039 28702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:40.054998 28851 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:40.053164 28701 leader_election.cc:304] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:40.059998 28851 leader_election.cc:304] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:40.060127 28777 leader_election.cc:336] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:40.061228 28777 leader_election.cc:336] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:40.061761 28777 leader_election.cc:304] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:40.064275 28851 leader_election.cc:304] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:40.061132 28701 leader_election.cc:304] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:40.010401 30639 raft_consensus.cc:493] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:40.058050 30621 raft_consensus.cc:2749] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:40.037528 30627 raft_consensus.cc:3060] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Advancing to term 3
W20260203 09:17:40.088455 28777 leader_election.cc:336] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:40.097155 28777 leader_election.cc:336] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:40.098096 28777 leader_election.cc:304] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:40.114429 28777 leader_election.cc:336] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:40.062642 30405 raft_consensus.cc:2749] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:40.062469 30562 raft_consensus.cc:3060] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:40.123800 28883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40946 (request call id 1232) took 1075 ms. Trace:
I20260203 09:17:40.124311 28883 rpcz_store.cc:276] 0203 09:17:39.048209 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:39.050411 (+ 2202us) service_pool.cc:225] Handling call
0203 09:17:39.051597 (+ 1186us) raft_consensus.cc:1471] Updating replica for 1 ops
0203 09:17:39.072585 (+ 20988us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:39.072617 (+ 32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0203 09:17:39.076335 (+ 3718us) log.cc:844] Serialized 26 byte log entry
0203 09:17:39.156844 (+ 80509us) raft_consensus.cc:1645] Marking committed up to 1
0203 09:17:39.156882 (+ 38us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:39.157037 (+ 155us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0203 09:17:40.010944 (+853907us) spinlock_profiling.cc:243] Waited 84.1 ms on lock 0x7b440002304c. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd0b478b1 00007f2cd0c16005 00007f2cd0c16a22 00007f2cd396057b 00007f2cd395be4f 00007f2cd394fc0e 00007f2cd394ef56 00007f2cd394eb78 00007f2cd39585c1 00007f2cd3958579 00007f2cd3958509
0203 09:17:40.123464 (+112520us) raft_consensus.cc:1685] finished
0203 09:17:40.123488 (+ 24us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:40.123731 (+ 243us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":102,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":14950,"spinlock_wait_cycles":193377152,"thread_start_us":66260,"threads_started":1,"wal-append.queue_time_us":176021}
I20260203 09:17:40.061937 30592 raft_consensus.cc:3060] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:40.118387 29459 raft_consensus.cc:1275] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260203 09:17:40.101539 30645 log.cc:927] Time spent T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.093s user 0.000s sys 0.000s
I20260203 09:17:40.099635 30639 raft_consensus.cc:515] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:40.131413 30639 leader_election.cc:290] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:40.049278 30577 raft_consensus.cc:515] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:40.107043 30603 leader_election.cc:290] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:40.108165 30473 raft_consensus.cc:2749] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260203 09:17:40.068603 30607 raft_consensus.cc:2749] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:40.108789 29456 raft_consensus.cc:2468] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
I20260203 09:17:40.109472 30486 raft_consensus.cc:2804] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:40.112437 30633 raft_consensus.cc:515] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:40.093950 28851 leader_election.cc:304] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:40.137485 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 43647.7us
I20260203 09:17:40.140170 30538 raft_consensus.cc:2804] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:40.140614 30538 raft_consensus.cc:493] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:40.141067 30538 raft_consensus.cc:3060] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:40.136281 30486 raft_consensus.cc:493] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:40.145447 30486 raft_consensus.cc:3060] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:40.115068 30390 raft_consensus.cc:2749] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:40.058565 30392 raft_consensus.cc:2749] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:40.058823 30250 raft_consensus.cc:2749] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260203 09:17:40.085980 30464 raft_consensus.cc:2749] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:40.091878 30620 raft_consensus.cc:2749] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:40.092123 30411 raft_consensus.cc:2749] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:40.021556 30444 consensus_queue.cc:260] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:40.090764 30631 leader_election.cc:290] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:40.117061 30504 raft_consensus.cc:493] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:40.127496 28777 leader_election.cc:304] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:40.154953 28851 leader_election.cc:304] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:40.157426 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 147575us
I20260203 09:17:40.162978 28776 leader_election.cc:304] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
W20260203 09:17:40.172575 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 58187.5us
I20260203 09:17:40.116577 29457 raft_consensus.cc:2468] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 5.
W20260203 09:17:40.177944 28777 leader_election.cc:336] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:40.180480 28777 leader_election.cc:336] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:40.180994 28700 leader_election.cc:400] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Vote denied by peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611) with higher term. Message: Invalid argument: T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3.
I20260203 09:17:40.175280 30361 raft_consensus.cc:3055] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:40.189137 28700 leader_election.cc:403] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260203 09:17:40.177019 30411 raft_consensus.cc:2804] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:17:40.190191 30646 consensus_queue.cc:1059] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 3.3, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260203 09:17:40.192674 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:40.176461 30254 raft_consensus.cc:3055] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:40.176400 30620 raft_consensus.cc:2804] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:17:40.176901 30607 raft_consensus.cc:2749] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:40.171638 30504 raft_consensus.cc:515] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:40.206542 30411 raft_consensus.cc:697] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:40.212002 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:40.210181 30646 consensus_queue.cc:1243] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer be3b58b70fd74625a8ae8dfd7db7f6ee log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260203 09:17:40.205340 30254 raft_consensus.cc:740] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:40.217034 30411 consensus_queue.cc:237] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:40.217232 30254 consensus_queue.cc:260] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:40.204490 30361 raft_consensus.cc:740] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:40.181557 30250 consensus_queue.cc:1059] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260203 09:17:40.210307 30473 raft_consensus.cc:3060] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:40.180435 30639 consensus_queue.cc:1059] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
W20260203 09:17:40.220844 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 345523us
I20260203 09:17:40.225193 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fabfb779b8894cf0b22204fe12768dc3" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
W20260203 09:17:40.227803 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 166726us
I20260203 09:17:40.228588 28810 raft_consensus.cc:1275] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:17:40.229674 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:40.241593 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:40.239182 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "021e904a783c4cbc96e5aa625a34a2d8" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:40.251132 28810 raft_consensus.cc:1275] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260203 09:17:40.243287 28701 leader_election.cc:304] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:40.249099 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b2c469d7255413d9f61a7cbaa4481a7" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:40.246431 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:40.264052 28812 raft_consensus.cc:2368] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a for earlier term 3. Current term is 4.
W20260203 09:17:40.246524 30649 log.cc:927] Time spent T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a: Append to log took a long time: real 0.075s user 0.001s sys 0.000s
I20260203 09:17:40.273036 28701 leader_election.cc:304] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:40.274519 29425 leader_election.cc:400] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Vote denied by peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611) with higher term. Message: Invalid argument: T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a for earlier term 3. Current term is 4.
I20260203 09:17:40.243029 30254 raft_consensus.cc:3060] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:40.274884 29425 leader_election.cc:403] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260203 09:17:40.255561 28804 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50256 (request call id 228) took 1212 ms. Trace:
I20260203 09:17:40.251945 30577 leader_election.cc:290] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:40.296758 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 108773us
I20260203 09:17:40.252964 30633 leader_election.cc:290] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:40.240201 30538 raft_consensus.cc:515] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:40.264974 30250 consensus_queue.cc:1059] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260203 09:17:40.270473 30542 consensus_queue.cc:1048] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260203 09:17:40.303825 30450 raft_consensus.cc:3060] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 4
I20260203 09:17:40.275707 30639 consensus_queue.cc:1048] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260203 09:17:40.294309 30617 consensus_queue.cc:1048] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260203 09:17:40.259997 30361 consensus_queue.cc:260] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:40.328922 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 51969.9us
I20260203 09:17:40.329793 28701 leader_election.cc:304] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:40.312433 30627 raft_consensus.cc:2749] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899) with higher term. Message: Invalid argument: T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3.
I20260203 09:17:40.331364 28701 leader_election.cc:400] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 election: Vote denied by peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899) with higher term. Message: Invalid argument: T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3.
I20260203 09:17:40.295567 28804 rpcz_store.cc:276] 0203 09:17:39.043539 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:39.046069 (+ 2530us) service_pool.cc:225] Handling call
0203 09:17:39.637864 (+591795us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b54000aa8a0. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3d2cdf0 00007f2cd3db8a98 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:40.255285 (+617421us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54003642d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:40.255495 (+ 210us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":539963904}
I20260203 09:17:40.322752 30620 raft_consensus.cc:697] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 4 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:40.335501 30577 raft_consensus.cc:2749] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260203 09:17:40.336263 30577 consensus_queue.cc:1059] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:40.335822 30620 consensus_queue.cc:237] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:40.337316 30577 raft_consensus.cc:3055] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:17:40.337711 30577 raft_consensus.cc:740] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:40.338572 30577 consensus_queue.cc:260] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:40.339941 30577 raft_consensus.cc:3060] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:40.335875 30650 raft_consensus.cc:2749] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:40.344224 30361 raft_consensus.cc:3060] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:40.324065 30250 raft_consensus.cc:2749] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:40.366593 28701 leader_election.cc:304] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:40.385032 30411 raft_consensus.cc:493] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:40.385903 30411 raft_consensus.cc:515] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:40.410367 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:40.411695 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:40.413053 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:40.414362 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:40.416010 28885 raft_consensus.cc:1275] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260203 09:17:40.417196 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:40.417999 28884 raft_consensus.cc:2393] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 6: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:40.430438 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b2c469d7255413d9f61a7cbaa4481a7" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:40.430908 30411 leader_election.cc:290] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:40.432236 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "021e904a783c4cbc96e5aa625a34a2d8" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:40.434145 30592 raft_consensus.cc:2749] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:40.434978 28811 raft_consensus.cc:3060] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:40.437448 30538 leader_election.cc:290] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:40.437626 30486 raft_consensus.cc:515] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:40.412156 30250 raft_consensus.cc:3060] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:40.439625 30486 leader_election.cc:290] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:40.405112 30504 leader_election.cc:290] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:40.441277 29464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53326 (request call id 497) took 1030 ms. Trace:
I20260203 09:17:40.441675 29464 rpcz_store.cc:276] 0203 09:17:39.410798 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:39.426826 (+ 16028us) service_pool.cc:225] Handling call
0203 09:17:40.441065 (+1014239us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b54007102d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:40.441205 (+ 140us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1992044288}
I20260203 09:17:40.444509 30562 raft_consensus.cc:2749] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:40.446449 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
W20260203 09:17:40.447700 29427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:40.447600 28811 raft_consensus.cc:2468] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 6.
W20260203 09:17:40.449496 28777 leader_election.cc:336] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:40.449970 28777 leader_election.cc:304] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:40.453876 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 171486us
W20260203 09:17:40.453480 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 208159us
W20260203 09:17:40.455564 28777 leader_election.cc:336] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:40.459236 28777 leader_election.cc:304] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:40.460287 28777 leader_election.cc:336] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:40.461524 28777 leader_election.cc:336] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:40.462616 28777 leader_election.cc:336] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:40.463371 28777 leader_election.cc:336] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:40.464679 28777 leader_election.cc:336] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:40.465983 28777 leader_election.cc:336] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:40.466861 28777 leader_election.cc:336] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:40.458638 28809 raft_consensus.cc:1275] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260203 09:17:40.468118 28777 leader_election.cc:336] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:40.469204 28777 leader_election.cc:336] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:40.469650 28777 leader_election.cc:304] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:40.457223 28700 leader_election.cc:304] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:40.472797 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:40.473598 28777 leader_election.cc:336] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:40.474392 28777 consensus_peers.cc:597] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:40.474783 28777 leader_election.cc:336] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:40.476329 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:40.445479 30473 raft_consensus.cc:2749] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611) with higher term. Message: Invalid argument: T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for earlier term 2. Current term is 3.
I20260203 09:17:40.455423 28701 leader_election.cc:304] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:17:40.529436 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 53774.4us
I20260203 09:17:40.426784 30583 raft_consensus.cc:493] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:40.559226 29465 raft_consensus.cc:1275] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260203 09:17:40.477274 30411 raft_consensus.cc:2749] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260203 09:17:40.579453 30583 raft_consensus.cc:515] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:40.579859 30661 consensus_queue.cc:1048] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:40.584591 30583 leader_election.cc:290] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:40.584123 30341 consensus_queue.cc:260] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:40.590906 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 135577us
I20260203 09:17:40.591704 28701 leader_election.cc:304] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:40.597926 28812 raft_consensus.cc:1217] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 LEADER]: Deduplicated request from leader. Original: 2.2->[3.3-3.3] Dedup: 3.3->[]
I20260203 09:17:40.598598 28812 raft_consensus.cc:1240] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 LEADER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260203 09:17:40.475822 30397 raft_consensus.cc:2749] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:40.497390 30561 raft_consensus.cc:3055] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:40.600718 30561 raft_consensus.cc:740] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:40.541469 30504 raft_consensus.cc:493] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:40.559715 30250 raft_consensus.cc:2749] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:40.476804 30562 raft_consensus.cc:2749] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:40.458679 30542 raft_consensus.cc:2749] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:40.607170 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:40.608232 28806 raft_consensus.cc:2468] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:40.612990 28700 leader_election.cc:304] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:40.537120 28880 raft_consensus.cc:1240] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260203 09:17:40.600510 29428 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:40.623934 28701 leader_election.cc:304] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:40.602468 30621 consensus_queue.cc:1048] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260203 09:17:40.604599 30650 raft_consensus.cc:2749] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:40.630226 28701 leader_election.cc:304] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:40.636622 30562 raft_consensus.cc:2749] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:40.637185 28701 leader_election.cc:304] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:40.637850 30562 raft_consensus.cc:2749] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:40.640568 28812 raft_consensus.cc:1240] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 3. Current term is 4. Ops: []
I20260203 09:17:40.642860 28883 raft_consensus.cc:1275] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:17:40.645102 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:40.645838 28884 raft_consensus.cc:2468] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:40.625278 30250 raft_consensus.cc:2749] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:40.614759 30620 raft_consensus.cc:493] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:40.649008 30650 consensus_queue.cc:1059] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:40.649698 30664 raft_consensus.cc:493] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:40.627882 30473 raft_consensus.cc:2804] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:40.627671 30341 raft_consensus.cc:3060] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:40.655709 28883 raft_consensus.cc:1240] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 3. Current term is 4. Ops: []
W20260203 09:17:40.658646 29427 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:40.628027 30577 consensus_queue.cc:1048] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260203 09:17:40.650254 30561 consensus_queue.cc:260] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:40.659485 30620 raft_consensus.cc:515] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:40.640046 30660 raft_consensus.cc:3060] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:40.615705 30504 raft_consensus.cc:515] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:40.648007 30464 raft_consensus.cc:493] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:40.682063 30561 raft_consensus.cc:3060] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:40.663164 30473 raft_consensus.cc:493] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:40.660681 30583 consensus_queue.cc:1048] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260203 09:17:40.697108 30660 raft_consensus.cc:2749] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260203 09:17:40.692806 30473 raft_consensus.cc:3060] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
W20260203 09:17:40.700001 29426 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.875s user 0.001s sys 0.015s
W20260203 09:17:40.700373 29426 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.875s user 0.001s sys 0.015s
W20260203 09:17:40.700716 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 875793us
I20260203 09:17:40.670030 30664 raft_consensus.cc:515] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:40.696189 30504 leader_election.cc:290] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:40.712704 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b6f1d6e275f4a8ba99a70dbb3ea3235" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:40.700172 30450 raft_consensus.cc:2749] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611) with higher term. Message: Invalid argument: T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a for earlier term 3. Current term is 4.
I20260203 09:17:40.704447 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:40.686528 30577 consensus_queue.cc:1059] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260203 09:17:40.705462 30569 consensus_queue.cc:1048] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260203 09:17:40.723937 30620 leader_election.cc:290] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:40.725571 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:40.726414 28808 raft_consensus.cc:2393] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:40.715952 28883 raft_consensus.cc:2468] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:40.727713 29463 raft_consensus.cc:1275] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260203 09:17:40.706830 30664 leader_election.cc:290] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:40.707425 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:40.717161 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b6f1d6e275f4a8ba99a70dbb3ea3235" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:40.719112 30577 raft_consensus.cc:3055] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:17:40.729319 28701 leader_election.cc:304] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:40.741699 28701 leader_election.cc:304] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:40.744907 28807 raft_consensus.cc:1240] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Rejecting Update request from peer cf00f643e7da4a98a0a11ea92869c24a for earlier term 3. Current term is 4. Ops: []
W20260203 09:17:40.757733 28852 consensus_peers.cc:597] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:40.734687 30577 raft_consensus.cc:740] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:40.760233 30341 raft_consensus.cc:2749] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:40.760310 30577 consensus_queue.cc:260] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:40.744082 30397 consensus_queue.cc:1048] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260203 09:17:40.744103 30405 raft_consensus.cc:493] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:40.762706 30405 raft_consensus.cc:515] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:40.744247 30620 raft_consensus.cc:493] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:40.763908 30620 raft_consensus.cc:515] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:40.762127 30577 raft_consensus.cc:3060] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
W20260203 09:17:40.765986 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 64132us
I20260203 09:17:40.757614 30664 raft_consensus.cc:2804] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:40.769439 30664 raft_consensus.cc:493] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:40.769812 30664 raft_consensus.cc:3060] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:40.685315 30464 raft_consensus.cc:515] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:40.772840 30574 consensus_queue.cc:1059] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260203 09:17:40.802731 28777 leader_election.cc:336] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:40.804281 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:40.804587 29426 leader_election.cc:336] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:40.805435 29425 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:40.758992 30473 raft_consensus.cc:515] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:40.792510 30538 raft_consensus.cc:493] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:40.792717 30405 leader_election.cc:290] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:40.818641 28885 raft_consensus.cc:1240] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Rejecting Update request from peer cf00f643e7da4a98a0a11ea92869c24a for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:40.819782 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:40.820525 28887 raft_consensus.cc:2368] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a for earlier term 3. Current term is 4.
I20260203 09:17:40.826556 29465 raft_consensus.cc:1275] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260203 09:17:40.828944 28882 raft_consensus.cc:1275] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260203 09:17:40.829205 28887 raft_consensus.cc:1240] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Rejecting Update request from peer cf00f643e7da4a98a0a11ea92869c24a for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:40.807682 30620 leader_election.cc:290] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:40.828363 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:40.830744 28887 raft_consensus.cc:1240] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Rejecting Update request from peer cf00f643e7da4a98a0a11ea92869c24a for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:40.841002 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:40.841756 29465 raft_consensus.cc:2376] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 4. Re-sending same reply.
I20260203 09:17:40.843050 29465 raft_consensus.cc:1240] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEADER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 3. Current term is 4. Ops: []
I20260203 09:17:40.844012 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:40.845201 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:40.841207 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:40.845754 28851 leader_election.cc:304] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:40.846872 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:40.848232 29462 raft_consensus.cc:2393] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 5: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
W20260203 09:17:40.837282 28777 leader_election.cc:336] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:40.856618 28777 leader_election.cc:336] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:40.857208 28777 leader_election.cc:304] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:40.860477 28777 leader_election.cc:336] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:40.861090 28777 leader_election.cc:304] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:40.862782 29465 raft_consensus.cc:1240] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 3. Current term is 4. Ops: []
I20260203 09:17:40.865741 29426 leader_election.cc:400] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: Vote denied by peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899) with higher term. Message: Invalid argument: T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a for earlier term 3. Current term is 4.
I20260203 09:17:40.859427 30421 consensus_queue.cc:1048] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260203 09:17:40.824389 30538 raft_consensus.cc:515] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:40.880163 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:40.880833 28885 raft_consensus.cc:3060] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:40.857870 30574 raft_consensus.cc:493] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
W20260203 09:17:40.870061 30672 log.cc:927] Time spent T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.071s user 0.000s sys 0.000s
I20260203 09:17:40.883808 28851 leader_election.cc:304] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:40.865183 30411 raft_consensus.cc:2749] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260203 09:17:40.886211 28777 leader_election.cc:336] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:40.893908 28777 leader_election.cc:336] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:40.894559 28777 leader_election.cc:336] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:40.895136 28777 leader_election.cc:336] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:40.895417 28777 leader_election.cc:304] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:40.874166 30631 raft_consensus.cc:3055] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:17:40.867576 29457 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:40.878247 30473 leader_election.cc:290] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:40.899410 28851 leader_election.cc:304] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:40.870951 30464 leader_election.cc:290] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:40.902119 30594 raft_consensus.cc:2749] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260203 09:17:40.903458 28777 leader_election.cc:336] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:40.901033 30405 raft_consensus.cc:2749] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:40.891772 30390 raft_consensus.cc:3060] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:40.908677 30603 raft_consensus.cc:2749] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260203 09:17:40.913741 28702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:40.905205 28777 leader_election.cc:304] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:40.921835 28885 raft_consensus.cc:2468] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:40.923209 28701 leader_election.cc:304] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
W20260203 09:17:40.914027 30254 consensus_meta.cc:287] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a: Time spent flushing consensus metadata: real 0.618s user 0.008s sys 0.004s
I20260203 09:17:40.900117 30631 raft_consensus.cc:740] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
W20260203 09:17:40.929379 29426 consensus_peers.cc:597] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:40.930995 28777 leader_election.cc:336] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:40.933638 28777 leader_election.cc:304] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:40.933802 29426 leader_election.cc:336] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:40.935506 29458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:40.936204 29426 leader_election.cc:304] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:40.937036 30617 raft_consensus.cc:2749] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260203 09:17:40.937372 29426 leader_election.cc:336] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:40.937909 30577 raft_consensus.cc:493] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:40.922946 30654 raft_consensus.cc:2749] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:40.938444 30577 raft_consensus.cc:515] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:40.895967 30574 raft_consensus.cc:515] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:40.941084 30577 leader_election.cc:290] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:40.942148 30574 leader_election.cc:290] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:40.941824 29426 leader_election.cc:304] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:40.918676 30449 raft_consensus.cc:493] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:40.896080 30450 consensus_queue.cc:1048] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260203 09:17:40.946074 28777 leader_election.cc:336] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:40.943758 29426 consensus_peers.cc:597] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:40.947954 30397 raft_consensus.cc:2749] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260203 09:17:40.942818 30542 raft_consensus.cc:2749] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:40.927484 30473 raft_consensus.cc:2804] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:17:40.926229 30538 leader_election.cc:290] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:40.926008 30569 consensus_queue.cc:1059] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260203 09:17:40.944768 30617 raft_consensus.cc:2749] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:40.941176 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:40.949903 28777 leader_election.cc:304] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:40.950327 29426 consensus_peers.cc:597] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:40.951984 30664 raft_consensus.cc:515] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:40.949131 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:40.984311 29426 consensus_peers.cc:597] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:40.984932 29426 leader_election.cc:336] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:40.985896 29426 consensus_peers.cc:597] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:40.986434 29426 consensus_peers.cc:597] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:40.986953 29426 consensus_peers.cc:597] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:40.991889 29426 consensus_peers.cc:597] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:40.992554 29426 leader_election.cc:336] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:40.993609 29426 leader_election.cc:336] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:40.994035 29426 leader_election.cc:304] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:40.995204 29426 consensus_peers.cc:597] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:40.998128 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47301e2bbfc94767a9905b0e12141d6d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:40.999965 28777 leader_election.cc:336] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:41.000617 28777 leader_election.cc:304] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:41.002694 28777 leader_election.cc:336] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:41.003295 28777 leader_election.cc:304] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:41.004360 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:41.005069 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:40.953466 30449 raft_consensus.cc:515] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:41.001328 30411 raft_consensus.cc:493] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:41.028084 28777 leader_election.cc:336] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:41.002743 28851 leader_election.cc:304] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:41.014302 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:41.016335 29463 raft_consensus.cc:1275] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260203 09:17:41.029474 28885 raft_consensus.cc:3060] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:41.024322 28806 raft_consensus.cc:2393] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 3: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:41.000725 30607 raft_consensus.cc:2749] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:41.006680 30664 leader_election.cc:290] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:41.008837 30397 raft_consensus.cc:2749] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:41.001569 30574 raft_consensus.cc:2749] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260203 09:17:40.975091 30473 raft_consensus.cc:697] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [term 4 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:41.034493 30473 consensus_queue.cc:237] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:41.040076 28885 raft_consensus.cc:2468] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 5.
W20260203 09:17:41.042003 28777 leader_election.cc:336] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:41.043898 28777 leader_election.cc:304] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:41.046379 28777 leader_election.cc:336] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:41.046317 29426 leader_election.cc:336] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:41.039170 28880 raft_consensus.cc:2393] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 4: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:41.048846 28777 leader_election.cc:304] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:41.053483 28701 leader_election.cc:304] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
W20260203 09:17:41.053725 28777 leader_election.cc:336] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:41.055451 28777 leader_election.cc:304] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:41.038515 30405 raft_consensus.cc:2749] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260203 09:17:41.038754 30495 raft_consensus.cc:2749] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260203 09:17:41.057013 28778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:40.983542 30631 consensus_queue.cc:260] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:41.052424 30397 raft_consensus.cc:2749] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260203 09:17:41.069999 30449 leader_election.cc:290] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:41.041831 30655 consensus_queue.cc:1048] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260203 09:17:41.057337 30664 raft_consensus.cc:2804] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Leader election won for term 5
I20260203 09:17:41.056296 30542 raft_consensus.cc:2749] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:41.044234 30411 raft_consensus.cc:515] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } attrs { replace: true } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:41.084208 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:41.085592 30411 leader_election.cc:290] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:41.075289 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:41.086767 30390 raft_consensus.cc:2749] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:41.086944 28885 raft_consensus.cc:2468] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 5.
I20260203 09:17:41.087291 30664 raft_consensus.cc:697] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 5 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:41.103132 28701 leader_election.cc:304] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:41.103319 30664 consensus_queue.cc:237] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:41.104010 30449 raft_consensus.cc:2804] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260203 09:17:41.104480 30449 raft_consensus.cc:493] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:41.104979 30449 raft_consensus.cc:3060] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:41.079388 30561 raft_consensus.cc:2749] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:41.095808 30631 raft_consensus.cc:3060] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
W20260203 09:17:41.076190 28777 leader_election.cc:336] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:41.108690 28777 consensus_peers.cc:597] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:41.109272 28777 leader_election.cc:336] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:41.097771 30691 log.cc:927] Time spent T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a: Append to log took a long time: real 0.066s user 0.002s sys 0.000s
I20260203 09:17:41.099391 30444 raft_consensus.cc:3060] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:41.101296 28851 leader_election.cc:304] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:41.115968 28851 leader_election.cc:304] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:41.118669 30620 raft_consensus.cc:2749] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260203 09:17:41.125633 28777 consensus_peers.cc:597] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:41.126446 28777 leader_election.cc:336] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:41.128424 29426 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 128 similar messages]
W20260203 09:17:41.129122 28777 consensus_peers.cc:597] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:41.129701 28777 consensus_peers.cc:597] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:41.131537 28777 leader_election.cc:336] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:41.141151 28777 consensus_peers.cc:597] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:41.143111 28777 consensus_peers.cc:597] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:41.143643 28777 consensus_peers.cc:597] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:41.144117 28777 consensus_peers.cc:597] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:41.144508 28777 consensus_peers.cc:597] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:41.152791 30449 raft_consensus.cc:515] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:41.153657 30654 raft_consensus.cc:493] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:41.157552 28703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:41.118779 30486 raft_consensus.cc:2749] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260203 09:17:41.159497 30341 raft_consensus.cc:493] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:41.161644 30504 raft_consensus.cc:493] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:41.181036 28777 leader_election.cc:336] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:41.173887 30654 raft_consensus.cc:515] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:41.194810 28701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:41.178848 30341 raft_consensus.cc:515] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:41.199748 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:41.180382 30504 raft_consensus.cc:515] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:41.201493 28804 raft_consensus.cc:1275] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260203 09:17:41.211138 28776 leader_election.cc:304] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:41.211045 28882 raft_consensus.cc:1240] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Rejecting Update request from peer cf00f643e7da4a98a0a11ea92869c24a for earlier term 3. Current term is 4. Ops: []
I20260203 09:17:41.223462 28882 raft_consensus.cc:1275] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260203 09:17:41.215993 30390 raft_consensus.cc:2749] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:41.231130 30254 raft_consensus.cc:3055] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:17:41.231504 30654 leader_election.cc:290] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:41.216238 30471 consensus_queue.cc:1059] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260203 09:17:41.236940 30254 raft_consensus.cc:740] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:41.237417 30341 leader_election.cc:290] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:41.216246 30569 consensus_queue.cc:1048] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260203 09:17:41.234711 30504 leader_election.cc:290] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:41.237901 30254 consensus_queue.cc:260] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:41.239166 30254 raft_consensus.cc:3060] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:41.229883 30590 consensus_queue.cc:1048] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260203 09:17:41.242688 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:41.249742 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:41.250376 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:41.250989 28885 raft_consensus.cc:2468] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:41.250437 28882 raft_consensus.cc:2468] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:41.255263 30632 raft_consensus.cc:3055] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:17:41.255749 30632 raft_consensus.cc:740] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:41.255687 28701 leader_election.cc:304] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:41.256982 28701 leader_election.cc:304] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:41.257694 30449 leader_election.cc:290] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 6 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:41.257869 30631 raft_consensus.cc:493] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:41.259188 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:41.261430 30341 raft_consensus.cc:2804] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:41.257870 28811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36388 (request call id 1837) took 1066 ms. Trace:
I20260203 09:17:41.256839 30632 consensus_queue.cc:260] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:41.267395 28813 raft_consensus.cc:1240] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Rejecting Update request from peer cf00f643e7da4a98a0a11ea92869c24a for earlier term 3. Current term is 4. Ops: []
I20260203 09:17:41.275453 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:41.277129 28811 rpcz_store.cc:276] 0203 09:17:40.191453 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:40.191568 (+ 115us) service_pool.cc:225] Handling call
0203 09:17:41.257705 (+1066137us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54002dc8d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:41.257807 (+ 102us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":529134336}
I20260203 09:17:41.277077 28884 raft_consensus.cc:3060] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:41.278898 28851 leader_election.cc:304] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:41.265218 30504 raft_consensus.cc:2804] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:41.285030 30504 raft_consensus.cc:493] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:41.285408 30504 raft_consensus.cc:3060] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:41.288770 28809 raft_consensus.cc:2393] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a in current term 4: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
W20260203 09:17:41.290840 28702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:41.301453 29425 leader_election.cc:304] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:41.300818 28884 raft_consensus.cc:2468] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 6.
I20260203 09:17:41.304162 28701 leader_election.cc:304] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:41.307680 30661 raft_consensus.cc:3060] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:41.313197 30664 raft_consensus.cc:2804] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Leader election won for term 6
I20260203 09:17:41.313798 30664 raft_consensus.cc:697] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 6 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:41.312099 30504 raft_consensus.cc:515] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:41.314646 30664 consensus_queue.cc:237] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:41.315500 30632 raft_consensus.cc:3060] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Advancing to term 4
W20260203 09:17:41.316552 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 512466us
I20260203 09:17:41.291569 30631 raft_consensus.cc:515] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:41.291359 30620 raft_consensus.cc:2804] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Leader election won for term 6
I20260203 09:17:41.333029 30620 raft_consensus.cc:697] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 6 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:41.291203 30282 raft_consensus.cc:493] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:41.289608 30341 raft_consensus.cc:493] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:41.323856 30449 raft_consensus.cc:493] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:41.330142 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 595235us
I20260203 09:17:41.337704 30620 consensus_queue.cc:237] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:41.351012 28813 raft_consensus.cc:1240] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 3. Current term is 4. Ops: []
I20260203 09:17:41.351012 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:41.351876 28810 raft_consensus.cc:3060] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:41.353668 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:41.356938 28813 raft_consensus.cc:1240] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 3. Current term is 4. Ops: []
I20260203 09:17:41.347268 30405 raft_consensus.cc:493] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:41.363417 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:41.349915 30449 raft_consensus.cc:515] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:41.349573 30661 raft_consensus.cc:2749] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:41.347476 30282 raft_consensus.cc:515] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:41.365644 30449 leader_election.cc:290] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:41.349890 30341 raft_consensus.cc:3060] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:41.363490 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:41.368507 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:41.369508 28884 raft_consensus.cc:2468] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:41.368481 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:41.370512 28701 leader_election.cc:304] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:41.370648 28809 raft_consensus.cc:2468] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:41.372113 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:41.378572 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:41.379129 28813 raft_consensus.cc:2468] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:41.362461 30646 raft_consensus.cc:3055] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:17:41.374269 30661 raft_consensus.cc:493] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:41.374375 30449 raft_consensus.cc:493] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:41.376767 30639 raft_consensus.cc:2804] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:41.392130 28810 raft_consensus.cc:2468] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:41.381165 30646 raft_consensus.cc:740] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:41.371155 30405 raft_consensus.cc:515] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:41.407765 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 66878us
I20260203 09:17:41.389031 30639 raft_consensus.cc:493] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:41.416509 30504 leader_election.cc:290] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:41.420270 30631 leader_election.cc:290] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:41.421028 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:41.421635 28884 raft_consensus.cc:3060] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 4
I20260203 09:17:41.398792 30655 raft_consensus.cc:493] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:41.429165 28884 raft_consensus.cc:2468] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:41.430289 28701 leader_election.cc:304] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:41.409734 30625 raft_consensus.cc:493] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:41.432843 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:41.389170 30661 raft_consensus.cc:515] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:41.416134 30639 raft_consensus.cc:3060] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:41.437152 30282 leader_election.cc:290] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:41.392824 30449 raft_consensus.cc:515] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:41.432670 30504 raft_consensus.cc:2804] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader election won for term 4
W20260203 09:17:41.460150 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 232357us
I20260203 09:17:41.448202 30444 raft_consensus.cc:493] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:41.432372 30655 raft_consensus.cc:515] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:41.450866 30504 raft_consensus.cc:697] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:41.435287 30646 consensus_queue.cc:260] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:41.435746 30625 raft_consensus.cc:515] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:41.473693 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 127571us
I20260203 09:17:41.491416 28700 leader_election.cc:304] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:41.494030 28700 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:41.495538 28700 leader_election.cc:304] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:41.499516 28700 leader_election.cc:304] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:41.500811 28700 leader_election.cc:304] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:41.502058 28700 leader_election.cc:304] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:41.511935 30702 log.cc:927] Time spent T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a: Append to log took a long time: real 0.081s user 0.001s sys 0.000s
I20260203 09:17:41.512785 30449 leader_election.cc:290] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:41.513175 28852 consensus_peers.cc:597] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:41.479358 30444 raft_consensus.cc:515] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:41.513561 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 100614us
I20260203 09:17:41.503698 30583 raft_consensus.cc:2749] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:41.514474 30661 leader_election.cc:290] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:41.503696 30577 raft_consensus.cc:2749] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260203 09:17:41.502743 30646 raft_consensus.cc:3060] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:41.497843 30473 raft_consensus.cc:3060] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:41.515954 30486 raft_consensus.cc:493] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:41.516542 30486 raft_consensus.cc:515] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:41.517925 30706 log.cc:927] Time spent T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.098s user 0.002s sys 0.000s
I20260203 09:17:41.519670 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:41.519912 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:41.520457 28882 raft_consensus.cc:2368] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 3. Current term is 4.
I20260203 09:17:41.520562 28805 raft_consensus.cc:2468] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:41.521674 30504 consensus_queue.cc:237] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:41.502046 30664 raft_consensus.cc:2749] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:41.514796 28631 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56844 (request call id 282) took 2527 ms. Trace:
I20260203 09:17:41.497642 30470 raft_consensus.cc:2749] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:41.526516 28885 raft_consensus.cc:1275] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260203 09:17:41.526713 28851 leader_election.cc:304] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:41.537391 28889 raft_consensus.cc:1240] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 3. Current term is 4. Ops: []
I20260203 09:17:41.528081 28883 raft_consensus.cc:1275] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260203 09:17:41.528312 28882 raft_consensus.cc:1240] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 2. Current term is 3. Ops: []
I20260203 09:17:41.538955 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:41.539354 28887 raft_consensus.cc:1275] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260203 09:17:41.540613 28886 raft_consensus.cc:1240] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 4. Current term is 5. Ops: []
I20260203 09:17:41.541472 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:41.542059 28887 raft_consensus.cc:2468] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 3.
I20260203 09:17:41.513196 30631 raft_consensus.cc:2749] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:41.552780 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:41.541729 30341 raft_consensus.cc:515] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:41.553992 30655 leader_election.cc:290] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:41.525791 30577 raft_consensus.cc:493] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:41.534557 28631 rpcz_store.cc:276] 0203 09:17:38.987712 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:38.987878 (+ 166us) service_pool.cc:225] Handling call
0203 09:17:41.514726 (+2526848us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0203 09:17:39.628079 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0203 09:17:39.635874 (+ 7795us) write_op.cc:432] Acquiring schema lock in shared mode
0203 09:17:39.635936 (+ 62us) write_op.cc:435] Acquired schema lock
0203 09:17:39.635977 (+ 41us) tablet.cc:660] Decoding operations
0203 09:17:39.637688 (+ 1711us) write_op.cc:620] Acquiring the partition lock for write op
0203 09:17:39.637835 (+ 147us) write_op.cc:641] Partition lock acquired for write op
0203 09:17:39.637890 (+ 55us) tablet.cc:683] Acquiring locks for 6 operations
0203 09:17:39.680119 (+ 42229us) tablet.cc:699] Row locks acquired
0203 09:17:39.683799 (+ 3680us) write_op.cc:260] PREPARE: finished
0203 09:17:39.697590 (+ 13791us) write_op.cc:270] Start()
0203 09:17:39.711737 (+ 14147us) write_op.cc:276] Timestamp: P: 1770110259694213 usec, L: 0
0203 09:17:39.716902 (+ 5165us) op_driver.cc:348] REPLICATION: starting
0203 09:17:39.811350 (+ 94448us) log.cc:844] Serialized 2467 byte log entry
0203 09:17:40.343975 (+532625us) op_driver.cc:464] REPLICATION: finished
0203 09:17:40.507549 (+163574us) write_op.cc:301] APPLY: starting
0203 09:17:40.510812 (+ 3263us) tablet.cc:1365] starting BulkCheckPresence
0203 09:17:40.556038 (+ 45226us) tablet.cc:1368] finished BulkCheckPresence
0203 09:17:40.575711 (+ 19673us) tablet.cc:1370] starting ApplyRowOperation cycle
0203 09:17:40.580222 (+ 4511us) tablet.cc:1381] finished ApplyRowOperation cycle
0203 09:17:40.580457 (+ 235us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0203 09:17:40.580509 (+ 52us) write_op.cc:312] APPLY: finished
0203 09:17:40.580799 (+ 290us) log.cc:844] Serialized 53 byte log entry
0203 09:17:40.580953 (+ 154us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:17:40.581060 (+ 107us) write_op.cc:454] Released schema lock
0203 09:17:40.581106 (+ 46us) write_op.cc:341] FINISH: Updating metrics
0203 09:17:40.581475 (+ 369us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:17:40.581502 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":140472,"apply.run_cpu_time_us":2903,"apply.run_wall_time_us":88484,"num_ops":6,"prepare.queue_time_us":213107,"prepare.run_cpu_time_us":14174,"prepare.run_wall_time_us":448389,"raft.queue_time_us":180288,"raft.run_cpu_time_us":25612,"raft.run_wall_time_us":102058,"replication_time_us":616680,"thread_start_us":449939,"threads_started":4,"wal-append.queue_time_us":321526}]]}
I20260203 09:17:41.526927 30486 leader_election.cc:290] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:41.540297 30654 raft_consensus.cc:2804] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:41.570618 28886 raft_consensus.cc:1275] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260203 09:17:41.541309 30405 leader_election.cc:290] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:41.574180 29426 leader_election.cc:304] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:41.577435 28777 leader_election.cc:400] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Vote denied by peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899) with higher term. Message: Invalid argument: T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 3. Current term is 4.
I20260203 09:17:41.577827 28777 leader_election.cc:403] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260203 09:17:41.618007 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 43900.3us
I20260203 09:17:41.568006 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:41.621814 28778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260203 09:17:41.625308 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 46031.9us
I20260203 09:17:41.573346 30654 raft_consensus.cc:493] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260203 09:17:41.645596 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 143603us
I20260203 09:17:41.650020 28700 leader_election.cc:304] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:41.651322 28700 leader_election.cc:304] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:41.650043 28777 leader_election.cc:304] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:41.654306 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:41.653578 28700 leader_election.cc:304] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:17:41.569793 30577 raft_consensus.cc:515] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:41.619583 30392 raft_consensus.cc:3060] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:41.664397 28700 leader_election.cc:304] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:41.666538 28852 leader_election.cc:336] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:41.655984 30631 raft_consensus.cc:3060] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:41.618098 30486 raft_consensus.cc:493] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:41.623195 30471 raft_consensus.cc:2804] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:41.674669 28700 leader_election.cc:304] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:41.676729 28852 leader_election.cc:336] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:41.693277 28852 leader_election.cc:304] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:41.556744 28802 tablet_service.cc:1552] Processing DeleteTablet for tablet 3a09fae92b37497d8efa250f727c0fd9 with delete_type TABLET_DATA_TOMBSTONED (TS be3b58b70fd74625a8ae8dfd7db7f6ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36384
I20260203 09:17:41.627041 30620 raft_consensus.cc:493] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:41.655694 30654 raft_consensus.cc:3060] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:41.662057 30390 raft_consensus.cc:2749] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:41.662045 30583 raft_consensus.cc:3060] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:41.708839 30714 raft_consensus.cc:2749] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:41.623023 30411 consensus_queue.cc:1048] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260203 09:17:41.645277 30542 consensus_queue.cc:1048] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.056s
I20260203 09:17:41.709127 30390 consensus_queue.cc:1048] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:17:41.702152 30486 raft_consensus.cc:515] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:41.711201 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:41.626044 30561 consensus_queue.cc:1059] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
W20260203 09:17:41.711462 28701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:41.712222 30561 raft_consensus.cc:3055] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:17:41.712586 30561 raft_consensus.cc:740] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:41.712692 28799 tablet_service.cc:1552] Processing DeleteTablet for tablet 7e1bac12c6ee43d6901400e02b35d82f with delete_type TABLET_DATA_TOMBSTONED (TS be3b58b70fd74625a8ae8dfd7db7f6ee not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36384
W20260203 09:17:41.713712 30710 log.cc:927] Time spent T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a: Append to log took a long time: real 0.090s user 0.000s sys 0.000s
I20260203 09:17:41.713440 30561 consensus_queue.cc:260] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:41.714566 30711 log.cc:927] Time spent T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.144s user 0.000s sys 0.000s
I20260203 09:17:41.714844 30561 raft_consensus.cc:3060] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
W20260203 09:17:41.715906 30712 log.cc:927] Time spent T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.090s user 0.000s sys 0.000s
I20260203 09:17:41.719790 30714 raft_consensus.cc:2749] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:41.723830 28886 raft_consensus.cc:1275] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260203 09:17:41.726435 30714 consensus_queue.cc:1048] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:17:41.673481 30664 raft_consensus.cc:2804] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Leader election won for term 5
I20260203 09:17:41.731390 28889 raft_consensus.cc:1275] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260203 09:17:41.691627 28881 raft_consensus.cc:2393] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 3: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
W20260203 09:17:41.743407 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 75530.1us
I20260203 09:17:41.697922 30471 raft_consensus.cc:493] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260203 09:17:41.741494 30705 log.cc:927] Time spent T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.058s user 0.001s sys 0.000s
I20260203 09:17:41.729880 30625 leader_election.cc:290] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:41.735194 30620 raft_consensus.cc:515] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:41.758294 30577 leader_election.cc:290] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:41.758911 30620 leader_election.cc:290] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:41.747686 30470 consensus_queue.cc:1048] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260203 09:17:41.766580 28883 raft_consensus.cc:1275] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260203 09:17:41.746407 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:41.748708 30664 raft_consensus.cc:697] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:41.750774 30471 raft_consensus.cc:3060] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:41.782024 28887 raft_consensus.cc:1275] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260203 09:17:41.782994 28885 raft_consensus.cc:1275] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260203 09:17:41.791460 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 132522us
I20260203 09:17:41.775764 30620 raft_consensus.cc:2749] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260203 09:17:41.775861 30444 leader_election.cc:290] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:41.800848 28882 raft_consensus.cc:1240] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 5. Current term is 6. Ops: []
W20260203 09:17:41.803431 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 126750us
W20260203 09:17:41.805310 28852 leader_election.cc:336] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:41.806991 28852 leader_election.cc:304] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:41.815418 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:41.816226 28885 raft_consensus.cc:2468] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 3.
I20260203 09:17:41.823313 29426 leader_election.cc:304] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:41.797240 30341 leader_election.cc:290] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:41.799415 29459 raft_consensus.cc:2468] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:41.825461 30715 raft_consensus.cc:3060] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:41.806501 30690 consensus_queue.cc:1059] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260203 09:17:41.806571 30397 consensus_queue.cc:1048] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260203 09:17:41.831293 30444 raft_consensus.cc:2804] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260203 09:17:41.850092 28852 leader_election.cc:336] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:41.853691 30473 raft_consensus.cc:2749] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:41.852968 30254 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:41.850749 30444 raft_consensus.cc:493] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:41.858053 30444 raft_consensus.cc:3060] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:41.859717 30486 leader_election.cc:290] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:41.857247 30254 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:41.847293 30664 consensus_queue.cc:237] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:41.862310 30254 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:41.865680 30717 log.cc:927] Time spent T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.071s user 0.000s sys 0.001s
I20260203 09:17:41.873900 30625 raft_consensus.cc:493] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:41.874584 30625 raft_consensus.cc:515] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:41.875571 28702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:41.878358 30495 raft_consensus.cc:493] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:41.878973 30495 raft_consensus.cc:515] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:41.880263 30625 leader_election.cc:290] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:41.851027 28852 leader_election.cc:304] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:17:41.891981 28852 leader_election.cc:336] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:41.892489 28852 leader_election.cc:304] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:17:41.915954 28776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 237339us
W20260203 09:17:41.922015 28852 consensus_peers.cc:597] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:41.922967 28852 leader_election.cc:336] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:41.923399 28852 leader_election.cc:304] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:17:41.936302 28852 leader_election.cc:336] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:41.887991 30646 raft_consensus.cc:493] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:41.937455 28852 leader_election.cc:336] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:41.942739 30646 raft_consensus.cc:515] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:41.934593 30449 raft_consensus.cc:493] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:41.944849 30495 leader_election.cc:290] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:41.946334 30728 raft_consensus.cc:493] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:41.946960 30728 raft_consensus.cc:515] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:41.948845 30715 raft_consensus.cc:2749] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:41.950227 30654 raft_consensus.cc:515] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:41.945185 30449 raft_consensus.cc:515] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:41.956039 28703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:41.952632 30444 raft_consensus.cc:515] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:41.968325 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 293717us
I20260203 09:17:41.971815 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:41.981423 28883 raft_consensus.cc:3060] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:41.918888 30486 raft_consensus.cc:2749] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:41.981648 28700 leader_election.cc:304] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:41.990342 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:41.991039 28810 raft_consensus.cc:2468] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:41.991943 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:41.993209 28805 raft_consensus.cc:1275] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260203 09:17:41.939508 30405 raft_consensus.cc:2749] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:41.937815 30724 raft_consensus.cc:2749] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260203 09:17:41.997694 28852 leader_election.cc:336] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:41.952572 30654 leader_election.cc:290] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:41.994103 28810 raft_consensus.cc:1275] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260203 09:17:41.996776 28700 leader_election.cc:304] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:41.983659 30583 raft_consensus.cc:2749] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:42.009761 30728 leader_election.cc:290] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:41.986006 30504 raft_consensus.cc:2749] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:41.994500 30646 leader_election.cc:290] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:42.020678 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:42.021486 28810 raft_consensus.cc:3060] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:42.028975 28851 leader_election.cc:304] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:42.004966 30486 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:42.007411 30282 raft_consensus.cc:3060] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:42.040287 28851 leader_election.cc:304] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:42.034595 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:42.043403 28888 raft_consensus.cc:2468] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:42.044595 28701 leader_election.cc:304] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:41.987969 30470 consensus_queue.cc:1059] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260203 09:17:42.041646 30654 raft_consensus.cc:2804] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:42.046162 30654 raft_consensus.cc:493] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:42.046538 30654 raft_consensus.cc:3060] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:42.047909 30444 leader_election.cc:290] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:42.041958 30715 raft_consensus.cc:493] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:42.049285 30715 raft_consensus.cc:515] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:42.050248 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:42.051040 28880 raft_consensus.cc:2393] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 4: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:42.051265 30715 leader_election.cc:290] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:42.023041 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:42.051988 30639 consensus_meta.cc:287] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent flushing consensus metadata: real 0.610s user 0.007s sys 0.000s
I20260203 09:17:42.052109 28804 raft_consensus.cc:2468] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:42.030802 30725 tablet_replica.cc:333] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:42.075606 30639 raft_consensus.cc:515] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:42.054594 30392 raft_consensus.cc:2749] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899) with higher term. Message: Invalid argument: T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 3. Current term is 4.
I20260203 09:17:42.059891 28883 raft_consensus.cc:2468] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:42.049643 30631 raft_consensus.cc:2749] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:42.063895 30724 raft_consensus.cc:2749] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:42.066478 30723 consensus_queue.cc:1048] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:42.078365 30639 leader_election.cc:290] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:42.067222 30730 raft_consensus.cc:2804] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:42.079761 30730 raft_consensus.cc:493] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:42.081307 28701 leader_election.cc:304] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:42.082701 28883 raft_consensus.cc:1275] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260203 09:17:42.068763 30719 consensus_queue.cc:1048] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260203 09:17:42.069949 28810 raft_consensus.cc:2468] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 4.
I20260203 09:17:42.033085 30646 raft_consensus.cc:493] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:42.037279 30449 leader_election.cc:290] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:42.042343 30486 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:42.085462 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:42.082019 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:42.088773 28882 raft_consensus.cc:2393] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 3: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:42.088840 28777 leader_election.cc:304] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:42.087150 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 254341us
I20260203 09:17:42.091361 28851 leader_election.cc:304] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:42.080024 30471 raft_consensus.cc:515] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:42.080231 30654 raft_consensus.cc:515] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:42.098489 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:42.080191 30730 raft_consensus.cc:3060] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:42.105687 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:42.107024 28883 raft_consensus.cc:2468] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 5.
I20260203 09:17:42.088007 30392 raft_consensus.cc:493] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:42.111797 28882 raft_consensus.cc:2468] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 3.
I20260203 09:17:42.122861 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:42.124382 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:42.125097 29465 raft_consensus.cc:2376] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 5. Re-sending same reply.
I20260203 09:17:42.126926 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:42.099963 30431 raft_consensus.cc:2804] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:42.094630 30729 raft_consensus.cc:3060] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:17:42.095227 30646 raft_consensus.cc:515] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:42.131474 30431 raft_consensus.cc:493] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:42.140067 30431 raft_consensus.cc:3060] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:42.141568 29458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:42.146227 30471 leader_election.cc:290] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:42.149238 30720 raft_consensus.cc:3055] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 LEADER]: Stepping down as leader of term 4
I20260203 09:17:42.149701 30720 raft_consensus.cc:740] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:42.150588 30720 consensus_queue.cc:260] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:42.130672 30392 raft_consensus.cc:515] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:42.151949 30486 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:42.139055 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:42.160723 30664 raft_consensus.cc:3055] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:17:42.161254 30664 raft_consensus.cc:740] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:42.162091 30664 consensus_queue.cc:260] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:42.163552 30282 raft_consensus.cc:2749] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:42.162274 30646 leader_election.cc:290] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:42.164901 30664 raft_consensus.cc:3060] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:42.171088 30729 raft_consensus.cc:2749] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:42.172170 30730 raft_consensus.cc:515] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:42.172938 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:42.173266 30392 leader_election.cc:290] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:42.173626 29459 raft_consensus.cc:2468] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:42.173764 30730 leader_election.cc:290] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:42.167152 30431 raft_consensus.cc:515] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:42.177090 30654 leader_election.cc:290] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:42.176693 30720 raft_consensus.cc:3060] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:42.177892 30431 leader_election.cc:290] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:42.235021 28635 catalog_manager.cc:5654] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 2 to 3, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 3 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:42.239055 28635 catalog_manager.cc:5654] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 1 to 3, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 3 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:17:42.242159 28635 catalog_manager.cc:5654] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:42.244566 28635 catalog_manager.cc:5654] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 1 to 3, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 3 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:17:42.247192 28700 leader_election.cc:304] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:42.247896 28635 catalog_manager.cc:5654] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
W20260203 09:17:42.248975 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 167626us
W20260203 09:17:42.258760 28776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 257357us
I20260203 09:17:42.264009 30449 raft_consensus.cc:493] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:42.264773 30341 raft_consensus.cc:493] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:42.265125 30577 raft_consensus.cc:493] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:42.265460 30449 raft_consensus.cc:515] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:42.265770 30341 raft_consensus.cc:515] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:42.266111 30577 raft_consensus.cc:515] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:42.267203 30473 raft_consensus.cc:493] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:42.268349 30341 leader_election.cc:290] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:42.268558 30577 leader_election.cc:290] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:42.268373 30449 leader_election.cc:290] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:42.269302 30341 raft_consensus.cc:2749] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:42.264024 30282 raft_consensus.cc:2804] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:17:42.269659 30577 consensus_queue.cc:1048] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:17:42.270473 30282 raft_consensus.cc:697] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:42.268061 30473 raft_consensus.cc:515] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:42.285439 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 196532us
I20260203 09:17:42.290539 30397 consensus_queue.cc:1048] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260203 09:17:42.291603 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:42.292927 28880 raft_consensus.cc:3060] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:42.293084 30397 consensus_queue.cc:1048] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260203 09:17:42.295315 30397 consensus_queue.cc:1059] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:17:42.297019 30431 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:42.297246 30473 leader_election.cc:290] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:42.298118 30431 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:42.301225 27553 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260203 09:17:42.306267 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:42.307329 28884 raft_consensus.cc:3060] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:42.309011 30654 raft_consensus.cc:493] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:42.309885 30654 raft_consensus.cc:515] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:42.310871 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:42.311672 28883 raft_consensus.cc:3060] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:42.312476 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:42.293162 30729 consensus_queue.cc:1048] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260203 09:17:42.313436 28889 raft_consensus.cc:2468] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:42.318251 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:42.319357 29459 raft_consensus.cc:2468] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:42.320633 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:42.323421 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:42.324503 29456 raft_consensus.cc:3060] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:42.326841 27553 tablet_replica.cc:333] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:42.329418 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:42.330366 28885 raft_consensus.cc:2468] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:42.342159 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:42.343194 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:42.343376 28811 raft_consensus.cc:3060] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Advancing to term 4
I20260203 09:17:42.346385 29426 leader_election.cc:304] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:42.346728 29457 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:42.344249 29465 raft_consensus.cc:2468] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 4.
I20260203 09:17:42.353013 30392 raft_consensus.cc:3055] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 LEADER]: Stepping down as leader of term 5
I20260203 09:17:42.355403 30392 raft_consensus.cc:740] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:42.348022 30625 raft_consensus.cc:2804] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260203 09:17:42.356065 30625 raft_consensus.cc:493] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:42.356415 30625 raft_consensus.cc:3060] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:42.312376 30654 leader_election.cc:290] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:42.357821 30431 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:42.358932 30392 consensus_queue.cc:260] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:42.360541 30392 raft_consensus.cc:3060] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:42.272424 30282 consensus_queue.cc:237] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:42.347993 29457 raft_consensus.cc:2368] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 3. Current term is 4.
W20260203 09:17:42.364517 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 55926.8us
I20260203 09:17:42.409579 28880 raft_consensus.cc:2468] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 4.
I20260203 09:17:42.410312 30473 raft_consensus.cc:493] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:42.411162 30473 raft_consensus.cc:515] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:42.410367 30577 raft_consensus.cc:493] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:42.433825 30577 raft_consensus.cc:515] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:42.436111 28852 leader_election.cc:336] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:42.441605 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:42.441643 30718 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:42.443775 30718 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:42.416832 30397 raft_consensus.cc:493] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:42.445701 30397 raft_consensus.cc:515] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:42.509182 28811 raft_consensus.cc:2468] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 4.
I20260203 09:17:42.459456 28886 raft_consensus.cc:1275] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260203 09:17:42.457758 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:42.509735 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 262881us
I20260203 09:17:42.513957 28884 raft_consensus.cc:2468] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 4.
I20260203 09:17:42.514303 28883 raft_consensus.cc:2468] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 5.
I20260203 09:17:42.446344 30577 leader_election.cc:290] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:42.507661 30741 raft_consensus.cc:493] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:42.447938 30397 leader_election.cc:290] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:42.449281 30718 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:42.521919 28852 leader_election.cc:336] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:42.518980 30431 raft_consensus.cc:493] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:42.529757 30741 raft_consensus.cc:515] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:42.532160 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:42.538815 29426 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:42.532994 30741 leader_election.cc:290] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:42.541921 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:42.540269 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:42.543557 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:42.543886 28809 raft_consensus.cc:3060] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:42.537137 30577 raft_consensus.cc:493] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:42.538491 30431 raft_consensus.cc:515] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:42.557183 30473 leader_election.cc:290] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:42.556020 30450 raft_consensus.cc:2804] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:42.563594 30450 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:42.564054 30450 raft_consensus.cc:3060] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:42.566663 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:42.563238 28809 raft_consensus.cc:2468] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 4.
I20260203 09:17:42.560330 30431 leader_election.cc:290] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:42.548592 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "021e904a783c4cbc96e5aa625a34a2d8" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:42.570233 28851 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:42.563066 28700 leader_election.cc:304] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:42.553889 29456 raft_consensus.cc:2468] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 4.
W20260203 09:17:42.574889 28852 consensus_peers.cc:597] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:42.577296 29426 leader_election.cc:304] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:42.580101 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:42.581964 28809 raft_consensus.cc:2468] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:42.590147 30725 raft_consensus.cc:2243] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:42.575529 30577 raft_consensus.cc:515] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:42.591655 30725 raft_consensus.cc:2272] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:42.591562 30743 raft_consensus.cc:2804] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:42.595575 30431 raft_consensus.cc:2804] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:42.593190 28701 leader_election.cc:304] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:42.597678 30431 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:42.592756 27553 raft_consensus.cc:2243] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:42.599717 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:42.598835 30431 raft_consensus.cc:3060] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:42.603996 28810 raft_consensus.cc:1275] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260203 09:17:42.605525 30341 raft_consensus.cc:493] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:42.606235 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:42.606997 28810 raft_consensus.cc:1275] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260203 09:17:42.608237 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:42.608855 28806 raft_consensus.cc:3060] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:42.594053 30743 raft_consensus.cc:493] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:42.613197 30743 raft_consensus.cc:3060] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:42.606182 30341 raft_consensus.cc:515] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:42.615445 30341 leader_election.cc:290] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:42.618921 28811 raft_consensus.cc:2468] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:42.628532 30743 raft_consensus.cc:515] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:42.631700 30743 leader_election.cc:290] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:42.631673 30625 raft_consensus.cc:515] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:42.601091 30282 raft_consensus.cc:493] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:42.633666 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:42.592622 30577 leader_election.cc:290] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:42.634505 28885 raft_consensus.cc:2468] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 4.
I20260203 09:17:42.634032 30625 leader_election.cc:290] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:42.640343 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 64048us
W20260203 09:17:42.641415 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 88270.6us
I20260203 09:17:42.644153 27553 raft_consensus.cc:2272] T 1dd859ca9f8b4cda8cca01872e191b47 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:42.646369 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:42.645927 29426 leader_election.cc:304] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:42.649713 28701 leader_election.cc:304] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:42.642686 30718 raft_consensus.cc:2804] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:17:42.651046 28811 raft_consensus.cc:2468] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:42.655200 28806 raft_consensus.cc:2468] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:42.640769 30431 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:42.659394 30577 raft_consensus.cc:2804] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:42.649704 30282 raft_consensus.cc:515] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:42.664269 30577 raft_consensus.cc:493] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:42.675799 28806 raft_consensus.cc:1275] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260203 09:17:42.661239 30625 raft_consensus.cc:2804] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader election won for term 4
W20260203 09:17:42.685060 28777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:42.665071 30718 raft_consensus.cc:697] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:42.682843 28806 pending_rounds.cc:85] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee: Aborting all ops after (but not including) 3
I20260203 09:17:42.688858 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:42.690470 28884 raft_consensus.cc:2468] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 4.
I20260203 09:17:42.693115 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:42.693847 28887 raft_consensus.cc:3060] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:42.699432 28809 raft_consensus.cc:1275] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260203 09:17:42.691452 28806 pending_rounds.cc:107] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260203 09:17:42.701406 28806 raft_consensus.cc:2889] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260203 09:17:42.684105 30473 raft_consensus.cc:2804] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:42.683420 30577 raft_consensus.cc:3060] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:42.704890 30411 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:42.708395 30411 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:42.711903 30411 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:42.705436 28852 leader_election.cc:336] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:42.714017 28852 leader_election.cc:336] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:42.721275 30725 ts_tablet_manager.cc:1916] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:42.721794 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:42.722605 28882 raft_consensus.cc:2393] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 5: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:42.729063 30743 raft_consensus.cc:493] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
W20260203 09:17:42.729746 30749 log.cc:927] Time spent T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f: Append to log took a long time: real 0.052s user 0.000s sys 0.001s
I20260203 09:17:42.720038 28887 raft_consensus.cc:2468] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 6.
I20260203 09:17:42.698774 30625 raft_consensus.cc:697] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:42.704222 30473 raft_consensus.cc:493] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:42.746685 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:42.747498 28809 raft_consensus.cc:2468] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:42.757899 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:42.759059 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:42.756345 28777 leader_election.cc:304] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:42.758517 28813 raft_consensus.cc:2468] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:42.726189 30361 raft_consensus.cc:493] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:42.756171 30473 raft_consensus.cc:3060] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:42.729889 30743 raft_consensus.cc:515] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:42.768919 28701 leader_election.cc:304] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:42.726212 30450 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:42.777846 30590 raft_consensus.cc:493] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:42.778479 30590 raft_consensus.cc:515] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:42.781155 30625 consensus_queue.cc:237] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:42.766629 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
W20260203 09:17:42.810180 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 53360.3us
I20260203 09:17:42.825413 30730 raft_consensus.cc:493] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:42.833537 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:42.833950 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:42.849040 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:42.825655 28851 leader_election.cc:304] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:42.851298 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:42.852042 28883 raft_consensus.cc:2468] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 4.
I20260203 09:17:42.853180 28809 raft_consensus.cc:2410] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc for term 5 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260203 09:17:42.793581 30590 leader_election.cc:290] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:42.826669 30752 log.cc:927] Time spent T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.058s user 0.000s sys 0.000s
I20260203 09:17:42.829150 30431 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:42.833415 29456 raft_consensus.cc:2468] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 4.
I20260203 09:17:42.830549 29458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:42.876741 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:42.876940 30634 raft_consensus.cc:493] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:42.877338 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:42.877645 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:42.900174 28807 raft_consensus.cc:3060] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:42.876405 30495 raft_consensus.cc:2804] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:42.878218 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:42.879320 30655 raft_consensus.cc:2804] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:42.876394 30341 raft_consensus.cc:493] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:42.877405 30714 raft_consensus.cc:2804] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Leader election won for term 5
I20260203 09:17:42.885885 27553 tablet_replica.cc:333] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:42.887405 30450 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:42.890452 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 64895.3us
I20260203 09:17:42.891364 29459 raft_consensus.cc:1240] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 6 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 5. Current term is 6. Ops: []
I20260203 09:17:42.783814 28805 raft_consensus.cc:2955] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:42.901121 28812 raft_consensus.cc:2393] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 4: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:42.915455 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "021e904a783c4cbc96e5aa625a34a2d8" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:43.007550 28852 leader_election.cc:336] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:43.012246 28852 leader_election.cc:336] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:42.974694 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 144126us
I20260203 09:17:42.803812 30718 consensus_queue.cc:237] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:42.851773 30361 raft_consensus.cc:515] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:43.034765 29426 leader_election.cc:336] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:43.011147 30655 raft_consensus.cc:493] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:43.037680 29426 leader_election.cc:304] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:42.901275 30495 raft_consensus.cc:493] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260203 09:17:43.036211 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 189784us
I20260203 09:17:42.856587 30730 raft_consensus.cc:515] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:43.067509 28851 leader_election.cc:304] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:42.904866 29458 raft_consensus.cc:3060] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:42.907177 30577 raft_consensus.cc:515] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:43.080322 29463 raft_consensus.cc:2468] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:42.905514 30282 leader_election.cc:290] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:43.046315 30655 raft_consensus.cc:3060] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:43.084980 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:43.073421 30495 raft_consensus.cc:3060] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:43.033995 30341 raft_consensus.cc:515] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:43.077090 30743 leader_election.cc:290] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:43.027683 30634 raft_consensus.cc:515] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:43.086354 30625 raft_consensus.cc:2749] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 09:17:43.127072 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 59675us
I20260203 09:17:43.127839 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:43.133013 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:43.133204 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 98469.3us
I20260203 09:17:43.140132 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:43.141914 28889 raft_consensus.cc:1240] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 5. Current term is 6. Ops: []
I20260203 09:17:43.102646 30741 raft_consensus.cc:493] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:43.090801 30282 consensus_queue.cc:1048] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260203 09:17:43.158782 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fbefdb5cdae4df9ab3c78a3b6b42ae2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:43.152117 30743 raft_consensus.cc:493] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:43.184544 28852 leader_election.cc:336] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:43.154156 30714 raft_consensus.cc:697] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 5 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:43.161157 30431 raft_consensus.cc:2804] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:17:43.196481 30756 raft_consensus.cc:493] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:43.196935 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:43.203650 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 47133.6us
I20260203 09:17:43.196256 30757 raft_consensus.cc:493] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:43.213222 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:43.216894 29426 leader_election.cc:336] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:43.216686 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:43.197713 30755 log.cc:927] Time spent T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.058s user 0.000s sys 0.000s
I20260203 09:17:43.221555 30756 raft_consensus.cc:515] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:43.222066 30730 leader_election.cc:290] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:43.221643 30714 consensus_queue.cc:237] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:43.223330 30763 log.cc:927] Time spent T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.070s user 0.000s sys 0.000s
I20260203 09:17:43.197747 30766 raft_consensus.cc:493] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:43.186825 30741 raft_consensus.cc:515] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:43.220216 30431 raft_consensus.cc:697] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 4 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:43.242627 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:43.247048 28777 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:43.227437 30392 raft_consensus.cc:493] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:43.210268 30743 raft_consensus.cc:515] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:43.254577 28884 raft_consensus.cc:2468] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:43.254868 30361 leader_election.cc:290] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:43.259239 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:43.239918 30730 raft_consensus.cc:493] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:43.257283 30341 leader_election.cc:290] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:43.275174 28851 leader_election.cc:304] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:43.253008 30577 leader_election.cc:290] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:43.277081 30577 raft_consensus.cc:493] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:43.277635 30577 raft_consensus.cc:515] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:43.281427 28807 raft_consensus.cc:2468] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 5.
I20260203 09:17:43.280474 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:43.285151 28851 leader_election.cc:304] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:43.291328 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:43.294767 27553 raft_consensus.cc:2243] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:43.295545 30743 leader_election.cc:290] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:43.296137 30473 consensus_meta.cc:287] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e: Time spent flushing consensus metadata: real 0.500s user 0.009s sys 0.002s
W20260203 09:17:43.296327 30764 log.cc:927] Time spent T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.079s user 0.000s sys 0.000s
W20260203 09:17:43.296813 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 105890us
I20260203 09:17:43.297294 30431 consensus_queue.cc:237] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:43.298348 30756 leader_election.cc:290] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:43.298121 30473 raft_consensus.cc:515] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:43.237160 30757 raft_consensus.cc:515] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:43.304212 30725 ts_tablet_manager.cc:1929] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260203 09:17:43.279404 30282 raft_consensus.cc:493] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:43.328541 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:43.263377 30766 raft_consensus.cc:515] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:43.330618 30282 raft_consensus.cc:515] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:43.332075 30473 leader_election.cc:290] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:43.332814 30282 leader_election.cc:290] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:43.334301 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b6f1d6e275f4a8ba99a70dbb3ea3235" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:43.335755 27553 raft_consensus.cc:2272] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:43.271433 30392 raft_consensus.cc:515] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:43.336511 28810 raft_consensus.cc:3060] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:43.330513 28883 raft_consensus.cc:2393] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 4: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:43.306708 30774 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:43.328030 30741 leader_election.cc:290] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:43.358757 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:43.356936 30774 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:43.284710 30730 raft_consensus.cc:515] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:43.355417 28777 leader_election.cc:336] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:43.358780 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:43.523952 28701 leader_election.cc:304] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:43.437685 28810 raft_consensus.cc:2468] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 5.
W20260203 09:17:43.424799 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 144659us
I20260203 09:17:43.525501 28883 raft_consensus.cc:3060] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:43.360049 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:43.465873 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b6f1d6e275f4a8ba99a70dbb3ea3235" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:43.513936 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 45053.3us
I20260203 09:17:43.327620 30756 raft_consensus.cc:2749] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:43.531790 28777 leader_election.cc:304] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:43.512245 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 46222.6us
W20260203 09:17:43.428380 30781 log.cc:927] Time spent T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.093s user 0.001s sys 0.000s
I20260203 09:17:43.437105 30725 log.cc:1199] T 3a09fae92b37497d8efa250f727c0fd9 P be3b58b70fd74625a8ae8dfd7db7f6ee: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-1-root/wals/3a09fae92b37497d8efa250f727c0fd9
I20260203 09:17:43.536235 30779 raft_consensus.cc:493] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:43.365077 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:43.542091 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 186729us
I20260203 09:17:43.522861 30486 raft_consensus.cc:2804] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:17:43.356895 30724 raft_consensus.cc:493] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
W20260203 09:17:43.550591 30748 log.cc:927] Time spent T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.094s user 0.000s sys 0.000s
I20260203 09:17:43.548890 28805 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36388 (request call id 1878) took 1016 ms. Trace:
I20260203 09:17:43.551657 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:43.550465 30782 raft_consensus.cc:2804] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:43.568290 30782 raft_consensus.cc:493] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:43.552392 30757 leader_election.cc:290] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:43.553045 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:43.553133 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:43.553797 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:43.554066 30792 raft_consensus.cc:3060] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:43.554308 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b2c469d7255413d9f61a7cbaa4481a7" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:43.557454 30741 raft_consensus.cc:493] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:43.544967 28851 leader_election.cc:304] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:43.524214 30341 consensus_queue.cc:1059] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260203 09:17:43.562327 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:43.564018 30282 raft_consensus.cc:493] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:43.595268 28804 raft_consensus.cc:2393] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 4: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:43.598125 28807 raft_consensus.cc:3060] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:43.564270 30725 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36384 (request call id 823) took 2029 ms. Trace:
I20260203 09:17:43.541965 30654 raft_consensus.cc:493] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:43.609786 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
W20260203 09:17:43.621917 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 76993.4us
I20260203 09:17:43.577747 30782 raft_consensus.cc:3060] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Advancing to term 5
W20260203 09:17:43.629328 28852 leader_election.cc:336] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:43.632848 30780 raft_consensus.cc:493] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:43.633569 30784 raft_consensus.cc:493] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:43.633443 30780 raft_consensus.cc:515] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:43.634143 30784 raft_consensus.cc:515] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:43.635747 30780 leader_election.cc:290] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:43.636409 30784 leader_election.cc:290] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:43.639395 29458 consensus_meta.cc:287] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a: Time spent flushing consensus metadata: real 0.527s user 0.009s sys 0.000s
I20260203 09:17:43.639822 29458 raft_consensus.cc:2468] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 5.
I20260203 09:17:43.595592 30282 raft_consensus.cc:515] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:43.538964 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:43.577138 28810 raft_consensus.cc:2393] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 4: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:43.538628 30450 raft_consensus.cc:493] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:43.576215 30486 raft_consensus.cc:697] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 4 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
W20260203 09:17:43.604835 28776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 52007.8us
W20260203 09:17:43.598922 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 44304.4us
I20260203 09:17:43.640684 28807 raft_consensus.cc:2468] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:43.645128 28851 leader_election.cc:304] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:43.640923 30634 leader_election.cc:290] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:43.610689 30397 raft_consensus.cc:493] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:43.654145 30341 consensus_queue.cc:1059] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
W20260203 09:17:43.656296 28777 leader_election.cc:336] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:43.669963 28777 leader_election.cc:304] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:43.647521 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:43.675420 28884 raft_consensus.cc:2393] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a in current term 4: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:43.566988 28805 rpcz_store.cc:276] 0203 09:17:42.526296 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:42.528807 (+ 2511us) service_pool.cc:225] Handling call
0203 09:17:42.531373 (+ 2566us) raft_consensus.cc:1471] Updating replica for 2 ops
0203 09:17:42.537661 (+ 6288us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:42.537690 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0203 09:17:42.545761 (+ 8071us) log.cc:844] Serialized 590 byte log entry
0203 09:17:42.661187 (+115426us) raft_consensus.cc:1645] Marking committed up to 4
0203 09:17:43.321932 (+660745us) log.cc:844] Serialized 14 byte log entry
0203 09:17:43.541501 (+219569us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:43.541575 (+ 74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0203 09:17:43.541616 (+ 41us) raft_consensus.cc:1685] finished
0203 09:17:43.541636 (+ 20us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:43.541766 (+ 130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6640,"raft.queue_time_us":235398,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":4370,"thread_start_us":328828,"threads_started":2,"wal-append.queue_time_us":182975}
I20260203 09:17:43.686460 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fabfb779b8894cf0b22204fe12768dc3" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:43.564937 30779 raft_consensus.cc:515] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:43.693616 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b2c469d7255413d9f61a7cbaa4481a7" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:43.690708 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 45657.4us
W20260203 09:17:43.662695 28852 consensus_peers.cc:597] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:43.696362 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:43.576467 30724 raft_consensus.cc:515] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:43.618899 30741 raft_consensus.cc:515] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:43.646872 30392 leader_election.cc:290] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:43.646584 30282 leader_election.cc:290] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:43.661216 30577 leader_election.cc:290] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:43.645457 30790 raft_consensus.cc:2749] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260203 09:17:43.700328 28852 leader_election.cc:336] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:43.625823 30654 raft_consensus.cc:515] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:43.642549 30766 leader_election.cc:290] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:43.643388 30730 leader_election.cc:290] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:43.667018 30450 raft_consensus.cc:515] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:43.919458 30801 raft_consensus.cc:493] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:43.786559 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:43.908373 30799 raft_consensus.cc:493] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:43.813977 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:43.946919 28888 raft_consensus.cc:2393] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a in current term 4: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:43.946455 30799 raft_consensus.cc:515] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:43.935864 28887 raft_consensus.cc:2393] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a in current term 4: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:43.921005 28851 leader_election.cc:304] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:17:43.709224 28776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 49154.7us
I20260203 09:17:43.813548 30791 raft_consensus.cc:3060] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:43.608819 30725 rpcz_store.cc:276] 0203 09:17:41.554427 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:41.556421 (+ 1994us) service_pool.cc:225] Handling call
0203 09:17:41.987672 (+431251us) ts_tablet_manager.cc:1151] Deleting tablet 3a09fae92b37497d8efa250f727c0fd9
0203 09:17:42.005009 (+ 17337us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0203 09:17:42.887136 (+882127us) tablet_metadata.cc:641] Metadata flushed
0203 09:17:43.303897 (+416761us) tablet_metadata.cc:641] Metadata flushed
0203 09:17:43.564141 (+260244us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":512272,"tablet-delete.queue_time_us":239956,"thread_start_us":78532,"threads_started":1}
I20260203 09:17:43.949106 30799 leader_election.cc:290] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:43.886296 28883 raft_consensus.cc:2468] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:43.950421 28776 leader_election.cc:400] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Vote denied by peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627) with higher term. Message: Invalid argument: T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 3. Current term is 4.
I20260203 09:17:43.916586 30720 raft_consensus.cc:493] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:43.950881 28776 leader_election.cc:403] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260203 09:17:43.713644 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:43.951603 30411 raft_consensus.cc:2749] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627) with higher term. Message: Invalid argument: T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 3. Current term is 4.
I20260203 09:17:43.870147 30634 raft_consensus.cc:493] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:43.919853 27553 tablet_replica.cc:333] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:43.869753 30361 raft_consensus.cc:493] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:43.759565 30341 raft_consensus.cc:493] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
W20260203 09:17:43.856750 30655 consensus_meta.cc:287] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc: Time spent flushing consensus metadata: real 0.755s user 0.008s sys 0.003s
I20260203 09:17:43.907003 30741 leader_election.cc:290] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:43.953321 30341 raft_consensus.cc:515] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:43.789284 30774 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:43.772061 30486 consensus_queue.cc:237] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:43.954196 30634 raft_consensus.cc:515] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:43.955628 30341 leader_election.cc:290] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:43.945930 30450 leader_election.cc:290] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:43.957527 30361 raft_consensus.cc:515] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:43.952757 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 257379us
W20260203 09:17:43.958987 28852 consensus_peers.cc:597] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:43.815449 30392 raft_consensus.cc:2749] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:43.708703 30784 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:43.960124 30784 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:43.775396 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:43.924975 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 268691us
I20260203 09:17:43.960736 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:43.961421 28888 raft_consensus.cc:2468] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:43.962378 30361 leader_election.cc:290] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:43.956553 28884 raft_consensus.cc:2468] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:43.807531 28889 raft_consensus.cc:1275] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260203 09:17:43.962998 30361 raft_consensus.cc:493] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:43.953367 27553 raft_consensus.cc:2243] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:43.937008 30654 leader_election.cc:290] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:43.979945 28701 leader_election.cc:304] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:43.981705 30341 raft_consensus.cc:2804] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:17:43.982429 30341 raft_consensus.cc:697] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 4 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:43.912145 30724 leader_election.cc:290] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:43.956809 30720 raft_consensus.cc:515] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:43.945487 30801 raft_consensus.cc:515] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:43.989882 30801 leader_election.cc:290] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:43.704262 30397 raft_consensus.cc:515] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:43.991885 30397 leader_election.cc:290] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:43.992861 30777 raft_consensus.cc:493] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:43.993569 30777 raft_consensus.cc:515] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:43.993947 30392 raft_consensus.cc:493] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:43.994479 30392 raft_consensus.cc:515] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:43.994938 30791 raft_consensus.cc:2749] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:43.995234 30411 raft_consensus.cc:493] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:43.995620 30777 leader_election.cc:290] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:43.995820 30411 raft_consensus.cc:515] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:43.953509 30655 raft_consensus.cc:515] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:43.997695 28885 raft_consensus.cc:2393] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 5: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:43.997917 30411 leader_election.cc:290] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:43.998596 30655 leader_election.cc:290] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:43.992942 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:44.000872 30792 raft_consensus.cc:2749] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:44.005376 30784 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:44.005782 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:43.956502 30634 leader_election.cc:290] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:44.010356 28806 raft_consensus.cc:3060] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:44.011214 30779 leader_election.cc:290] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:44.013281 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 92360.7us
I20260203 09:17:44.005429 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:43.951108 30725 tablet_replica.cc:333] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:44.022330 28701 leader_election.cc:304] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:44.029206 30801 raft_consensus.cc:493] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:44.029839 30801 raft_consensus.cc:515] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.031872 30801 leader_election.cc:290] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:44.032320 30392 leader_election.cc:290] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:44.032868 30392 raft_consensus.cc:493] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:44.033320 30392 raft_consensus.cc:515] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.032361 30801 raft_consensus.cc:493] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:44.034416 30801 raft_consensus.cc:515] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:43.986344 30361 raft_consensus.cc:515] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.036423 30361 leader_election.cc:290] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
W20260203 09:17:44.045850 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 268796us
I20260203 09:17:43.950114 28618 catalog_manager.cc:4985] TS be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): tablet 3a09fae92b37497d8efa250f727c0fd9 (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:17:44.054141 30801 leader_election.cc:290] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:44.055510 30766 raft_consensus.cc:493] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:44.056142 30766 raft_consensus.cc:515] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:44.057186 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:44.057355 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 214004us
I20260203 09:17:43.986644 30775 raft_consensus.cc:3055] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 LEADER]: Stepping down as leader of term 5
I20260203 09:17:44.010396 30720 leader_election.cc:290] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:44.057643 27553 pending_rounds.cc:70] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e: Trying to abort 1 pending ops.
I20260203 09:17:44.068080 28851 leader_election.cc:304] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:44.068631 29426 leader_election.cc:304] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:44.071565 27553 pending_rounds.cc:77] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7250371558447943680 op_type: NO_OP noop_request { }
I20260203 09:17:44.072124 27553 raft_consensus.cc:2889] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260203 09:17:44.072213 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:44.072495 27553 raft_consensus.cc:2272] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:44.072834 28889 raft_consensus.cc:2468] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 4.
I20260203 09:17:44.055567 30784 raft_consensus.cc:2804] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:44.073374 30784 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:44.073721 30784 raft_consensus.cc:3060] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:44.073856 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:44.074621 30392 leader_election.cc:290] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:44.074973 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:44.076002 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:44.076259 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:44.077867 28809 raft_consensus.cc:1275] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260203 09:17:44.078516 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:44.078886 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:44.079499 28811 raft_consensus.cc:2468] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 4.
I20260203 09:17:44.080977 28635 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56866 (request call id 291) took 4316 ms. Trace:
I20260203 09:17:44.082217 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:44.084131 30766 leader_election.cc:290] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:44.061028 28631 catalog_manager.cc:5654] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:44.073050 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:44.059890 28701 leader_election.cc:304] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:44.066532 28806 raft_consensus.cc:2468] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 5.
I20260203 09:17:44.027540 30724 raft_consensus.cc:2804] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:17:44.086567 28812 raft_consensus.cc:2468] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
W20260203 09:17:44.067579 28618 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 117621us
I20260203 09:17:44.075563 28889 raft_consensus.cc:2468] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
I20260203 09:17:44.070348 30341 consensus_queue.cc:237] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:44.101035 28851 leader_election.cc:304] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:44.101204 28631 catalog_manager.cc:5654] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 2 to 3, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 3 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:44.102339 28851 leader_election.cc:304] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:44.103212 27553 tablet_replica.cc:333] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:44.102944 28631 catalog_manager.cc:5654] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 1 to 3, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 3 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
W20260203 09:17:44.085556 28852 consensus_peers.cc:597] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:44.059531 30741 raft_consensus.cc:493] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:44.061864 30775 raft_consensus.cc:740] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:44.052414 30782 raft_consensus.cc:515] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.072852 30654 raft_consensus.cc:2804] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:44.104990 30431 raft_consensus.cc:2749] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:44.126940 30784 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:44.127400 30282 raft_consensus.cc:2804] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:44.128087 30282 raft_consensus.cc:493] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260203 09:17:44.128306 30798 log.cc:927] Time spent T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a: Append to log took a long time: real 0.293s user 0.001s sys 0.002s
I20260203 09:17:44.130273 30450 raft_consensus.cc:2804] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 6 FOLLOWER]: Leader election won for term 6
I20260203 09:17:44.130801 30450 raft_consensus.cc:697] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 6 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:44.131729 30450 consensus_queue.cc:237] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.104589 27553 raft_consensus.cc:2243] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:44.132661 30577 raft_consensus.cc:493] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:44.133185 27553 raft_consensus.cc:2272] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:44.109752 28851 leader_election.cc:304] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:44.135352 28851 leader_election.cc:304] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:44.104453 28631 catalog_manager.cc:5654] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 1 to 3, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68). New cstate: current_term: 3 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:44.114852 28777 leader_election.cc:304] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:44.117791 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:44.124907 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 65075.5us
W20260203 09:17:44.137677 28852 consensus_peers.cc:597] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:44.133322 30577 raft_consensus.cc:515] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.141598 30790 raft_consensus.cc:2804] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:44.141844 30720 raft_consensus.cc:493] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:44.121838 30654 raft_consensus.cc:493] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:44.106280 30725 raft_consensus.cc:2243] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:44.109453 30655 consensus_queue.cc:1048] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260203 09:17:44.107172 30724 raft_consensus.cc:697] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 4 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:44.136678 30282 raft_consensus.cc:3060] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:44.145269 28700 leader_election.cc:304] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:44.147601 28631 catalog_manager.cc:5654] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:44.151722 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:44.105914 30783 raft_consensus.cc:493] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:44.115443 30495 consensus_meta.cc:287] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee: Time spent flushing consensus metadata: real 1.004s user 0.007s sys 0.002s
I20260203 09:17:44.153659 28777 leader_election.cc:304] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:44.138424 30431 raft_consensus.cc:2804] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:44.122530 30782 leader_election.cc:290] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 election: Requested vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:44.145207 30718 raft_consensus.cc:493] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:44.104853 30795 raft_consensus.cc:2749] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:44.153195 30790 raft_consensus.cc:493] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:44.161473 30654 raft_consensus.cc:3060] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:44.182873 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:44.190056 28887 raft_consensus.cc:3060] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:44.081346 28635 rpcz_store.cc:276] 0203 09:17:39.764261 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:39.764435 (+ 174us) service_pool.cc:225] Handling call
0203 09:17:40.971106 (+1206671us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b540008d754. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1f0c0 00007f2cd3dbdbba 00007f2cd9b3eeac 00007f2cd9c3910e 00007f2cd81344a4 00007f2cd8134432 00007f2cd8134361 00007f2cd81342dc 00007f2cd8133592 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:41.232283 (+261177us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b5400000e10. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd0b478b1 00007f2cd0cca880 00007f2cd9b33ad6 00007f2cd9c399ce 00007f2cd81344a4 00007f2cd8134432 00007f2cd8134361 00007f2cd81342dc 00007f2cd8133592 00007f2cd20f434c 00007f2cd20f3786
0203 09:17:44.080891 (+2848608us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0203 09:17:42.411178 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0203 09:17:42.411968 (+ 790us) write_op.cc:432] Acquiring schema lock in shared mode
0203 09:17:42.412034 (+ 66us) write_op.cc:435] Acquired schema lock
0203 09:17:42.412072 (+ 38us) tablet.cc:660] Decoding operations
0203 09:17:42.413073 (+ 1001us) write_op.cc:620] Acquiring the partition lock for write op
0203 09:17:42.413209 (+ 136us) write_op.cc:641] Partition lock acquired for write op
0203 09:17:42.413241 (+ 32us) tablet.cc:683] Acquiring locks for 5 operations
0203 09:17:42.414185 (+ 944us) tablet.cc:699] Row locks acquired
0203 09:17:42.414237 (+ 52us) write_op.cc:260] PREPARE: finished
0203 09:17:42.414498 (+ 261us) write_op.cc:270] Start()
0203 09:17:42.414748 (+ 250us) write_op.cc:276] Timestamp: P: 1770110262414404 usec, L: 0
0203 09:17:42.414797 (+ 49us) op_driver.cc:348] REPLICATION: starting
0203 09:17:42.415987 (+ 1190us) log.cc:844] Serialized 2084 byte log entry
0203 09:17:42.547189 (+131202us) spinlock_profiling.cc:243] Waited 93.3 ms on lock 0x7b440002304c. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd0b478b1 00007f2cd0c16005 00007f2cd0c16a22 00007f2cd396057b 00007f2cd395be4f 00007f2cd0ce9f0c 00007f2cd9ad2709 00007f2cd0d0657b 00007f2cd0d0481f 00007f2cd0d06ae2 00007f2cd394e5ab
0203 09:17:43.226240 (+679051us) op_driver.cc:464] REPLICATION: finished
0203 09:17:43.560543 (+334303us) write_op.cc:301] APPLY: starting
0203 09:17:43.562451 (+ 1908us) tablet.cc:1365] starting BulkCheckPresence
0203 09:17:43.562707 (+ 256us) tablet.cc:1368] finished BulkCheckPresence
0203 09:17:43.562750 (+ 43us) tablet.cc:1370] starting ApplyRowOperation cycle
0203 09:17:43.563522 (+ 772us) tablet.cc:1381] finished ApplyRowOperation cycle
0203 09:17:43.563862 (+ 340us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0203 09:17:43.563915 (+ 53us) write_op.cc:312] APPLY: finished
0203 09:17:43.564242 (+ 327us) log.cc:844] Serialized 47 byte log entry
0203 09:17:43.564480 (+ 238us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:17:43.564603 (+ 123us) write_op.cc:454] Released schema lock
0203 09:17:43.569577 (+ 4974us) write_op.cc:341] FINISH: Updating metrics
0203 09:17:43.782360 (+212783us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:17:43.785675 (+ 3315us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":253853,"reported_tablets":17,"spinlock_wait_cycles":570040320,"child_traces":[["op",{"apply.queue_time_us":304752,"apply.run_cpu_time_us":13914,"apply.run_wall_time_us":170233,"num_ops":5,"prepare.queue_time_us":157130,"prepare.run_cpu_time_us":19730,"prepare.run_wall_time_us":235949,"raft.queue_time_us":478108,"raft.run_cpu_time_us":12024,"raft.run_wall_time_us":124693,"replication_time_us":811255,"spinlock_wait_cycles":214624640,"thread_start_us":395427,"threads_started":4,"wal-append.queue_time_us":258384}]]}
I20260203 09:17:44.161114 30714 raft_consensus.cc:493] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:44.182595 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:44.182607 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:44.108212 30741 raft_consensus.cc:515] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.154470 30766 consensus_queue.cc:1048] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260203 09:17:44.150086 30765 consensus_queue.cc:1048] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260203 09:17:44.187440 30431 raft_consensus.cc:493] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:44.178320 30807 raft_consensus.cc:493] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:44.171133 30774 consensus_queue.cc:1048] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260203 09:17:44.196775 28885 raft_consensus.cc:2393] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 4: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:44.188318 28884 raft_consensus.cc:1240] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260203 09:17:44.196523 28882 raft_consensus.cc:1275] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260203 09:17:44.185606 30799 raft_consensus.cc:493] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:44.170991 30720 raft_consensus.cc:515] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:44.189603 30792 raft_consensus.cc:493] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:44.195739 30411 raft_consensus.cc:2804] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:44.191538 30790 raft_consensus.cc:3060] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:44.205559 30766 consensus_queue.cc:1243] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer be3b58b70fd74625a8ae8dfd7db7f6ee log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260203 09:17:44.211952 30431 raft_consensus.cc:3060] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:44.184207 28631 catalog_manager.cc:5654] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:44.113385 30775 consensus_queue.cc:260] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.208616 30779 raft_consensus.cc:493] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:44.235877 30791 raft_consensus.cc:493] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:44.208575 30392 raft_consensus.cc:493] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
W20260203 09:17:44.205859 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 135017us
I20260203 09:17:44.186939 30495 raft_consensus.cc:515] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.214272 30784 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:44.247200 30411 raft_consensus.cc:493] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:44.297330 28887 raft_consensus.cc:2468] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 5.
I20260203 09:17:44.192545 30718 raft_consensus.cc:515] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.299508 28631 catalog_manager.cc:5654] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260203 09:17:44.369140 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 223946us
W20260203 09:17:44.370185 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 135707us
I20260203 09:17:44.250782 30782 raft_consensus.cc:2749] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:44.288067 27553 tablet_replica.cc:333] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:44.256498 30725 raft_consensus.cc:2272] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:44.189756 30783 raft_consensus.cc:515] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:44.377523 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 51753.6us
I20260203 09:17:44.382078 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.382542 30783 leader_election.cc:290] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:44.382920 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.382586 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fabfb779b8894cf0b22204fe12768dc3" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.383466 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.383543 29465 raft_consensus.cc:2468] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:44.287458 30793 raft_consensus.cc:493] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:44.384696 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:44.387722 28813 raft_consensus.cc:2393] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 5: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:44.388198 28887 raft_consensus.cc:3060] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:44.241896 30799 raft_consensus.cc:515] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:44.378777 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 81826.4us
I20260203 09:17:44.386158 28631 catalog_manager.cc:5654] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 3 to 4, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68). New cstate: current_term: 4 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:44.384001 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.389959 29459 raft_consensus.cc:2410] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260203 09:17:44.390501 29457 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.391189 30495 leader_election.cc:290] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 election: Requested vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:44.297174 30392 raft_consensus.cc:515] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.392400 30821 raft_consensus.cc:493] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:44.392993 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.393452 30634 raft_consensus.cc:493] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:44.287325 30805 raft_consensus.cc:2804] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:44.250574 30714 raft_consensus.cc:515] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.437800 28887 raft_consensus.cc:2468] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 5.
I20260203 09:17:44.440351 28701 leader_election.cc:304] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:44.425958 28806 raft_consensus.cc:1275] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260203 09:17:44.369498 30804 raft_consensus.cc:493] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:44.292761 30765 consensus_queue.cc:1059] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.102s
W20260203 09:17:44.424739 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 186587us
I20260203 09:17:44.378039 30411 raft_consensus.cc:3060] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
W20260203 09:17:44.456010 28777 leader_election.cc:336] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:44.464331 30341 raft_consensus.cc:2804] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Leader election won for term 5
I20260203 09:17:44.393900 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b5ccabd714ab40bab140c7a90667ddd6" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.468538 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.250340 30792 raft_consensus.cc:515] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.471838 29461 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.472447 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.474501 30799 leader_election.cc:290] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:44.398212 30793 raft_consensus.cc:515] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:44.438922 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.477039 29458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
W20260203 09:17:44.477705 30814 log.cc:927] Time spent T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.185s user 0.000s sys 0.000s
I20260203 09:17:44.477924 30720 leader_election.cc:290] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:44.479013 30341 raft_consensus.cc:697] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 5 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:44.295611 30724 consensus_queue.cc:237] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:44.440466 30796 log.cc:927] Time spent T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.071s user 0.000s sys 0.000s
I20260203 09:17:44.242254 30807 raft_consensus.cc:515] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.296464 30779 raft_consensus.cc:515] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.520396 30779 leader_election.cc:290] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:44.503361 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.521780 29460 raft_consensus.cc:2393] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 4: Already voted for candidate cf00f643e7da4a98a0a11ea92869c24a in this term.
I20260203 09:17:44.522807 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:44.523406 29460 raft_consensus.cc:3060] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:44.529534 28700 leader_election.cc:304] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:44.530280 28881 raft_consensus.cc:1275] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260203 09:17:44.531051 30718 leader_election.cc:290] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:44.531281 28700 leader_election.cc:304] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:44.531502 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:44.532675 28889 raft_consensus.cc:2468] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 3.
I20260203 09:17:44.532823 30774 consensus_queue.cc:1048] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:44.534121 30774 consensus_queue.cc:1048] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:44.534740 30824 raft_consensus.cc:2749] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260203 09:17:44.535521 30824 raft_consensus.cc:2749] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:44.537366 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a09fae92b37497d8efa250f727c0fd9" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.538081 29456 raft_consensus.cc:2468] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 1.
I20260203 09:17:44.539914 30392 leader_election.cc:290] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:44.542163 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 71302.1us
I20260203 09:17:44.485224 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:44.294945 30791 raft_consensus.cc:515] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:44.477121 30816 log.cc:927] Time spent T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
I20260203 09:17:44.487982 28631 catalog_manager.cc:5654] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 2 to 4, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 4 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:44.511093 28776 leader_election.cc:304] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:44.449942 30805 raft_consensus.cc:493] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:44.425601 30784 consensus_queue.cc:1048] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.061s
I20260203 09:17:44.470144 29465 raft_consensus.cc:2468] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 4.
I20260203 09:17:44.504151 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:44.553701 28887 raft_consensus.cc:2468] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 3.
I20260203 09:17:44.511662 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.496464 30801 raft_consensus.cc:493] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:44.513804 30807 leader_election.cc:290] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:44.514034 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.514530 29461 raft_consensus.cc:2393] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 4: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:44.460152 30821 raft_consensus.cc:515] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:44.468226 30634 raft_consensus.cc:515] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:44.568192 28702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260203 09:17:44.568893 28702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:44.479657 30804 raft_consensus.cc:515] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:44.540153 30792 leader_election.cc:290] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:44.532521 28700 leader_election.cc:304] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:44.513396 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "428e0a1fef8d467da4a30ece11cc6e5c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.575217 30780 raft_consensus.cc:2749] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:44.575634 28700 leader_election.cc:304] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:44.576364 27553 raft_consensus.cc:2243] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:17:44.576867 28700 leader_election.cc:304] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:44.577461 27553 raft_consensus.cc:2272] T 6b71c6a3f2db4b738de03d5e4190cf27 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:44.578838 29457 raft_consensus.cc:2468] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 3.
I20260203 09:17:44.579114 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:44.579588 30821 leader_election.cc:290] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:44.514521 30741 leader_election.cc:290] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:44.500022 29458 raft_consensus.cc:2468] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 3.
I20260203 09:17:44.531834 30577 leader_election.cc:290] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:44.564378 28631 catalog_manager.cc:5654] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:44.552994 30805 raft_consensus.cc:3060] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:44.581142 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:44.580329 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:44.559295 28776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 48397.2us
I20260203 09:17:44.504498 30720 raft_consensus.cc:493] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:44.561986 30341 consensus_queue.cc:237] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.551609 30431 raft_consensus.cc:515] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.620303 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:44.581611 30801 raft_consensus.cc:515] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:44.620820 30804 leader_election.cc:290] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:44.575676 30830 raft_consensus.cc:2749] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:44.650502 28804 raft_consensus.cc:2410] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for term 5 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260203 09:17:44.617221 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:44.591784 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:44.577666 30775 raft_consensus.cc:3060] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:44.619400 30782 raft_consensus.cc:2749] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:44.619261 30774 raft_consensus.cc:2749] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:44.633219 30714 leader_election.cc:290] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:44.653012 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a10f51ea1a844376bb4dce51f655be6b" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:44.623010 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:44.634238 30725 ts_tablet_manager.cc:1916] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260203 09:17:44.616756 28807 raft_consensus.cc:1275] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260203 09:17:44.654737 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:44.655114 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:44.655807 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fd89e8aac3604bd48c5553ce7e5aa905" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:44.612006 30634 leader_election.cc:290] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:44.656399 28810 raft_consensus.cc:2376] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 4. Re-sending same reply.
I20260203 09:17:44.626180 30793 leader_election.cc:290] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:44.657414 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:44.608290 30812 log.cc:927] Time spent T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.223s user 0.000s sys 0.001s
W20260203 09:17:44.624432 28813 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36388 (request call id 1883) took 1838 ms (client timeout 2353 ms). Trace:
W20260203 09:17:44.659024 28813 rpcz_store.cc:269] 0203 09:17:42.786094 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:42.786199 (+ 105us) service_pool.cc:225] Handling call
0203 09:17:44.624185 (+1837986us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54000366d4. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3db8f7a 00007f2cd8d6a647 00007f2cd22fa834 00007f2cd22fa7c2 00007f2cd22fa6f1 00007f2cd22fa66c 00007f2cd22f9922 00007f2cd20f434c 00007f2cd20f3786 00007f2cd20f312f
0203 09:17:44.624344 (+ 159us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3536034688}
I20260203 09:17:44.660188 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
W20260203 09:17:44.605321 28852 consensus_peers.cc:597] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:44.661016 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 512999us
I20260203 09:17:44.575274 30791 leader_election.cc:290] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:44.608045 30282 raft_consensus.cc:515] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.663920 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.653831 30801 leader_election.cc:290] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:44.664136 29457 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.665307 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.649950 30720 raft_consensus.cc:515] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:44.668277 28776 leader_election.cc:304] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:44.581235 28700 leader_election.cc:304] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:44.661166 30790 raft_consensus.cc:515] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.672479 30720 leader_election.cc:290] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:44.658548 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:44.673125 30790 leader_election.cc:290] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:44.673564 28810 raft_consensus.cc:2468] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 4.
W20260203 09:17:44.673615 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 92450.1us
I20260203 09:17:44.674815 28700 leader_election.cc:304] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:44.655726 28807 raft_consensus.cc:2468] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 2.
I20260203 09:17:44.641651 30654 raft_consensus.cc:515] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.610707 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:44.680325 28809 raft_consensus.cc:1275] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260203 09:17:44.649101 27553 tablet_replica.cc:333] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:44.631950 30411 raft_consensus.cc:515] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.682111 27553 raft_consensus.cc:2243] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:44.672909 28808 raft_consensus.cc:2468] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:44.683316 30411 leader_election.cc:290] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Requested vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:44.685997 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:44.686758 29464 raft_consensus.cc:2393] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 4: Already voted for candidate cf00f643e7da4a98a0a11ea92869c24a in this term.
I20260203 09:17:44.686571 29457 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.687563 29457 raft_consensus.cc:2468] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:44.687918 29458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.689270 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9fcb41fb74694d87acc7c8963bdf4bcf" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.686985 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4b4d20256154aa1a7644698755531fd" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.689630 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.690544 29461 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:44.689524 29458 raft_consensus.cc:2393] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 4: Already voted for candidate cf00f643e7da4a98a0a11ea92869c24a in this term.
I20260203 09:17:44.691237 28851 leader_election.cc:304] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:44.691792 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:44.706930 29459 raft_consensus.cc:3060] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Advancing to term 5
I20260203 09:17:44.707019 30724 raft_consensus.cc:2804] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:44.707412 30724 raft_consensus.cc:493] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:44.707994 30724 raft_consensus.cc:3060] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:44.710032 29461 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:44.713037 30836 raft_consensus.cc:493] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:44.713750 30836 raft_consensus.cc:515] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.716176 30836 leader_election.cc:290] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:44.661655 28852 leader_election.cc:336] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:44.716872 28852 leader_election.cc:304] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:17:44.717761 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 56158.1us
W20260203 09:17:44.718431 28852 leader_election.cc:336] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:44.719000 28852 consensus_peers.cc:597] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:44.697430 30282 leader_election.cc:290] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 election: Requested vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:44.651096 30431 leader_election.cc:290] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:44.701864 29426 leader_election.cc:336] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:44.720511 29456 raft_consensus.cc:1240] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 6 LEADER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260203 09:17:44.703354 29460 raft_consensus.cc:2468] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 5.
I20260203 09:17:44.703653 30774 raft_consensus.cc:2749] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:44.704146 30835 raft_consensus.cc:2749] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260203 09:17:44.722596 29426 leader_election.cc:336] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:44.723369 28776 leader_election.cc:304] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:44.726086 30834 raft_consensus.cc:2804] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader election won for term 5
I20260203 09:17:44.726583 30834 raft_consensus.cc:697] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:44.727459 30834 consensus_queue.cc:237] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.705094 28700 leader_election.cc:304] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:17:44.728785 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 246420us
I20260203 09:17:44.729125 30835 raft_consensus.cc:2749] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260203 09:17:44.706336 27553 raft_consensus.cc:2272] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:44.692446 30411 raft_consensus.cc:2804] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:44.692505 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:44.735632 28812 raft_consensus.cc:2393] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 4: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:44.693897 30654 leader_election.cc:290] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:44.720023 30791 raft_consensus.cc:2749] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260203 09:17:44.737011 30411 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:44.737509 30411 raft_consensus.cc:3060] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Advancing to term 5
W20260203 09:17:44.737969 29426 leader_election.cc:336] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:44.739631 29426 leader_election.cc:336] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:44.738068 30836 consensus_queue.cc:1048] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260203 09:17:44.743418 29426 leader_election.cc:336] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:44.744318 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:44.665488 28806 raft_consensus.cc:2376] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 5. Re-sending same reply.
I20260203 09:17:44.750833 30720 raft_consensus.cc:493] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:44.731837 28700 leader_election.cc:304] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:44.750401 30822 raft_consensus.cc:493] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:44.751343 30720 raft_consensus.cc:515] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:44.751832 30822 raft_consensus.cc:515] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.753348 30720 leader_election.cc:290] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:44.754042 30822 leader_election.cc:290] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:44.754665 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:44.755798 27553 tablet_replica.cc:333] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:44.757063 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:44.759044 30822 raft_consensus.cc:2749] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:44.759938 28700 leader_election.cc:304] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:44.760478 30654 consensus_queue.cc:1048] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:44.761428 28880 raft_consensus.cc:1240] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Rejecting Update request from peer cf00f643e7da4a98a0a11ea92869c24a for earlier term 3. Current term is 4. Ops: []
I20260203 09:17:44.763394 28885 raft_consensus.cc:1275] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260203 09:17:44.763968 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:44.782827 30822 raft_consensus.cc:2804] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Leader election won for term 5
I20260203 09:17:44.783481 30822 raft_consensus.cc:697] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:44.784473 30822 consensus_queue.cc:237] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.786823 30805 raft_consensus.cc:515] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:44.788187 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 68689.4us
I20260203 09:17:44.789419 28700 leader_election.cc:304] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:44.790272 30341 raft_consensus.cc:2749] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:44.791751 27553 raft_consensus.cc:2243] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:44.792753 27553 raft_consensus.cc:2272] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:44.795872 27553 tablet_replica.cc:333] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:44.769567 28889 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:44.823020 28889 raft_consensus.cc:3060] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 5
I20260203 09:17:44.770740 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "797be23efb5c447da7f2d0ba9af2e84d" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:44.720052 29459 raft_consensus.cc:2468] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 5.
I20260203 09:17:44.774288 28884 raft_consensus.cc:1275] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260203 09:17:44.827191 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:44.827595 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:44.792789 30654 raft_consensus.cc:493] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:44.796159 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:44.798409 28811 raft_consensus.cc:2368] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a for earlier term 4. Current term is 5.
I20260203 09:17:44.798553 28851 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:44.800321 29457 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:44.808902 30805 leader_election.cc:290] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 election: Requested vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:44.837476 28852 consensus_peers.cc:597] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:44.811149 30411 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.838425 30790 raft_consensus.cc:2749] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260203 09:17:44.841848 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:44.837442 30654 raft_consensus.cc:515] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.844527 30654 leader_election.cc:290] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:44.845151 28882 raft_consensus.cc:2393] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 4: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:44.844554 30725 ts_tablet_manager.cc:1929] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20260203 09:17:44.847189 30725 log.cc:1199] T 7e1bac12c6ee43d6901400e02b35d82f P be3b58b70fd74625a8ae8dfd7db7f6ee: Deleting WAL directory at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0/minicluster-data/ts-1-root/wals/7e1bac12c6ee43d6901400e02b35d82f
I20260203 09:17:44.848268 30725 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36384 (request call id 824) took 3293 ms. Trace:
I20260203 09:17:44.813707 30756 raft_consensus.cc:493] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:44.848604 30725 rpcz_store.cc:276] 0203 09:17:41.555067 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:41.572333 (+ 17266us) service_pool.cc:225] Handling call
0203 09:17:43.950685 (+2378352us) ts_tablet_manager.cc:1151] Deleting tablet 7e1bac12c6ee43d6901400e02b35d82f
0203 09:17:43.950779 (+ 94us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0203 09:17:44.730154 (+779375us) tablet_metadata.cc:641] Metadata flushed
0203 09:17:44.844239 (+114085us) tablet_metadata.cc:641] Metadata flushed
0203 09:17:44.848182 (+ 3943us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":91422,"tablet-delete.queue_time_us":2237408}
I20260203 09:17:44.849448 30756 raft_consensus.cc:515] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.814049 28700 leader_election.cc:304] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:44.816217 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:44.815564 28777 leader_election.cc:304] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:44.816704 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:44.817225 29426 leader_election.cc:304] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:44.852027 29426 leader_election.cc:304] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:44.817122 30450 consensus_queue.cc:1048] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260203 09:17:44.859225 30832 consensus_queue.cc:1059] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260203 09:17:44.859395 30450 consensus_queue.cc:1048] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260203 09:17:44.860322 30832 raft_consensus.cc:3055] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:17:44.861254 30832 raft_consensus.cc:740] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
W20260203 09:17:44.861747 28700 raft_consensus.cc:2686] T fd89e8aac3604bd48c5553ce7e5aa905 P 847a7af9f0e2497cbb9025cc2c62557e: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260203 09:17:44.862524 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 48566.1us
I20260203 09:17:44.863301 28700 leader_election.cc:304] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:44.864050 28777 leader_election.cc:304] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:44.864943 28700 leader_election.cc:304] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:44.767124 29425 leader_election.cc:304] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:44.830900 28889 raft_consensus.cc:2468] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 5.
I20260203 09:17:44.834261 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:44.828341 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6645a0476f6e40bda131d06fa0f15f7b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:44.834566 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47301e2bbfc94767a9905b0e12141d6d" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:44.868023 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:44.869288 28886 raft_consensus.cc:1275] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260203 09:17:44.867600 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:44.840718 29457 raft_consensus.cc:2393] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 5: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
W20260203 09:17:44.838177 28852 consensus_peers.cc:597] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:44.853132 28618 catalog_manager.cc:4985] TS be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): tablet 7e1bac12c6ee43d6901400e02b35d82f (table test-workload [id=bf904e980c40401592cd3f9df9c34549]) successfully deleted
I20260203 09:17:44.854513 30756 leader_election.cc:290] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:44.855196 30634 raft_consensus.cc:2804] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:44.855285 30836 raft_consensus.cc:2804] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:44.874142 30634 raft_consensus.cc:493] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting leader election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:44.856027 28880 raft_consensus.cc:2393] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 5: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:44.856423 30805 raft_consensus.cc:2749] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:44.875402 29456 raft_consensus.cc:2393] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 5: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:44.818547 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:44.876511 28887 raft_consensus.cc:2468] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 4.
I20260203 09:17:44.875356 30634 raft_consensus.cc:3060] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Advancing to term 4
W20260203 09:17:44.879144 28852 consensus_peers.cc:597] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:44.819708 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:44.866204 28700 leader_election.cc:304] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:44.867712 28884 raft_consensus.cc:2393] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 5: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:44.866349 30720 raft_consensus.cc:3060] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
W20260203 09:17:44.869802 29426 leader_election.cc:336] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:44.839031 28851 leader_election.cc:304] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:44.871093 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 130832us
I20260203 09:17:44.871553 30341 raft_consensus.cc:2749] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:44.821798 30724 raft_consensus.cc:515] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:44.869433 30832 consensus_queue.cc:260] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.881196 29426 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:44.892787 29426 leader_election.cc:336] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:44.893725 29426 leader_election.cc:336] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:44.894155 29426 leader_election.cc:304] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:44.885334 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 46384.8us
I20260203 09:17:44.886457 28777 leader_election.cc:304] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:44.886838 28700 leader_election.cc:304] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:17:44.889609 30654 raft_consensus.cc:2749] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:44.881983 30836 raft_consensus.cc:493] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:44.895532 30341 raft_consensus.cc:2804] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Leader election won for term 5
I20260203 09:17:44.896835 30341 raft_consensus.cc:697] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 5 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:44.895689 28851 leader_election.cc:304] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:44.897933 28777 leader_election.cc:304] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:44.898743 28700 leader_election.cc:304] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:44.899181 28777 leader_election.cc:304] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:44.901242 29426 consensus_peers.cc:597] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:44.901968 29426 leader_election.cc:336] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:44.902251 29426 leader_election.cc:304] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:17:44.903049 29426 leader_election.cc:336] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:44.903487 29426 leader_election.cc:336] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:44.903829 29426 leader_election.cc:304] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:44.872584 30822 raft_consensus.cc:3060] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:44.873323 30450 raft_consensus.cc:2749] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:44.905738 28851 leader_election.cc:304] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:44.907614 30341 consensus_queue.cc:237] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:44.915850 30654 raft_consensus.cc:2804] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election won for term 5
I20260203 09:17:44.916368 30654 raft_consensus.cc:697] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 5 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:44.908797 30718 raft_consensus.cc:2749] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:44.917332 30654 consensus_queue.cc:237] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.909149 30810 raft_consensus.cc:2749] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260203 09:17:44.910125 30820 raft_consensus.cc:3060] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:44.919183 28701 leader_election.cc:304] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:44.910465 30756 raft_consensus.cc:2749] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:44.889756 30835 raft_consensus.cc:3060] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:44.910765 30361 consensus_queue.cc:1048] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:44.911089 30775 raft_consensus.cc:2749] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260203 09:17:44.911717 29426 leader_election.cc:336] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:44.904901 30836 raft_consensus.cc:3060] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:44.904685 30805 raft_consensus.cc:2749] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260203 09:17:44.912731 30834 raft_consensus.cc:2804] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:44.938098 30834 raft_consensus.cc:493] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:44.938508 30834 raft_consensus.cc:3060] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:44.922569 30282 raft_consensus.cc:2804] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Leader election won for term 5
I20260203 09:17:44.942519 30282 raft_consensus.cc:697] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:44.943502 30282 consensus_queue.cc:237] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:44.914217 28700 leader_election.cc:304] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:44.913153 30813 raft_consensus.cc:2749] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:44.915215 30830 raft_consensus.cc:2749] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260203 09:17:44.920737 28883 raft_consensus.cc:1240] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260203 09:17:44.946545 30724 leader_election.cc:290] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
W20260203 09:17:44.906945 28852 consensus_peers.cc:597] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:44.913098 30634 raft_consensus.cc:515] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:44.928369 29426 leader_election.cc:304] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:44.935122 30832 raft_consensus.cc:3060] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:44.952288 30813 raft_consensus.cc:2749] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260203 09:17:44.948212 28852 leader_election.cc:336] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:44.914999 30774 consensus_queue.cc:1048] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260203 09:17:44.953625 28852 leader_election.cc:336] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:44.954028 28852 leader_election.cc:304] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:44.950697 30775 raft_consensus.cc:2804] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:17:44.954802 30775 raft_consensus.cc:493] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting leader election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:44.955211 30775 raft_consensus.cc:3060] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:17:44.960919 28702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260203 09:17:44.934235 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 44887.4us
I20260203 09:17:44.966439 30724 raft_consensus.cc:2749] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:44.967852 30720 raft_consensus.cc:2749] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:44.971024 28701 leader_election.cc:304] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:44.983553 27553 raft_consensus.cc:2243] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:44.949239 28700 leader_election.cc:304] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
W20260203 09:17:45.019032 28777 leader_election.cc:336] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:45.019620 28777 leader_election.cc:304] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:45.021051 28777 leader_election.cc:336] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:45.021490 28777 leader_election.cc:304] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:45.026396 30341 raft_consensus.cc:2804] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Leader election won for term 5
I20260203 09:17:45.026459 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:45.027135 30341 raft_consensus.cc:697] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
W20260203 09:17:45.035161 28777 leader_election.cc:336] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:45.037184 28777 leader_election.cc:304] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:45.038125 27553 raft_consensus.cc:2272] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:45.029633 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 80443.2us
W20260203 09:17:45.038734 28852 leader_election.cc:336] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:45.039495 30805 raft_consensus.cc:2749] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:45.040374 30634 leader_election.cc:290] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:45.038456 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 73147.4us
I20260203 09:17:45.049510 29425 leader_election.cc:304] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:45.043860 27553 tablet_replica.cc:333] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:45.037355 30730 raft_consensus.cc:2804] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:45.028421 30799 raft_consensus.cc:2749] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:45.045517 28852 leader_election.cc:304] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:45.060477 28777 leader_election.cc:336] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:45.060967 28777 leader_election.cc:304] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:45.061079 28852 leader_election.cc:336] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:45.061568 28852 leader_election.cc:304] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:45.061772 30801 raft_consensus.cc:2749] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260203 09:17:45.062613 30756 raft_consensus.cc:2749] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260203 09:17:45.063134 28777 leader_election.cc:336] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:45.063531 28777 leader_election.cc:304] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:45.064203 30801 raft_consensus.cc:2749] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:45.055691 30341 consensus_queue.cc:237] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:45.066668 28852 consensus_peers.cc:597] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:45.066812 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:45.051374 29425 leader_election.cc:400] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Vote denied by peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611) with higher term. Message: Invalid argument: T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a for earlier term 4. Current term is 5.
I20260203 09:17:45.051877 29457 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:45.052832 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:45.053313 30813 raft_consensus.cc:2749] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:45.077569 30834 raft_consensus.cc:515] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:45.026175 30720 raft_consensus.cc:2749] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:45.059504 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba8b1b8685b431e8328cdb7df4ad1d0" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:45.067920 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:45.068811 29425 leader_election.cc:403] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260203 09:17:45.038116 28851 leader_election.cc:304] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:45.075544 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:45.081094 28810 raft_consensus.cc:1275] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260203 09:17:45.053874 29460 raft_consensus.cc:2468] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 4.
I20260203 09:17:45.082201 29461 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:45.016185 30765 consensus_queue.cc:1048] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260203 09:17:45.107210 28807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:45.091763 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:45.096365 28806 raft_consensus.cc:2376] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4. Re-sending same reply.
I20260203 09:17:45.096529 28812 raft_consensus.cc:2393] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 5: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
W20260203 09:17:45.097334 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 46136.6us
I20260203 09:17:45.096148 28808 raft_consensus.cc:2410] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260203 09:17:45.098241 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 60212.8us
W20260203 09:17:45.093184 28777 leader_election.cc:336] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:45.102396 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:45.059324 30730 raft_consensus.cc:493] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting leader election (detected failure of leader cf00f643e7da4a98a0a11ea92869c24a)
I20260203 09:17:45.031805 30714 consensus_queue.cc:1059] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260203 09:17:45.072713 30756 raft_consensus.cc:2749] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:45.115799 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:45.113039 28777 leader_election.cc:304] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:45.102727 28852 leader_election.cc:336] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:45.104697 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eac7b86aa8d340e3a4d61a5c982b1f2e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:45.121109 28812 raft_consensus.cc:2468] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 4.
I20260203 09:17:45.092657 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:45.153514 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:45.153827 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "574d0205e57547c6938037563109a6d2" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:45.153203 29425 leader_election.cc:304] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:17:45.150817 28807 pending_rounds.cc:85] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee: Aborting all ops after (but not including) 1
I20260203 09:17:45.155061 28807 pending_rounds.cc:107] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee: Aborting uncommitted NO_OP operation due to leader change: 4.2
W20260203 09:17:45.124394 28852 leader_election.cc:336] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:45.104911 30790 raft_consensus.cc:2749] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260203 09:17:45.155529 28702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:45.161899 28812 raft_consensus.cc:1275] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260203 09:17:45.155344 28807 raft_consensus.cc:2889] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260203 09:17:45.120325 30730 raft_consensus.cc:3060] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:45.119946 30813 raft_consensus.cc:2749] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611) with higher term. Message: Invalid argument: T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a for earlier term 4. Current term is 5.
I20260203 09:17:45.167410 29425 leader_election.cc:304] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:45.173429 28851 leader_election.cc:304] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:45.178351 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 85192.2us
W20260203 09:17:45.183210 28777 leader_election.cc:336] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:45.184144 28777 leader_election.cc:336] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:45.184551 28777 leader_election.cc:304] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:45.165709 30718 raft_consensus.cc:2804] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:45.165843 29458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
W20260203 09:17:45.198063 28777 leader_election.cc:336] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:45.419399 28777 leader_election.cc:304] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:45.416714 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 216296us
I20260203 09:17:45.416548 27553 raft_consensus.cc:2243] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 LEADER]: Raft consensus shutting down.
I20260203 09:17:45.264961 30801 raft_consensus.cc:2749] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:45.655622 30730 raft_consensus.cc:515] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:45.658345 30730 leader_election.cc:290] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:45.179420 29457 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:45.625838 30804 raft_consensus.cc:493] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:45.199694 30718 raft_consensus.cc:493] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:45.660398 30718 raft_consensus.cc:3060] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:45.660351 30804 raft_consensus.cc:515] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:45.179948 30832 raft_consensus.cc:2749] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260203 09:17:45.265906 30411 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:45.425211 28700 leader_election.cc:304] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:45.345069 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 183987us
I20260203 09:17:45.193799 30765 raft_consensus.cc:493] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:45.446164 29458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d2d0debbeba46b086bb9d7344d2181b" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
W20260203 09:17:45.425994 30820 consensus_meta.cc:287] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a: Time spent flushing consensus metadata: real 0.507s user 0.005s sys 0.011s
I20260203 09:17:45.674212 30820 raft_consensus.cc:2749] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:45.675169 29461 raft_consensus.cc:3060] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Advancing to term 5
W20260203 09:17:45.425403 30835 consensus_meta.cc:287] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e: Time spent flushing consensus metadata: real 0.501s user 0.008s sys 0.008s
I20260203 09:17:45.676138 30835 raft_consensus.cc:2749] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:45.440384 30724 raft_consensus.cc:2749] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260203 09:17:45.446226 30834 leader_election.cc:290] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:45.677433 30834 raft_consensus.cc:493] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:45.677915 30834 raft_consensus.cc:515] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:45.679919 30834 leader_election.cc:290] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:45.681422 30804 leader_election.cc:290] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:45.482499 28851 leader_election.cc:304] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:45.685269 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 202855us
I20260203 09:17:45.686193 27553 pending_rounds.cc:70] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e: Trying to abort 1 pending ops.
I20260203 09:17:45.686511 27553 pending_rounds.cc:77] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e: Aborting op as it isn't in flight: id { term: 5 index: 7 } timestamp: 7250371645842231296 op_type: NO_OP noop_request { }
I20260203 09:17:45.686854 27553 raft_consensus.cc:2889] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260203 09:17:45.687198 27553 raft_consensus.cc:2272] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:45.489357 28702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260203 09:17:45.689031 28702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260203 09:17:45.692902 28700 raft_consensus.cc:2686] T 9fcb41fb74694d87acc7c8963bdf4bcf P 847a7af9f0e2497cbb9025cc2c62557e: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260203 09:17:45.693549 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 268479us
I20260203 09:17:45.694238 28700 leader_election.cc:304] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:45.697482 30878 raft_consensus.cc:2749] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:45.700196 30864 raft_consensus.cc:493] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:45.435999 30775 raft_consensus.cc:515] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:45.700943 30654 raft_consensus.cc:2749] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:45.700721 30864 raft_consensus.cc:515] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:45.702775 30864 leader_election.cc:290] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:45.703313 30795 raft_consensus.cc:493] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:45.703872 30795 raft_consensus.cc:515] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:45.501722 30793 raft_consensus.cc:2749] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260203 09:17:45.629822 30836 consensus_meta.cc:287] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a: Time spent flushing consensus metadata: real 0.689s user 0.008s sys 0.009s
I20260203 09:17:45.705008 30836 raft_consensus.cc:515] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:45.631108 30856 log.cc:927] Time spent T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.157s user 0.000s sys 0.001s
I20260203 09:17:45.706146 29457 raft_consensus.cc:2393] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 5: Already voted for candidate cf00f643e7da4a98a0a11ea92869c24a in this term.
I20260203 09:17:45.640763 30766 raft_consensus.cc:3055] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 LEADER]: Stepping down as leader of term 4
I20260203 09:17:45.706681 30766 raft_consensus.cc:740] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:45.707042 30836 leader_election.cc:290] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:45.638419 30869 log.cc:927] Time spent T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.104s user 0.000s sys 0.000s
I20260203 09:17:45.707531 30766 consensus_queue.cc:260] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:45.708565 30766 raft_consensus.cc:3060] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:45.723742 28885 raft_consensus.cc:1275] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260203 09:17:45.625382 30822 consensus_meta.cc:287] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e: Time spent flushing consensus metadata: real 0.702s user 0.014s sys 0.003s
I20260203 09:17:45.724933 30822 raft_consensus.cc:2749] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:45.726125 28885 raft_consensus.cc:1240] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260203 09:17:45.652722 30859 log.cc:927] Time spent T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.175s user 0.000s sys 0.001s
I20260203 09:17:45.672557 30765 raft_consensus.cc:515] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:45.728049 28885 raft_consensus.cc:1275] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260203 09:17:45.728893 30765 leader_election.cc:290] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:45.641937 30855 log.cc:927] Time spent T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.163s user 0.000s sys 0.001s
W20260203 09:17:45.643540 30854 log.cc:927] Time spent T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.529s user 0.001s sys 0.000s
I20260203 09:17:45.712101 30775 leader_election.cc:290] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:45.716867 28852 leader_election.cc:336] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:45.718470 30870 raft_consensus.cc:493] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:45.740181 28888 raft_consensus.cc:1275] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260203 09:17:45.695843 28700 leader_election.cc:304] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:45.741075 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:45.742991 30870 raft_consensus.cc:515] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:45.744266 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:45.745908 30875 consensus_queue.cc:1048] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:17:45.748401 28808 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
W20260203 09:17:45.757267 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 61485.4us
I20260203 09:17:45.757550 30718 raft_consensus.cc:515] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:45.758859 30341 raft_consensus.cc:2749] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:45.759661 30718 leader_election.cc:290] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:45.758996 28700 leader_election.cc:304] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:45.766036 28700 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:45.766914 30341 raft_consensus.cc:3060] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:45.773579 28700 leader_election.cc:304] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:17:45.742408 29461 raft_consensus.cc:2468] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 5.
I20260203 09:17:45.774355 30795 leader_election.cc:290] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:45.780378 29425 leader_election.cc:304] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:17:45.782986 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 191601us
W20260203 09:17:45.788475 28700 raft_consensus.cc:2686] T 3a09fae92b37497d8efa250f727c0fd9 P 847a7af9f0e2497cbb9025cc2c62557e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260203 09:17:45.790684 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:45.791482 28885 raft_consensus.cc:2393] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a in current term 5: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:45.791913 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:45.789574 28700 leader_election.cc:304] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc
I20260203 09:17:45.801337 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "438ed0267e3148da951c6dc25761c745" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:45.802109 28805 raft_consensus.cc:3060] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Advancing to term 5
W20260203 09:17:45.807794 28700 raft_consensus.cc:2686] T 797be23efb5c447da7f2d0ba9af2e84d P 847a7af9f0e2497cbb9025cc2c62557e: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260203 09:17:45.825464 28852 leader_election.cc:336] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:45.829778 28700 leader_election.cc:304] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:45.788618 30826 raft_consensus.cc:2749] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:45.835145 28700 leader_election.cc:304] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:45.794106 30836 raft_consensus.cc:2749] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260203 09:17:45.806203 30799 raft_consensus.cc:493] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:45.781859 30782 consensus_queue.cc:1048] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.050s
I20260203 09:17:45.839046 28700 leader_election.cc:304] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:45.799686 30765 consensus_queue.cc:1048] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260203 09:17:45.839073 30577 raft_consensus.cc:2749] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:45.866736 30341 raft_consensus.cc:2749] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:45.843017 30766 raft_consensus.cc:2749] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:45.848846 30799 raft_consensus.cc:515] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:45.870817 28852 leader_election.cc:336] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:45.873452 28804 raft_consensus.cc:1275] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260203 09:17:45.874718 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:45.876111 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:45.877475 28700 leader_election.cc:304] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:45.878823 30775 raft_consensus.cc:2749] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:45.880328 28812 raft_consensus.cc:1275] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260203 09:17:45.880932 28812 pending_rounds.cc:85] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee: Aborting all ops after (but not including) 3
I20260203 09:17:45.881227 28812 pending_rounds.cc:107] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260203 09:17:45.881067 28700 leader_election.cc:304] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:45.881752 28812 raft_consensus.cc:2917] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260203 09:17:45.886336 28700 leader_election.cc:304] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:45.851150 30826 raft_consensus.cc:2749] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260203 09:17:45.892906 28812 raft_consensus.cc:2889] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260203 09:17:45.895051 28805 raft_consensus.cc:2468] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 5.
W20260203 09:17:45.901190 30860 log.cc:927] Time spent T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.409s user 0.000s sys 0.004s
W20260203 09:17:45.901997 30860 consensus_queue.cc:1175] T 09f2301096ce4f4689e1e7f24f013e52 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "847a7af9f0e2497cbb9025cc2c62557e" status { last_received { term: 5 index: 7 } last_committed_idx: 6 last_received_current_leader { term: 5 index: 7 } }
I20260203 09:17:45.902645 30799 leader_election.cc:290] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:45.898741 28700 raft_consensus.cc:2686] T fba8b1b8685b431e8328cdb7df4ad1d0 P 847a7af9f0e2497cbb9025cc2c62557e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260203 09:17:45.909256 28804 raft_consensus.cc:1275] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260203 09:17:45.913538 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 715473us
I20260203 09:17:45.914397 29425 leader_election.cc:304] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:45.889933 30775 raft_consensus.cc:2749] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260203 09:17:45.914376 28777 leader_election.cc:336] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:45.916716 28777 leader_election.cc:304] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:45.918082 28777 leader_election.cc:336] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:45.918516 28777 leader_election.cc:304] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:45.881708 30822 consensus_queue.cc:1048] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
W20260203 09:17:45.926453 28777 leader_election.cc:336] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:45.926999 28777 leader_election.cc:304] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:45.930862 28777 leader_election.cc:336] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:45.931437 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 139232us
I20260203 09:17:45.932204 28777 leader_election.cc:304] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:45.933497 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 245415us
W20260203 09:17:45.937868 28777 leader_election.cc:336] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:45.938328 28777 leader_election.cc:304] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:45.939237 30341 consensus_queue.cc:1048] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260203 09:17:45.922560 30818 raft_consensus.cc:2804] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader election won for term 5
I20260203 09:17:45.939447 28851 leader_election.cc:304] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:45.930820 30411 raft_consensus.cc:2749] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260203 09:17:45.923681 30799 raft_consensus.cc:2749] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:45.948215 30341 consensus_queue.cc:1048] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260203 09:17:45.948846 28777 leader_election.cc:336] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:45.949222 28777 leader_election.cc:304] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:45.923347 30782 consensus_queue.cc:1048] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260203 09:17:45.922221 30874 raft_consensus.cc:2749] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:45.958801 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:45.959686 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd859ca9f8b4cda8cca01872e191b47" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:45.960259 28883 raft_consensus.cc:3060] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:45.961607 28886 raft_consensus.cc:1275] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260203 09:17:45.941630 30870 leader_election.cc:290] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:45.944308 30801 raft_consensus.cc:2749] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:45.960183 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:45.952775 30795 raft_consensus.cc:2804] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:17:45.962615 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:45.965401 30799 raft_consensus.cc:2749] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:45.954578 30720 raft_consensus.cc:2749] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:45.979472 29461 raft_consensus.cc:1275] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260203 09:17:45.979943 30795 raft_consensus.cc:697] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 4 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:45.956580 30818 raft_consensus.cc:697] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 5 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
W20260203 09:17:45.974742 30865 log.cc:927] Time spent T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.334s user 0.002s sys 0.000s
I20260203 09:17:45.974773 27553 tablet_replica.cc:333] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:45.983016 27553 raft_consensus.cc:2243] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 LEADER]: Raft consensus shutting down.
I20260203 09:17:45.984355 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:45.986028 29462 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c49cb7ba1af14dfcbe637cf12fbe669c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:45.986315 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b6c0f69b8ce94c9b9b4e64882eb25a2c" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:45.987231 29461 raft_consensus.cc:1275] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260203 09:17:45.951185 30877 raft_consensus.cc:2749] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:45.980978 30795 consensus_queue.cc:237] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:45.995625 28883 raft_consensus.cc:2468] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 5.
I20260203 09:17:45.997514 28700 leader_election.cc:304] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:46.001899 29461 raft_consensus.cc:1275] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260203 09:17:45.981004 30818 consensus_queue.cc:237] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:46.001973 29457 raft_consensus.cc:3060] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:45.946118 30730 consensus_queue.cc:1048] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260203 09:17:46.008302 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e336e3590fc428e88c5353c9e96a36f" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:46.027541 28700 leader_election.cc:304] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:46.053380 28700 leader_election.cc:304] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:46.054854 28700 leader_election.cc:304] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:46.058459 29426 consensus_peers.cc:597] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:46.012635 29427 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s user 0.009s sys 0.028s
W20260203 09:17:46.059204 29427 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s user 0.010s sys 0.028s
I20260203 09:17:46.069028 28631 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:57772 (request call id 178) took 4014 ms. Trace:
I20260203 09:17:46.050477 30765 raft_consensus.cc:2749] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260203 09:17:46.088176 27553 pending_rounds.cc:70] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e: Trying to abort 1 pending ops.
I20260203 09:17:46.088505 27553 pending_rounds.cc:77] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e: Aborting op as it isn't in flight: id { term: 5 index: 4 } timestamp: 7250371645504589824 op_type: NO_OP noop_request { }
I20260203 09:17:46.059713 30730 raft_consensus.cc:2749] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260203 09:17:46.088914 27553 raft_consensus.cc:2889] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260203 09:17:46.057840 30782 raft_consensus.cc:2749] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:17:46.090341 27553 raft_consensus.cc:2272] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:46.086694 28777 leader_election.cc:304] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:46.069449 28631 rpcz_store.cc:276] 0203 09:17:42.045590 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:42.056281 (+ 10691us) service_pool.cc:225] Handling call
0203 09:17:46.059949 (+4003668us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0203 09:17:44.709822 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0203 09:17:44.710426 (+ 604us) write_op.cc:432] Acquiring schema lock in shared mode
0203 09:17:44.710457 (+ 31us) write_op.cc:435] Acquired schema lock
0203 09:17:44.710474 (+ 17us) tablet.cc:660] Decoding operations
0203 09:17:44.711485 (+ 1011us) write_op.cc:620] Acquiring the partition lock for write op
0203 09:17:44.711574 (+ 89us) write_op.cc:641] Partition lock acquired for write op
0203 09:17:44.711601 (+ 27us) tablet.cc:683] Acquiring locks for 10 operations
0203 09:17:44.712585 (+ 984us) tablet.cc:699] Row locks acquired
0203 09:17:44.712606 (+ 21us) write_op.cc:260] PREPARE: finished
0203 09:17:44.712944 (+ 338us) write_op.cc:270] Start()
0203 09:17:44.713056 (+ 112us) write_op.cc:276] Timestamp: P: 1770110264712775 usec, L: 0
0203 09:17:44.713077 (+ 21us) op_driver.cc:348] REPLICATION: starting
0203 09:17:44.714369 (+ 1292us) log.cc:844] Serialized 3984 byte log entry
0203 09:17:44.841150 (+126781us) op_driver.cc:464] REPLICATION: finished
0203 09:17:44.990567 (+149417us) write_op.cc:301] APPLY: starting
0203 09:17:44.990673 (+ 106us) tablet.cc:1365] starting BulkCheckPresence
0203 09:17:44.990919 (+ 246us) tablet.cc:1368] finished BulkCheckPresence
0203 09:17:44.991057 (+ 138us) tablet.cc:1370] starting ApplyRowOperation cycle
0203 09:17:44.992219 (+ 1162us) tablet.cc:1381] finished ApplyRowOperation cycle
0203 09:17:44.992479 (+ 260us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0203 09:17:44.992531 (+ 52us) write_op.cc:312] APPLY: finished
0203 09:17:45.045603 (+ 53072us) log.cc:844] Serialized 77 byte log entry
0203 09:17:45.060029 (+ 14426us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:17:45.092175 (+ 32146us) write_op.cc:454] Released schema lock
0203 09:17:45.095926 (+ 3751us) write_op.cc:341] FINISH: Updating metrics
0203 09:17:45.158865 (+ 62939us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:17:45.162903 (+ 4038us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":121700,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":149151,"apply.run_cpu_time_us":3586,"apply.run_wall_time_us":135582,"num_ops":10,"prepare.queue_time_us":6736,"prepare.run_cpu_time_us":7979,"prepare.run_wall_time_us":23604,"raft.queue_time_us":100178,"raft.run_cpu_time_us":11259,"raft.run_wall_time_us":73831,"replication_time_us":127921,"thread_start_us":183943,"threads_started":4,"wal-append.queue_time_us":18853,"wal-append.run_cpu_time_us":42353,"wal-append.run_wall_time_us":1325261}]]}
I20260203 09:17:46.072880 30766 raft_consensus.cc:2749] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:46.099130 29463 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:46.100276 29463 raft_consensus.cc:2468] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 5.
I20260203 09:17:46.102200 28776 leader_election.cc:304] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:46.048395 30870 consensus_queue.cc:1048] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260203 09:17:46.107116 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:46.061956 30822 consensus_queue.cc:1048] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260203 09:17:46.062091 30775 consensus_queue.cc:1048] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
W20260203 09:17:46.111518 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 51606.8us
I20260203 09:17:46.114090 28633 catalog_manager.cc:5654] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:46.119383 28809 raft_consensus.cc:1240] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Rejecting Update request from peer 77541303e1934638ba82f0f43f707adc for earlier term 4. Current term is 5. Ops: []
I20260203 09:17:46.101079 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:46.128166 28809 raft_consensus.cc:1275] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260203 09:17:46.126858 29426 leader_election.cc:336] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:46.131937 29426 leader_election.cc:304] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:46.140210 28703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:46.115468 30793 raft_consensus.cc:2804] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader election won for term 5
W20260203 09:17:46.147122 29426 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 194 similar messages]
I20260203 09:17:46.132684 28633 catalog_manager.cc:5654] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 2 to 3, leader changed from cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 3 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:46.152515 30864 raft_consensus.cc:493] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:46.115726 30877 raft_consensus.cc:2804] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260203 09:17:46.156301 28633 catalog_manager.cc:5654] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 2 to 3, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 3 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } }
I20260203 09:17:46.164232 28633 catalog_manager.cc:5654] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 4 to 5, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 5 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:46.106626 30392 consensus_queue.cc:1048] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260203 09:17:46.175690 28633 catalog_manager.cc:5654] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 3 to 4, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 4 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:46.191202 28776 leader_election.cc:304] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:46.155071 30809 raft_consensus.cc:2749] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260203 09:17:46.185979 28852 consensus_peers.cc:597] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260203 09:17:46.207300 28852 consensus_peers.cc:597] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:46.203116 28633 catalog_manager.cc:5654] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:46.209244 28633 catalog_manager.cc:5654] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:46.162585 30877 raft_consensus.cc:493] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:46.211525 28633 catalog_manager.cc:5654] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 1 to 3, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 3 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } }
I20260203 09:17:46.221853 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:46.189651 29460 raft_consensus.cc:1240] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Rejecting Update request from peer be3b58b70fd74625a8ae8dfd7db7f6ee for earlier term 3. Current term is 4. Ops: []
I20260203 09:17:46.225479 28851 leader_election.cc:304] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:46.178629 30793 raft_consensus.cc:697] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:46.226755 28633 catalog_manager.cc:5654] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
W20260203 09:17:46.208168 30893 log.cc:927] Time spent T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a: Append to log took a long time: real 0.077s user 0.001s sys 0.000s
I20260203 09:17:46.252282 28633 catalog_manager.cc:5654] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 3 to 5, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 5 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:46.262900 28633 catalog_manager.cc:5654] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 2 to 4, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 4 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:46.269450 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:46.274749 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 78377.6us
I20260203 09:17:46.191646 30864 raft_consensus.cc:515] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:46.231899 30877 raft_consensus.cc:3060] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:46.254410 30873 raft_consensus.cc:2749] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260203 09:17:46.290446 29426 consensus_peers.cc:597] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:46.270479 30868 raft_consensus.cc:2749] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260203 09:17:46.293256 30654 consensus_queue.cc:1059] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260203 09:17:46.304852 29458 raft_consensus.cc:1240] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 5 LEADER]: Rejecting Update request from peer 77541303e1934638ba82f0f43f707adc for earlier term 4. Current term is 5. Ops: []
W20260203 09:17:46.324250 30865 consensus_queue.cc:1175] T 15917cb595b149fd847e4ab4424f8262 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "847a7af9f0e2497cbb9025cc2c62557e" status { last_received { term: 5 index: 4 } last_committed_idx: 3 last_received_current_leader { term: 5 index: 4 } }
I20260203 09:17:46.327922 30864 leader_election.cc:290] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:46.328748 27553 tablet_replica.cc:333] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:46.328918 29457 raft_consensus.cc:1275] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Refusing update from remote peer 847a7af9f0e2497cbb9025cc2c62557e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260203 09:17:46.329319 29457 pending_rounds.cc:85] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a: Aborting all ops after (but not including) 3
I20260203 09:17:46.329567 29457 pending_rounds.cc:107] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260203 09:17:46.329857 27553 raft_consensus.cc:2243] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 5 LEADER]: Raft consensus shutting down.
I20260203 09:17:46.330045 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:46.294047 30392 consensus_queue.cc:1059] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260203 09:17:46.331918 30392 raft_consensus.cc:3055] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:17:46.332255 30392 raft_consensus.cc:740] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:46.314668 30828 consensus_queue.cc:1048] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
W20260203 09:17:46.393211 28700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260203 09:17:46.397545 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 87020.1us
W20260203 09:17:46.399561 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 169859us
I20260203 09:17:46.329869 29457 raft_consensus.cc:2917] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260203 09:17:46.352151 30875 raft_consensus.cc:493] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
W20260203 09:17:46.405783 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 60759.6us
W20260203 09:17:46.419314 28702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260203 09:17:46.444816 30912 log.cc:927] Time spent T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a: Append to log took a long time: real 0.064s user 0.000s sys 0.001s
W20260203 09:17:46.507823 30897 log.cc:927] Time spent T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.124s user 0.000s sys 0.000s
I20260203 09:17:46.512838 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "113a394f120048c58168ad22915e0187" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:46.515002 28700 leader_election.cc:304] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:46.515964 27553 raft_consensus.cc:2272] T d146929ef3874ea3a955fd4c49d19d4c P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:46.517189 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 118980us
W20260203 09:17:46.526618 28701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:46.443312 29457 raft_consensus.cc:2889] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [term 5 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260203 09:17:46.536988 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 62717.3us
I20260203 09:17:46.361336 30793 consensus_queue.cc:237] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:46.545037 28703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:46.442505 30875 raft_consensus.cc:515] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:46.542129 28851 leader_election.cc:304] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:46.529778 30871 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:46.534332 30775 raft_consensus.cc:493] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:46.411023 30392 consensus_queue.cc:260] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:46.533201 30826 raft_consensus.cc:2749] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260203 09:17:46.587338 30896 log.cc:927] Time spent T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.206s user 0.000s sys 0.001s
W20260203 09:17:46.577519 30920 log.cc:927] Time spent T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a: Append to log took a long time: real 0.054s user 0.001s sys 0.000s
W20260203 09:17:46.590214 30913 log.cc:927] Time spent T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.063s user 0.000s sys 0.001s
I20260203 09:17:46.598001 30875 leader_election.cc:290] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:46.601912 30917 raft_consensus.cc:2749] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260203 09:17:46.609897 30907 log.cc:927] Time spent T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.225s user 0.000s sys 0.001s
I20260203 09:17:46.611076 28881 raft_consensus.cc:3055] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 4 LEADER]: Stepping down as leader of term 4
I20260203 09:17:46.611485 28881 raft_consensus.cc:740] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:46.612246 28881 consensus_queue.cc:260] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:46.597867 27553 tablet_replica.cc:333] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:46.624979 28813 raft_consensus.cc:1275] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260203 09:17:46.632128 30832 consensus_queue.cc:1048] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260203 09:17:46.574158 30906 log.cc:927] Time spent T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.193s user 0.001s sys 0.000s
W20260203 09:17:46.577620 30909 log.cc:927] Time spent T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.053s user 0.001s sys 0.000s
W20260203 09:17:46.632539 30910 log.cc:927] Time spent T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a: Append to log took a long time: real 0.248s user 0.002s sys 0.000s
I20260203 09:17:46.613562 28881 raft_consensus.cc:3060] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:46.574347 30775 raft_consensus.cc:515] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:46.573207 30871 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:46.658936 30877 raft_consensus.cc:515] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:46.710355 27553 raft_consensus.cc:2243] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Raft consensus shutting down.
W20260203 09:17:46.728058 29426 consensus_peers.cc:597] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:46.731001 30775 leader_election.cc:290] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:46.734155 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 190578us
W20260203 09:17:46.736730 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 164230us
W20260203 09:17:46.737576 28776 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:46.741976 29456 raft_consensus.cc:1275] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260203 09:17:46.700912 30805 raft_consensus.cc:493] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:46.745958 29426 consensus_peers.cc:597] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:46.749823 28812 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:46.764182 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 222101us
W20260203 09:17:46.766616 28777 leader_election.cc:336] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:46.768468 28851 leader_election.cc:304] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:17:46.769435 28777 leader_election.cc:336] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:46.772256 28808 raft_consensus.cc:1275] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260203 09:17:46.715029 30884 raft_consensus.cc:493] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
W20260203 09:17:46.785024 28777 leader_election.cc:336] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:46.790725 28777 leader_election.cc:336] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:46.791163 28777 leader_election.cc:304] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:46.792743 28777 leader_election.cc:336] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:46.783674 28809 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:46.793265 28777 leader_election.cc:304] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:46.786540 30906 log.cc:927] Time spent T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
I20260203 09:17:46.781672 30880 raft_consensus.cc:493] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:46.782390 30795 raft_consensus.cc:2749] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:46.799003 30870 raft_consensus.cc:493] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:46.846453 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 71134.6us
I20260203 09:17:46.804970 30895 raft_consensus.cc:2749] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260203 09:17:46.798089 30793 raft_consensus.cc:2749] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260203 09:17:46.835975 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a720779d5e3444dc8825e118d9880b72" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:46.854215 28887 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f40d17692ce0424589f3962011b49824" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:46.766040 30805 raft_consensus.cc:515] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:46.867051 30392 raft_consensus.cc:3060] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:46.834273 30828 raft_consensus.cc:493] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:46.845346 30813 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:46.865072 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 61091.1us
I20260203 09:17:46.791898 30799 consensus_queue.cc:1048] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260203 09:17:46.798693 30884 raft_consensus.cc:515] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:46.890690 28702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:46.844920 30880 raft_consensus.cc:515] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:46.965261 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 118176us
W20260203 09:17:46.953848 29426 consensus_peers.cc:597] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:46.969456 28809 raft_consensus.cc:1240] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Rejecting Update request from peer 847a7af9f0e2497cbb9025cc2c62557e for earlier term 5. Current term is 6. Ops: []
I20260203 09:17:46.853535 30870 raft_consensus.cc:515] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:46.904028 30878 raft_consensus.cc:493] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:46.976711 28853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260203 09:17:46.977718 30922 log.cc:927] Time spent T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.109s user 0.000s sys 0.000s
W20260203 09:17:46.980115 30903 log.cc:927] Time spent T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.594s user 0.000s sys 0.013s
I20260203 09:17:46.981518 30934 raft_consensus.cc:493] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:46.958314 30873 raft_consensus.cc:493] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:47.025728 30932 log.cc:927] Time spent T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e: Append to log took a long time: real 0.051s user 0.000s sys 0.000s
I20260203 09:17:47.027361 30942 raft_consensus.cc:493] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:47.028026 30942 raft_consensus.cc:515] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:47.030328 30942 leader_election.cc:290] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:46.998224 30878 raft_consensus.cc:515] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:47.038681 30878 leader_election.cc:290] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:47.039515 30941 raft_consensus.cc:493] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:47.040064 30941 raft_consensus.cc:515] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:47.042233 30941 leader_election.cc:290] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:46.893805 30828 raft_consensus.cc:515] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:47.043159 30880 leader_election.cc:290] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:46.893627 30813 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:47.044307 30828 leader_election.cc:290] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:47.045296 30813 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:47.060684 28701 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 75297us
I20260203 09:17:47.046444 30805 leader_election.cc:290] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:47.006276 30934 raft_consensus.cc:515] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:46.998508 30871 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:47.049815 28881 raft_consensus.cc:1275] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260203 09:17:47.027415 30877 leader_election.cc:290] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:47.053783 30884 leader_election.cc:290] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:47.080322 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:47.013964 30873 raft_consensus.cc:515] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:47.056984 30875 consensus_queue.cc:1059] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260203 09:17:47.065471 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:47.071367 28701 leader_election.cc:304] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:47.074644 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31afe6e1e9d24b89b4ac6d2e837fca22" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:47.076090 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:47.046593 30870 leader_election.cc:290] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:47.092085 27553 raft_consensus.cc:2272] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:47.075282 28881 pending_rounds.cc:85] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc: Aborting all ops after (but not including) 5
I20260203 09:17:47.091598 28885 raft_consensus.cc:2468] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 4.
W20260203 09:17:47.102784 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 120484us
I20260203 09:17:47.098671 28881 pending_rounds.cc:107] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260203 09:17:47.097126 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:47.110510 28701 leader_election.cc:304] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:47.113401 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:47.114075 28804 raft_consensus.cc:2468] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:47.128854 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:47.111232 28881 raft_consensus.cc:2889] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260203 09:17:47.133567 30790 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260203 09:17:47.114349 30864 raft_consensus.cc:2706] T f40d17692ce0424589f3962011b49824 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Received pre-election callback for term 7 while not running: Illegal state: RaftConsensus is not running: State = Stopped
I20260203 09:17:47.137025 28700 leader_election.cc:304] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:47.132155 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:47.137391 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4630d6f6a17e4819a2daf0560e4013ad" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:47.151451 28700 leader_election.cc:304] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:47.132030 30927 raft_consensus.cc:2749] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260203 09:17:47.152812 29426 consensus_peers.cc:597] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260203 09:17:47.163199 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 46404.8us
I20260203 09:17:47.158936 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:47.176769 29426 consensus_peers.cc:597] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:47.188623 29426 leader_election.cc:304] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:17:47.189951 28852 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 96598.5us
I20260203 09:17:47.191627 29426 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:47.184995 30765 raft_consensus.cc:2749] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260203 09:17:47.171108 30868 consensus_queue.cc:1048] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260203 09:17:47.218451 30881 consensus_queue.cc:1048] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260203 09:17:47.219908 27553 tablet_replica.cc:333] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:47.221045 27553 raft_consensus.cc:2243] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:47.221835 27553 raft_consensus.cc:2272] T b6c0f69b8ce94c9b9b4e64882eb25a2c P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:47.222985 28882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:47.223769 28882 raft_consensus.cc:2393] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be3b58b70fd74625a8ae8dfd7db7f6ee in current term 5: Already voted for candidate 77541303e1934638ba82f0f43f707adc in this term.
I20260203 09:17:47.176187 30873 leader_election.cc:290] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:47.223907 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf838e5b1f6141bfb1cd1bc26a8b0006" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:47.181952 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:47.207643 30943 log.cc:927] Time spent T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.077s user 0.001s sys 0.000s
I20260203 09:17:47.209350 30934 leader_election.cc:290] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:47.210381 30936 raft_consensus.cc:493] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:47.214634 30883 raft_consensus.cc:493] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:47.204118 30945 raft_consensus.cc:2804] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260203 09:17:47.465214 28702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:17:47.479283 28884 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:47.395998 28700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 149339us
I20260203 09:17:47.490016 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "649a6d7dbffd49cf9969715dea1c841d" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:47.196237 30718 raft_consensus.cc:2804] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:47.492120 30936 raft_consensus.cc:515] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:47.479415 27553 tablet_replica.cc:333] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
W20260203 09:17:47.412438 28777 leader_election.cc:336] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:47.504158 28777 leader_election.cc:304] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:47.506038 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 98944.2us
W20260203 09:17:47.506753 28777 leader_election.cc:336] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:47.507691 28777 consensus_peers.cc:597] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:47.518954 28889 raft_consensus.cc:1275] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260203 09:17:47.256595 30944 log.cc:927] Time spent T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.067s user 0.000s sys 0.000s
I20260203 09:17:47.520859 28700 leader_election.cc:304] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:17:47.249238 30914 log.cc:927] Time spent T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.053s user 0.000s sys 0.000s
I20260203 09:17:47.211862 29459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:47.527849 28777 leader_election.cc:304] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:47.235903 29461 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:47.423619 29457 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6063a063fced4ff38761f892acbdfa76" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:47.397110 30942 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:17:47.534864 28777 consensus_peers.cc:597] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:47.236510 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:47.517606 30830 raft_consensus.cc:2749] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260203 09:17:47.508289 30810 raft_consensus.cc:493] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:47.491434 30945 raft_consensus.cc:493] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:47.499750 30718 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:47.457165 30941 raft_consensus.cc:493] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:47.397109 30940 raft_consensus.cc:493] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:47.535133 30730 raft_consensus.cc:2749] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:47.397984 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:47.538163 27553 raft_consensus.cc:2243] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:47.393657 30826 raft_consensus.cc:493] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:47.538781 30634 raft_consensus.cc:2749] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260203 09:17:47.515121 28881 raft_consensus.cc:2468] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 5.
I20260203 09:17:47.539134 29461 raft_consensus.cc:2468] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 5.
W20260203 09:17:47.544832 28777 consensus_peers.cc:597] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:47.537087 30411 raft_consensus.cc:3060] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:47.518323 30577 raft_consensus.cc:493] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 77541303e1934638ba82f0f43f707adc)
I20260203 09:17:47.560300 28883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40958 (request call id 1394) took 1021 ms. Trace:
I20260203 09:17:47.550700 30718 raft_consensus.cc:3060] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:47.504182 30883 raft_consensus.cc:515] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:47.564674 30826 raft_consensus.cc:515] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:47.587960 30826 leader_election.cc:290] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:47.591202 29465 raft_consensus.cc:1275] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260203 09:17:47.591732 30883 leader_election.cc:290] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:47.578187 27553 raft_consensus.cc:2272] T 8b2c469d7255413d9f61a7cbaa4481a7 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:47.549674 30945 raft_consensus.cc:3060] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:47.540856 30942 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:47.574538 28883 rpcz_store.cc:276] 0203 09:17:46.538628 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:46.538758 (+ 130us) service_pool.cc:225] Handling call
0203 09:17:46.566314 (+ 27556us) raft_consensus.cc:1471] Updating replica for 1 ops
0203 09:17:46.855345 (+289031us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:17:46.855378 (+ 33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0203 09:17:46.855867 (+ 489us) log.cc:844] Serialized 26 byte log entry
0203 09:17:46.985195 (+129328us) raft_consensus.cc:1645] Marking committed up to 6
0203 09:17:46.985233 (+ 38us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:46.985303 (+ 70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0203 09:17:47.560112 (+574809us) raft_consensus.cc:1685] finished
0203 09:17:47.560132 (+ 20us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:47.560244 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3320,"raft.queue_time_us":35022,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":376892,"threads_started":2,"wal-append.queue_time_us":222663}
I20260203 09:17:47.602159 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:47.549340 30810 raft_consensus.cc:515] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:47.608505 28811 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:47.555478 30941 raft_consensus.cc:515] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:47.621528 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 98880.7us
I20260203 09:17:47.622563 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2339220aa4ac4160839f61543c6c60d2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:47.625663 28701 leader_election.cc:304] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:47.583745 30577 raft_consensus.cc:515] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:47.614728 30730 raft_consensus.cc:493] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:47.634945 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:47.627066 30822 raft_consensus.cc:3055] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 LEADER]: Stepping down as leader of term 5
I20260203 09:17:47.645761 30942 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:47.646723 30936 leader_election.cc:290] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:47.647182 27553 tablet_replica.cc:333] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:47.648137 30941 leader_election.cc:290] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:47.649552 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "021e904a783c4cbc96e5aa625a34a2d8" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:47.651710 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:47.653152 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd8e39da0721419098d343e576a8c0a2" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:47.658244 28883 raft_consensus.cc:2468] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 4.
I20260203 09:17:47.659458 28701 leader_election.cc:304] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:47.660583 28701 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:47.557204 30940 raft_consensus.cc:515] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:47.641558 30875 raft_consensus.cc:2749] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260203 09:17:47.656622 30903 log.cc:927] Time spent T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc: Append to log took a long time: real 0.646s user 0.010s sys 0.002s
I20260203 09:17:47.673195 27553 raft_consensus.cc:2243] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:47.650256 30822 raft_consensus.cc:740] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:47.663134 30942 raft_consensus.cc:2749] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:47.657626 30790 raft_consensus.cc:493] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:47.667680 30936 raft_consensus.cc:2804] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:47.641803 30730 raft_consensus.cc:515] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:47.694518 27553 raft_consensus.cc:2272] T a720779d5e3444dc8825e118d9880b72 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:47.682035 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "021e904a783c4cbc96e5aa625a34a2d8" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:47.703328 30953 log.cc:927] Time spent T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a: Append to log took a long time: real 0.120s user 0.000s sys 0.001s
I20260203 09:17:47.704218 30940 leader_election.cc:290] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:47.705092 28888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40946 (request call id 1379) took 1772 ms. Trace:
I20260203 09:17:47.710342 30577 leader_election.cc:290] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:47.698918 30936 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:47.712059 30936 raft_consensus.cc:3060] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:47.714134 30730 leader_election.cc:290] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:47.701292 30790 raft_consensus.cc:515] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:47.716045 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b6f1d6e275f4a8ba99a70dbb3ea3235" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:47.719257 30822 consensus_queue.cc:260] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:47.723021 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:47.723043 28701 leader_election.cc:304] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:47.726183 30938 raft_consensus.cc:2749] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:17:47.705458 28888 rpcz_store.cc:276] 0203 09:17:45.928163 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:45.928391 (+ 228us) service_pool.cc:225] Handling call
0203 09:17:45.932285 (+ 3894us) raft_consensus.cc:1471] Updating replica for 1 ops
0203 09:17:45.942664 (+ 10379us) raft_consensus.cc:1534] Early marking committed up to index 3
0203 09:17:46.060088 (+117424us) log.cc:844] Serialized 14 byte log entry
0203 09:17:46.103488 (+ 43400us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0203 09:17:46.111373 (+ 7885us) log.cc:844] Serialized 26 byte log entry
0203 09:17:46.111542 (+ 169us) raft_consensus.cc:1645] Marking committed up to 3
0203 09:17:46.111579 (+ 37us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:17:46.111653 (+ 74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0203 09:17:46.785143 (+673490us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b18001f3f60. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd9b5bc91 00007f2cd9b68671 00007f2cd0d07402 00007f2cd0d096a1 00007f2cd0d09659 00007f2cd0d095e9 00007f2cd0d095b1 00007f2cd0d088ad 0000000000379254 0000000000379099 00007f2cd0cea69a
0203 09:17:46.850368 (+ 65225us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b440002304c. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd0b478b1 00007f2cd0c16005 00007f2cd0c16a22 00007f2cd396057b 00007f2cd395be4f 00007f2cd394fc0e 00007f2cd394ef56 00007f2cd394eb78 00007f2cd39585c1 00007f2cd3958579 00007f2cd3958509
0203 09:17:47.641874 (+791506us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b2400399458. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd0b478b1 00007f2cd0b5bad4 00007f2cd0b59bdb 00007f2cd0be8ad9 00007f2cd0be8765 00007f2cd0be7dad 00007f2cd39384ae 00007f2cd394fc2c 00007f2cd394ef56 00007f2cd394eb78 00007f2cd39585c1
0203 09:17:47.700578 (+ 58704us) raft_consensus.cc:1685] finished
0203 09:17:47.700599 (+ 21us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:17:47.700765 (+ 166us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9946,"prepare.queue_time_us":152651,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":11065,"raft.run_cpu_time_us":451,"raft.run_wall_time_us":8558,"spinlock_wait_cycles":62897536,"thread_start_us":114717,"threads_started":2,"wal-append.queue_time_us":259640}
I20260203 09:17:47.723366 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b6f1d6e275f4a8ba99a70dbb3ea3235" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:47.720575 30822 raft_consensus.cc:3060] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:47.745370 28701 leader_election.cc:304] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:47.752095 30836 raft_consensus.cc:493] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:47.729137 30790 leader_election.cc:290] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:47.756253 30836 raft_consensus.cc:515] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:47.757663 30810 leader_election.cc:290] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:47.759723 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:47.760444 28806 raft_consensus.cc:2468] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 4.
I20260203 09:17:47.761643 29425 leader_election.cc:304] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:47.752738 30766 raft_consensus.cc:2749] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:47.766844 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:47.769305 30836 leader_election.cc:290] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:47.770851 30411 raft_consensus.cc:2749] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:47.765587 30810 raft_consensus.cc:2804] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:47.780296 30810 raft_consensus.cc:493] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:47.780730 30810 raft_consensus.cc:3060] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Advancing to term 5
W20260203 09:17:47.780963 28852 leader_election.cc:336] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:47.791850 29426 consensus_peers.cc:597] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260203 09:17:47.793576 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 151088us
I20260203 09:17:47.793012 30810 raft_consensus.cc:515] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:47.764479 30718 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:47.801518 29460 raft_consensus.cc:2393] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77541303e1934638ba82f0f43f707adc in current term 5: Already voted for candidate cf00f643e7da4a98a0a11ea92869c24a in this term.
I20260203 09:17:47.805158 30577 raft_consensus.cc:493] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:47.804296 27553 tablet_replica.cc:333] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:47.809110 27553 raft_consensus.cc:2243] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 5 LEADER]: Raft consensus shutting down.
I20260203 09:17:47.808524 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:47.813941 27553 raft_consensus.cc:2272] T bcfe4116093a4fe49ba4dfa67b48cedf P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:47.813933 28813 raft_consensus.cc:3060] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:47.804160 30810 leader_election.cc:290] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:47.827770 28852 leader_election.cc:336] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:47.828413 28852 leader_election.cc:304] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
W20260203 09:17:47.830056 28852 leader_election.cc:336] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:47.834002 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:47.838912 27553 tablet_replica.cc:333] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:47.839919 27553 raft_consensus.cc:2243] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:47.840423 27553 raft_consensus.cc:2272] T 7e336e3590fc428e88c5353c9e96a36f P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:47.813100 30877 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:47.845177 30718 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:47.805768 30577 raft_consensus.cc:515] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:47.864243 30877 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:47.820564 30945 raft_consensus.cc:515] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:47.865851 30577 leader_election.cc:290] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:47.867908 30945 leader_election.cc:290] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 6 election: Requested vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:47.868501 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:47.869122 28885 raft_consensus.cc:3060] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:47.831934 30917 raft_consensus.cc:2749] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260203 09:17:47.854136 30961 log.cc:927] Time spent T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.154s user 0.002s sys 0.000s
I20260203 09:17:47.855902 30766 raft_consensus.cc:493] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:47.872350 27553 tablet_replica.cc:333] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:47.872249 30766 raft_consensus.cc:515] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:47.874575 30766 leader_election.cc:290] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:47.875698 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:47.876047 28885 raft_consensus.cc:2468] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 6.
I20260203 09:17:47.876336 28805 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2fe435e0235d42ec88a9773010ea1fec" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:47.876607 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:47.877197 28804 raft_consensus.cc:3060] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:47.877368 28701 leader_election.cc:304] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
I20260203 09:17:47.879428 28700 leader_election.cc:304] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:47.880635 30577 raft_consensus.cc:2804] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Leader election won for term 6
I20260203 09:17:47.881198 30577 raft_consensus.cc:697] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:47.882422 30822 raft_consensus.cc:2749] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:47.882071 30577 consensus_queue.cc:237] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:47.891062 27553 raft_consensus.cc:2243] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:47.876267 30877 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:47.891752 27553 pending_rounds.cc:70] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e: Trying to abort 1 pending ops.
I20260203 09:17:47.892014 27553 pending_rounds.cc:77] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7250371568894267392 op_type: NO_OP noop_request { }
I20260203 09:17:47.892344 27553 raft_consensus.cc:2889] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260203 09:17:47.892701 27553 raft_consensus.cc:2272] T 4630d6f6a17e4819a2daf0560e4013ad P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:47.861871 28813 raft_consensus.cc:2468] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 5.
I20260203 09:17:47.894654 29425 leader_election.cc:304] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:47.895498 30718 raft_consensus.cc:2804] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader election won for term 5
I20260203 09:17:47.896018 30718 raft_consensus.cc:697] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 5 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:47.896333 30936 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:47.896967 30718 consensus_queue.cc:237] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:47.898991 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:47.899516 28885 raft_consensus.cc:3060] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Advancing to term 5
W20260203 09:17:47.899613 28777 consensus_peers.cc:597] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260203 09:17:47.900261 28777 consensus_peers.cc:597] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:47.902137 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:47.832300 29426 consensus_peers.cc:597] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260203 09:17:47.905449 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 73202us
W20260203 09:17:47.906049 29426 consensus_peers.cc:597] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260203 09:17:47.902962 28852 consensus_peers.cc:597] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:47.908957 28885 raft_consensus.cc:2468] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 5.
I20260203 09:17:47.910229 28701 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e; no voters:
W20260203 09:17:47.900974 28777 consensus_peers.cc:597] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260203 09:17:47.911731 28852 leader_election.cc:336] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:47.912249 29426 leader_election.cc:336] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:47.913950 28804 raft_consensus.cc:2468] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847a7af9f0e2497cbb9025cc2c62557e in term 6.
W20260203 09:17:47.915132 28777 consensus_peers.cc:597] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:47.911563 30945 raft_consensus.cc:2804] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Leader election won for term 5
I20260203 09:17:47.921684 30945 raft_consensus.cc:697] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 LEADER]: Becoming Leader. State: Replica: 847a7af9f0e2497cbb9025cc2c62557e, State: Running, Role: LEADER
I20260203 09:17:47.922564 30945 consensus_queue.cc:237] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:47.925730 30963 log.cc:927] Time spent T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a: Append to log took a long time: real 0.172s user 0.000s sys 0.001s
I20260203 09:17:47.927284 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:47.928032 28881 raft_consensus.cc:2468] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 4.
I20260203 09:17:47.935856 28635 catalog_manager.cc:5654] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 4 to 5, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 5 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } }
I20260203 09:17:47.946494 28777 leader_election.cc:304] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:47.947356 30877 raft_consensus.cc:2749] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260203 09:17:47.948547 28633 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56858 (request call id 302) took 3842 ms. Trace:
I20260203 09:17:47.948971 28633 rpcz_store.cc:276] 0203 09:17:44.106513 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:44.106767 (+ 254us) service_pool.cc:225] Handling call
0203 09:17:47.948484 (+3841717us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0203 09:17:47.029536 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0203 09:17:47.030151 (+ 615us) write_op.cc:432] Acquiring schema lock in shared mode
0203 09:17:47.030186 (+ 35us) write_op.cc:435] Acquired schema lock
0203 09:17:47.030199 (+ 13us) tablet.cc:660] Decoding operations
0203 09:17:47.031240 (+ 1041us) write_op.cc:620] Acquiring the partition lock for write op
0203 09:17:47.031299 (+ 59us) write_op.cc:641] Partition lock acquired for write op
0203 09:17:47.031331 (+ 32us) tablet.cc:683] Acquiring locks for 11 operations
0203 09:17:47.032266 (+ 935us) tablet.cc:699] Row locks acquired
0203 09:17:47.032285 (+ 19us) write_op.cc:260] PREPARE: finished
0203 09:17:47.032444 (+ 159us) write_op.cc:270] Start()
0203 09:17:47.032557 (+ 113us) write_op.cc:276] Timestamp: P: 1770110267032389 usec, L: 0
0203 09:17:47.032575 (+ 18us) op_driver.cc:348] REPLICATION: starting
0203 09:17:47.108977 (+ 76402us) log.cc:844] Serialized 4403 byte log entry
0203 09:17:47.622887 (+513910us) op_driver.cc:464] REPLICATION: finished
0203 09:17:47.700208 (+ 77321us) write_op.cc:301] APPLY: starting
0203 09:17:47.700289 (+ 81us) tablet.cc:1365] starting BulkCheckPresence
0203 09:17:47.700511 (+ 222us) tablet.cc:1368] finished BulkCheckPresence
0203 09:17:47.702467 (+ 1956us) tablet.cc:1370] starting ApplyRowOperation cycle
0203 09:17:47.716485 (+ 14018us) tablet.cc:1381] finished ApplyRowOperation cycle
0203 09:17:47.725127 (+ 8642us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0203 09:17:47.725175 (+ 48us) write_op.cc:312] APPLY: finished
0203 09:17:47.725430 (+ 255us) log.cc:844] Serialized 83 byte log entry
0203 09:17:47.725571 (+ 141us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:17:47.725673 (+ 102us) write_op.cc:454] Released schema lock
0203 09:17:47.725708 (+ 35us) write_op.cc:341] FINISH: Updating metrics
0203 09:17:47.726058 (+ 350us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:17:47.726706 (+ 648us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1575,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":75281,"apply.run_cpu_time_us":3014,"apply.run_wall_time_us":25828,"num_ops":11,"prepare.queue_time_us":620032,"prepare.run_cpu_time_us":21231,"prepare.run_wall_time_us":160568,"raft.queue_time_us":320909,"raft.run_cpu_time_us":19710,"raft.run_wall_time_us":103584,"replication_time_us":575777,"thread_start_us":564372,"threads_started":4,"wal-append.queue_time_us":141968}]]}
I20260203 09:17:47.938138 28635 catalog_manager.cc:5654] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } }
I20260203 09:17:47.954171 30940 consensus_queue.cc:1048] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:17:47.958434 30936 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 election: Requested vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:47.959332 28700 leader_election.cc:304] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:47.962612 30936 raft_consensus.cc:2749] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:47.955107 28777 leader_election.cc:304] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:47.956292 28851 leader_election.cc:304] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:47.963577 30946 raft_consensus.cc:2804] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260203 09:17:47.964005 30946 raft_consensus.cc:493] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:47.964226 30940 raft_consensus.cc:2749] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:47.964381 30946 raft_consensus.cc:3060] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:47.963349 30577 raft_consensus.cc:493] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:47.965698 30577 raft_consensus.cc:515] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:47.970273 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b149dd40ec15465299cdb910e5385206" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:47.972107 30917 consensus_queue.cc:1048] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260203 09:17:47.974267 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:47.958257 28635 catalog_manager.cc:5654] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 2 to 4, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 4 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:47.976735 30577 leader_election.cc:290] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:47.980970 27553 tablet_replica.cc:333] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:47.999207 27553 raft_consensus.cc:2243] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 5 LEADER]: Raft consensus shutting down.
I20260203 09:17:48.000398 27553 raft_consensus.cc:2272] T e18f9202613d46f68396231b64ee4ada P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:47.996132 30946 raft_consensus.cc:515] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:48.003393 28635 catalog_manager.cc:5654] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:17:48.004249 28885 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1862780e910a42d5a3414a9329cd9259" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:48.018751 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:48.004738 30946 leader_election.cc:290] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:48.019578 28881 raft_consensus.cc:2393] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a in current term 5: Already voted for candidate 847a7af9f0e2497cbb9025cc2c62557e in this term.
I20260203 09:17:48.004964 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:48.005528 27553 tablet_replica.cc:333] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.005620 28883 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0322ad4122a64f6abccdfb1906919b8e" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:48.020942 27553 raft_consensus.cc:2243] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:17:48.021390 28635 catalog_manager.cc:5654] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } }
I20260203 09:17:48.020417 28880 raft_consensus.cc:2468] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 3.
I20260203 09:17:48.007941 30577 raft_consensus.cc:493] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:48.025367 27553 raft_consensus.cc:2272] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:48.025118 30577 raft_consensus.cc:515] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:48.013077 28777 leader_election.cc:304] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:48.018378 28851 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:48.028051 28804 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:48.029253 30946 raft_consensus.cc:2749] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:48.033030 30940 raft_consensus.cc:2804] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:48.033564 30940 raft_consensus.cc:493] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:48.034051 30940 raft_consensus.cc:3060] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:48.028251 27553 tablet_replica.cc:333] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.035343 27553 raft_consensus.cc:2243] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 LEADER]: Raft consensus shutting down.
I20260203 09:17:48.035218 28851 leader_election.cc:304] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:48.036173 27553 pending_rounds.cc:70] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e: Trying to abort 2 pending ops.
I20260203 09:17:48.036445 27553 pending_rounds.cc:77] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e: Aborting op as it isn't in flight: id { term: 6 index: 4 } timestamp: 7250371657255452672 op_type: NO_OP noop_request { }
I20260203 09:17:48.036542 30946 raft_consensus.cc:2749] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260203 09:17:48.036842 27553 raft_consensus.cc:2889] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260203 09:17:48.028041 30577 leader_election.cc:290] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:48.041930 27553 pending_rounds.cc:77] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e: Aborting op as it isn't in flight: id { term: 4 index: 3 } timestamp: 7250371635394895872 op_type: NO_OP noop_request { }
I20260203 09:17:48.048959 27553 raft_consensus.cc:2889] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260203 09:17:48.049363 27553 raft_consensus.cc:2272] T 298c016813da45bdbc537b5851b5e728 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:48.044234 30940 raft_consensus.cc:515] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:48.050365 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09f2301096ce4f4689e1e7f24f013e52" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:48.051075 29460 raft_consensus.cc:3060] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Advancing to term 6
W20260203 09:17:48.051281 28852 consensus_peers.cc:597] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260203 09:17:48.052357 30940 leader_election.cc:290] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:48.053067 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:48.053928 29456 raft_consensus.cc:2393] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 5: Already voted for candidate cf00f643e7da4a98a0a11ea92869c24a in this term.
I20260203 09:17:48.056545 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4915f49d9ce24ab29a5c09e91dafd667" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:48.056770 27553 tablet_replica.cc:333] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.057739 27553 raft_consensus.cc:2243] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:48.058301 27553 raft_consensus.cc:2272] T 649a6d7dbffd49cf9969715dea1c841d P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:48.058570 30577 raft_consensus.cc:493] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:48.059090 30577 raft_consensus.cc:515] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:48.060994 27553 tablet_replica.cc:333] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.062830 27553 raft_consensus.cc:2243] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:17:48.063344 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0b96e8815b1443c99aaa50410b2c6d1" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:48.064157 30577 leader_election.cc:290] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:48.061817 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:48.065418 27553 raft_consensus.cc:2272] T 74236b7aaa67439b807775f90674420c P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:48.066179 28852 consensus_peers.cc:597] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260203 09:17:48.067453 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:48.066526 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c8f123f58ac4b3da0beed1215102a98" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:48.069063 29464 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c13ab397c8524e6ca30e36e5fca2ff35" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:48.069356 29465 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f652d76b6054b738b66531829291e55" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:48.074412 29456 raft_consensus.cc:2393] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 847a7af9f0e2497cbb9025cc2c62557e in current term 5: Already voted for candidate cf00f643e7da4a98a0a11ea92869c24a in this term.
I20260203 09:17:48.075765 28701 leader_election.cc:304] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:48.069602 27553 tablet_replica.cc:333] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.077466 30577 raft_consensus.cc:2749] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:48.078603 27553 raft_consensus.cc:2243] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:48.079231 27553 raft_consensus.cc:2272] T 7c8f123f58ac4b3da0beed1215102a98 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:48.081041 29460 raft_consensus.cc:2468] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 6.
I20260203 09:17:48.084039 27553 tablet_replica.cc:333] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.024293 28635 catalog_manager.cc:5654] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 2 to 4, leader changed from cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 4 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:48.085307 27553 raft_consensus.cc:2243] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:48.086087 27553 raft_consensus.cc:2272] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:48.085620 28635 catalog_manager.cc:5654] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 5 to 6, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 6 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } }
I20260203 09:17:48.087034 28635 catalog_manager.cc:5654] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 4 to 6, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 6 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:17:48.091604 27553 tablet_replica.cc:333] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.096578 28700 leader_election.cc:304] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:48.109277 28700 raft_consensus.cc:2686] T 4915f49d9ce24ab29a5c09e91dafd667 P 847a7af9f0e2497cbb9025cc2c62557e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260203 09:17:48.102608 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:48.110304 28700 leader_election.cc:304] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:48.111604 30936 raft_consensus.cc:2749] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:48.111831 27553 raft_consensus.cc:2243] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:17:48.113672 27553 raft_consensus.cc:2272] T 47301e2bbfc94767a9905b0e12141d6d P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:48.114719 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b71c6a3f2db4b738de03d5e4190cf27" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:48.115374 28881 raft_consensus.cc:3060] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Advancing to term 5
W20260203 09:17:48.122149 28777 leader_election.cc:336] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:48.123415 28881 raft_consensus.cc:2468] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 5.
I20260203 09:17:48.110266 29426 leader_election.cc:304] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:48.133280 30718 raft_consensus.cc:2749] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:48.126461 28635 catalog_manager.cc:5654] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 2 to 4, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 4 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:17:48.130205 27553 tablet_replica.cc:333] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.138103 27553 raft_consensus.cc:2243] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:48.140204 29426 leader_election.cc:304] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:48.140830 27553 raft_consensus.cc:2272] T 6063a063fced4ff38761f892acbdfa76 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:48.141654 28852 consensus_peers.cc:597] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260203 09:17:48.143345 30880 raft_consensus.cc:2749] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260203 09:17:48.143774 28852 leader_election.cc:336] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:48.142127 28635 catalog_manager.cc:5654] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 2 to 5, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 5 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } }
I20260203 09:17:48.167953 28700 leader_election.cc:304] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:48.169100 30936 raft_consensus.cc:2749] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:48.167991 27553 tablet_replica.cc:333] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.171789 27553 raft_consensus.cc:2243] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:48.172428 27553 raft_consensus.cc:2272] T 2f652d76b6054b738b66531829291e55 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:48.173200 28700 leader_election.cc:304] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:48.178807 28777 leader_election.cc:304] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:48.179570 30940 raft_consensus.cc:2804] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader election won for term 5
I20260203 09:17:48.179992 30936 raft_consensus.cc:2749] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260203 09:17:48.180086 30940 raft_consensus.cc:697] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:48.181298 30940 consensus_queue.cc:237] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:48.177680 28852 consensus_peers.cc:597] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260203 09:17:48.174369 28851 leader_election.cc:304] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:48.187578 30946 raft_consensus.cc:2804] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Leader election won for term 6
I20260203 09:17:48.188133 30946 raft_consensus.cc:697] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 6 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:48.188953 30946 consensus_queue.cc:237] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:48.192633 27553 tablet_replica.cc:333] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.195147 27553 raft_consensus.cc:2243] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 6 LEADER]: Raft consensus shutting down.
I20260203 09:17:48.198721 27553 raft_consensus.cc:2272] T 6b21247fc3af467fa74a89f61d43143f P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:48.202293 28777 leader_election.cc:336] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:48.202790 28777 leader_election.cc:304] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:48.204082 27553 tablet_replica.cc:333] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.205011 27553 raft_consensus.cc:2243] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:48.205659 27553 raft_consensus.cc:2272] T c49cb7ba1af14dfcbe637cf12fbe669c P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:48.207903 28852 consensus_peers.cc:597] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260203 09:17:48.214864 29426 leader_election.cc:336] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:48.216122 29426 leader_election.cc:336] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:48.216742 29426 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:48.216704 28777 consensus_peers.cc:597] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:48.214957 30877 raft_consensus.cc:2749] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260203 09:17:48.218595 30880 raft_consensus.cc:2749] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260203 09:17:48.224882 28777 leader_election.cc:336] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:48.230995 30805 raft_consensus.cc:493] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:48.238253 30805 raft_consensus.cc:515] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:48.241704 30805 leader_election.cc:290] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:48.242950 27553 tablet_replica.cc:333] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.246582 27553 raft_consensus.cc:2243] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:48.249225 27553 raft_consensus.cc:2272] T 2fe435e0235d42ec88a9773010ea1fec P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:48.252377 27553 tablet_replica.cc:333] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.253239 27553 raft_consensus.cc:2243] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:48.253865 27553 raft_consensus.cc:2272] T a0b96e8815b1443c99aaa50410b2c6d1 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:48.259138 30936 raft_consensus.cc:493] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:48.259739 30936 raft_consensus.cc:515] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:48.261900 30936 leader_election.cc:290] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:48.262907 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:48.267526 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:48.268244 28881 raft_consensus.cc:2468] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 5.
I20260203 09:17:48.275950 27553 tablet_replica.cc:333] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.277189 28777 leader_election.cc:304] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:48.278019 30805 raft_consensus.cc:2804] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260203 09:17:48.278381 30805 raft_consensus.cc:493] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:48.278750 30805 raft_consensus.cc:3060] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:48.281292 27553 raft_consensus.cc:2243] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260203 09:17:48.281787 28777 leader_election.cc:336] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:48.288344 28813 raft_consensus.cc:1275] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260203 09:17:48.288962 27553 raft_consensus.cc:2272] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 847a7af9f0e2497cbb9025cc2c62557e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:48.289860 30718 consensus_queue.cc:1048] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260203 09:17:48.291781 27553 tablet_replica.cc:333] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.292621 27553 raft_consensus.cc:2243] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:48.303530 27553 raft_consensus.cc:2272] T 2339220aa4ac4160839f61543c6c60d2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:48.306655 27553 tablet_replica.cc:333] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.307454 27553 raft_consensus.cc:2243] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 LEADER]: Raft consensus shutting down.
I20260203 09:17:48.308230 27553 pending_rounds.cc:70] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e: Trying to abort 1 pending ops.
I20260203 09:17:48.302953 30805 raft_consensus.cc:515] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:48.310765 30805 leader_election.cc:290] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:48.313088 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d146929ef3874ea3a955fd4c49d19d4c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:48.313680 28881 raft_consensus.cc:3060] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Advancing to term 6
W20260203 09:17:48.317451 28777 leader_election.cc:336] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:48.321027 28881 raft_consensus.cc:2468] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 6.
I20260203 09:17:48.323179 28777 leader_election.cc:304] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:48.325368 30940 raft_consensus.cc:2804] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Leader election won for term 6
I20260203 09:17:48.325922 30940 raft_consensus.cc:697] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:48.326748 30940 consensus_queue.cc:237] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:48.330070 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6bf3d38eba3b4894b7f18f2d5733f63e" candidate_uuid: "847a7af9f0e2497cbb9025cc2c62557e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:48.308495 27553 pending_rounds.cc:77] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e: Aborting op as it isn't in flight: id { term: 5 index: 6 } timestamp: 7250371657420316672 op_type: NO_OP noop_request { }
I20260203 09:17:48.332443 27553 raft_consensus.cc:2889] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260203 09:17:48.334184 27553 raft_consensus.cc:2272] T 3f2a68daf4384c47ba2a6a46ac297f00 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:48.335026 28852 consensus_peers.cc:597] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260203 09:17:48.340106 27553 tablet_replica.cc:333] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.341049 27553 raft_consensus.cc:2243] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:48.341583 27553 raft_consensus.cc:2272] T fabfb779b8894cf0b22204fe12768dc3 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:48.344053 27553 tablet_replica.cc:333] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.348428 28700 leader_election.cc:304] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 847a7af9f0e2497cbb9025cc2c62557e; no voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:48.349560 30936 raft_consensus.cc:2749] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:48.355047 28881 raft_consensus.cc:3060] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 5
I20260203 09:17:48.360927 27553 raft_consensus.cc:2243] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:48.362087 28881 raft_consensus.cc:1275] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260203 09:17:48.362843 27553 raft_consensus.cc:2272] T 1862780e910a42d5a3414a9329cd9259 P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:48.363844 30880 consensus_queue.cc:1048] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260203 09:17:48.370110 27553 tablet_replica.cc:333] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.370987 27553 raft_consensus.cc:2243] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:17:48.382566 27553 raft_consensus.cc:2272] T a924eec8e84d4192bc0e30ae0829e54b P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:48.414011 27553 tablet_replica.cc:333] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.415014 27553 raft_consensus.cc:2243] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:48.417128 27553 raft_consensus.cc:2272] T 6645a0476f6e40bda131d06fa0f15f7b P 847a7af9f0e2497cbb9025cc2c62557e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:48.420210 27553 tablet_replica.cc:333] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.420990 27553 raft_consensus.cc:2243] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 5 LEADER]: Raft consensus shutting down.
I20260203 09:17:48.429744 27553 raft_consensus.cc:2272] T 7e1bac12c6ee43d6901400e02b35d82f P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:48.439281 27553 tablet_replica.cc:333] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.440021 27553 raft_consensus.cc:2243] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:17:48.441011 27553 raft_consensus.cc:2272] T 0ce53cd3bb1847daa8cecd00aacff824 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:48.458992 28852 consensus_peers.cc:597] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260203 09:17:48.461215 27553 tablet_replica.cc:333] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.462291 27553 raft_consensus.cc:2243] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:48.462915 27553 pending_rounds.cc:70] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e: Trying to abort 1 pending ops.
I20260203 09:17:48.463152 27553 pending_rounds.cc:77] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e: Aborting op as it isn't in flight: id { term: 3 index: 2 } timestamp: 7250371612907933696 op_type: NO_OP noop_request { }
I20260203 09:17:48.463470 27553 raft_consensus.cc:2889] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260203 09:17:48.460024 28631 catalog_manager.cc:5654] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:48.463809 27553 raft_consensus.cc:2272] T bd8e39da0721419098d343e576a8c0a2 P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:48.466468 27553 tablet_replica.cc:333] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.467199 27553 raft_consensus.cc:2243] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:48.467707 27553 raft_consensus.cc:2272] T 0d2d0debbeba46b086bb9d7344d2181b P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:48.469388 28631 catalog_manager.cc:5654] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 3 to 6, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68). New cstate: current_term: 6 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:48.473202 28631 catalog_manager.cc:5654] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:48.477017 28635 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56866 (request call id 292) took 3538 ms. Trace:
I20260203 09:17:48.485630 28631 catalog_manager.cc:5654] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:48.480479 28635 rpcz_store.cc:276] 0203 09:17:44.935919 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:44.936077 (+ 158us) service_pool.cc:225] Handling call
0203 09:17:48.474491 (+3538414us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0203 09:17:48.202325 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0203 09:17:48.221643 (+ 19318us) write_op.cc:432] Acquiring schema lock in shared mode
0203 09:17:48.222716 (+ 1073us) write_op.cc:435] Acquired schema lock
0203 09:17:48.223277 (+ 561us) tablet.cc:660] Decoding operations
0203 09:17:48.277386 (+ 54109us) write_op.cc:620] Acquiring the partition lock for write op
0203 09:17:48.277463 (+ 77us) write_op.cc:641] Partition lock acquired for write op
0203 09:17:48.277491 (+ 28us) tablet.cc:683] Acquiring locks for 10 operations
0203 09:17:48.278215 (+ 724us) tablet.cc:699] Row locks acquired
0203 09:17:48.278236 (+ 21us) write_op.cc:260] PREPARE: finished
0203 09:17:48.278378 (+ 142us) write_op.cc:270] Start()
0203 09:17:48.278499 (+ 121us) write_op.cc:276] Timestamp: P: 1770110268278328 usec, L: 0
0203 09:17:48.278523 (+ 24us) op_driver.cc:348] REPLICATION: starting
0203 09:17:48.279210 (+ 687us) log.cc:844] Serialized 4087 byte log entry
0203 09:17:48.352680 (+ 73470us) op_driver.cc:464] REPLICATION: finished
0203 09:17:48.383137 (+ 30457us) write_op.cc:301] APPLY: starting
0203 09:17:48.383219 (+ 82us) tablet.cc:1365] starting BulkCheckPresence
0203 09:17:48.387872 (+ 4653us) tablet.cc:1368] finished BulkCheckPresence
0203 09:17:48.388764 (+ 892us) tablet.cc:1370] starting ApplyRowOperation cycle
0203 09:17:48.390675 (+ 1911us) tablet.cc:1381] finished ApplyRowOperation cycle
0203 09:17:48.390908 (+ 233us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0203 09:17:48.390951 (+ 43us) write_op.cc:312] APPLY: finished
0203 09:17:48.391195 (+ 244us) log.cc:844] Serialized 77 byte log entry
0203 09:17:48.391347 (+ 152us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:17:48.391469 (+ 122us) write_op.cc:454] Released schema lock
0203 09:17:48.391512 (+ 43us) write_op.cc:341] FINISH: Updating metrics
0203 09:17:48.391918 (+ 406us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:17:48.391946 (+ 28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":24599,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":30178,"apply.run_cpu_time_us":2864,"apply.run_wall_time_us":8759,"num_ops":10,"prepare.queue_time_us":40038,"prepare.run_cpu_time_us":4750,"prepare.run_wall_time_us":79478,"replication_time_us":71238,"thread_start_us":53737,"threads_started":2}]]}
I20260203 09:17:48.490479 27553 tablet_replica.cc:333] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.491962 27553 raft_consensus.cc:2243] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:48.493141 27553 raft_consensus.cc:2272] T f4da79410aa74f5abca9517bbae98420 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:48.492592 28631 catalog_manager.cc:5654] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:48.496132 27553 tablet_replica.cc:333] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.499881 27553 raft_consensus.cc:2243] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:48.501250 27553 raft_consensus.cc:2272] T 6bf3d38eba3b4894b7f18f2d5733f63e P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:48.499874 28631 catalog_manager.cc:5654] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 4 to 5, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68). New cstate: current_term: 5 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:48.502954 28631 catalog_manager.cc:5654] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 3 to 5, leader changed from cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 5 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:48.503765 27553 tablet_replica.cc:333] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.522743 27553 raft_consensus.cc:2243] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:48.524487 27553 pending_rounds.cc:70] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e: Trying to abort 1 pending ops.
I20260203 09:17:48.524775 27553 pending_rounds.cc:77] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e: Aborting op as it isn't in flight: id { term: 2 index: 5 } timestamp: 7250371602865680384 op_type: NO_OP noop_request { }
I20260203 09:17:48.525089 27553 raft_consensus.cc:2889] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260203 09:17:48.525378 27553 raft_consensus.cc:2272] T eac7b86aa8d340e3a4d61a5c982b1f2e P 847a7af9f0e2497cbb9025cc2c62557e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:48.528374 27553 tablet_replica.cc:333] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.535682 27553 raft_consensus.cc:2243] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:48.539652 27553 pending_rounds.cc:70] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e: Trying to abort 2 pending ops.
I20260203 09:17:48.534174 28631 catalog_manager.cc:5654] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 3 to 5, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 5 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:48.539942 27553 pending_rounds.cc:77] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e: Aborting op as it isn't in flight: id { term: 5 index: 6 } timestamp: 7250371632589664256 op_type: NO_OP noop_request { }
I20260203 09:17:48.540346 27553 raft_consensus.cc:2889] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260203 09:17:48.540661 27553 pending_rounds.cc:77] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e: Aborting op as it isn't in flight: id { term: 4 index: 5 } timestamp: 7250371597733388288 op_type: NO_OP noop_request { }
I20260203 09:17:48.540956 27553 raft_consensus.cc:2889] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260203 09:17:48.541266 27553 raft_consensus.cc:2272] T c13ab397c8524e6ca30e36e5fca2ff35 P 847a7af9f0e2497cbb9025cc2c62557e [term 6 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:48.543736 27553 tablet_replica.cc:333] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.544433 27553 raft_consensus.cc:2243] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:48.545003 27553 raft_consensus.cc:2272] T 113a394f120048c58168ad22915e0187 P 847a7af9f0e2497cbb9025cc2c62557e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:48.565614 27553 tablet_replica.cc:333] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e: stopping tablet replica
I20260203 09:17:48.566370 27553 raft_consensus.cc:2243] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:48.591337 27553 raft_consensus.cc:2272] T 021e904a783c4cbc96e5aa625a34a2d8 P 847a7af9f0e2497cbb9025cc2c62557e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:48.610996 29426 consensus_peers.cc:597] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:48.614715 28633 catalog_manager.cc:5654] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } }
I20260203 09:17:48.618453 28633 catalog_manager.cc:5654] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 3 to 5, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 5 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
W20260203 09:17:48.622316 28852 consensus_peers.cc:597] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260203 09:17:48.621241 28633 catalog_manager.cc:5654] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 1 to 4, leader changed from 77541303e1934638ba82f0f43f707adc (127.26.232.67) to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 4 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } }
I20260203 09:17:48.636499 28633 catalog_manager.cc:5654] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 2 to 5, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65). New cstate: current_term: 5 leader_uuid: "847a7af9f0e2497cbb9025cc2c62557e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:48.638140 28633 catalog_manager.cc:5654] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 3 to 4, leader changed from cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 4 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:48.659930 29456 raft_consensus.cc:1275] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 6 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260203 09:17:48.662753 30917 consensus_queue.cc:1048] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260203 09:17:48.667585 28777 consensus_peers.cc:597] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:48.682060 28635 catalog_manager.cc:5654] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 3 to 5, leader changed from be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66) to cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68). New cstate: current_term: 5 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
W20260203 09:17:48.694803 28852 consensus_peers.cc:597] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:48.703523 28683 auto_rebalancer.cc:726] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:48.703892 28683 auto_rebalancer.cc:266] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:48.718218 28852 consensus_peers.cc:597] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:48.716472 28635 catalog_manager.cc:5654] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 3 to 6, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 6 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260203 09:17:48.719744 28777 consensus_peers.cc:597] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:48.718873 28852 consensus_peers.cc:597] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260203 09:17:48.735366 28881 raft_consensus.cc:1275] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260203 09:17:48.737144 30877 consensus_queue.cc:1048] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:48.769681 28633 catalog_manager.cc:5654] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 4 to 5, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 5 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:48.772228 28633 catalog_manager.cc:5654] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 5 to 6, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 6 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
W20260203 09:17:48.782207 28852 consensus_peers.cc:597] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:48.804183 28881 raft_consensus.cc:1275] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260203 09:17:48.805661 30874 consensus_queue.cc:1048] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260203 09:17:48.869498 29426 consensus_peers.cc:597] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260203 09:17:48.977049 29426 consensus_peers.cc:597] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:49.024356 30718 raft_consensus.cc:493] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.025049 30718 raft_consensus.cc:515] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:49.029786 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:49.030689 28806 raft_consensus.cc:2393] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf00f643e7da4a98a0a11ea92869c24a in current term 6: Already voted for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in this term.
I20260203 09:17:49.035835 30917 raft_consensus.cc:493] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.036443 30917 raft_consensus.cc:515] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.039711 30917 leader_election.cc:290] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:49.041599 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:49.051827 30718 leader_election.cc:290] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
W20260203 09:17:49.073067 28852 leader_election.cc:336] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.074745 28852 leader_election.cc:304] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:49.079566 30940 raft_consensus.cc:493] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.094007 30940 raft_consensus.cc:515] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.096156 30940 leader_election.cc:290] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:49.088539 30877 raft_consensus.cc:493] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:49.096832 30877 raft_consensus.cc:515] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:49.098687 30877 leader_election.cc:290] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:49.100222 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:49.100931 29460 raft_consensus.cc:2468] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 5.
I20260203 09:17:49.102295 28776 leader_election.cc:304] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:49.103440 30877 raft_consensus.cc:2804] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260203 09:17:49.103879 30877 raft_consensus.cc:493] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:49.104262 30877 raft_consensus.cc:3060] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Advancing to term 7
I20260203 09:17:49.118840 30925 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.119395 30925 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:49.121519 30925 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:49.122184 30916 raft_consensus.cc:2749] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:49.135991 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:49.136771 28813 raft_consensus.cc:2468] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 5.
W20260203 09:17:49.140369 29426 leader_election.cc:336] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.143903 29426 leader_election.cc:304] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:49.154834 28851 leader_election.cc:304] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:49.156067 30917 raft_consensus.cc:2804] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260203 09:17:49.157260 30718 raft_consensus.cc:3060] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:49.157878 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:49.164791 28881 raft_consensus.cc:2468] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 5.
I20260203 09:17:49.164119 30917 raft_consensus.cc:493] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.184276 30917 raft_consensus.cc:3060] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:49.197135 30877 raft_consensus.cc:515] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:49.207932 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4da79410aa74f5abca9517bbae98420" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
W20260203 09:17:49.213912 28852 leader_election.cc:336] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.257474 30916 raft_consensus.cc:493] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.258020 30916 raft_consensus.cc:515] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.260064 30916 leader_election.cc:290] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:49.261382 30940 raft_consensus.cc:493] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.261937 30940 raft_consensus.cc:515] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.265410 30940 leader_election.cc:290] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:49.219744 30718 raft_consensus.cc:2749] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260203 09:17:49.221261 28777 leader_election.cc:336] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
W20260203 09:17:49.274026 28777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:37967, user_credentials={real_user=slave}} blocked reactor thread for 52806.3us
W20260203 09:17:49.274564 28777 leader_election.cc:336] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.226963 30877 leader_election.cc:290] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 7 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:49.279685 28777 leader_election.cc:304] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:49.282207 30877 raft_consensus.cc:2804] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260203 09:17:49.282706 30877 raft_consensus.cc:493] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.284193 30877 raft_consensus.cc:3060] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Advancing to term 6
W20260203 09:17:49.286844 28852 consensus_peers.cc:597] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260203 09:17:49.292987 29460 raft_consensus.cc:3060] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 6 FOLLOWER]: Advancing to term 7
I20260203 09:17:49.292989 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:49.299122 28852 leader_election.cc:336] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
W20260203 09:17:49.299639 28852 consensus_peers.cc:597] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260203 09:17:49.303323 29460 raft_consensus.cc:2468] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 7.
I20260203 09:17:49.304792 30916 raft_consensus.cc:493] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.305617 30917 raft_consensus.cc:515] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:49.305335 30916 raft_consensus.cc:515] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.308298 30940 raft_consensus.cc:493] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.310288 30940 raft_consensus.cc:515] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.312309 30940 leader_election.cc:290] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:49.317272 30916 leader_election.cc:290] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:49.319658 30917 leader_election.cc:290] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
W20260203 09:17:49.320791 28852 leader_election.cc:336] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.334686 28776 leader_election.cc:304] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee, cf00f643e7da4a98a0a11ea92869c24a; no voters:
W20260203 09:17:49.334888 28852 leader_election.cc:336] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.335700 30940 raft_consensus.cc:2804] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 7 FOLLOWER]: Leader election won for term 7
I20260203 09:17:49.336411 30940 raft_consensus.cc:697] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 7 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:49.337345 30940 consensus_queue.cc:237] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:49.341387 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:49.348800 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47301e2bbfc94767a9905b0e12141d6d" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:49.354174 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15917cb595b149fd847e4ab4424f8262" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:49.354998 28806 raft_consensus.cc:3060] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:49.375181 30877 raft_consensus.cc:515] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.378160 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:49.379508 28851 leader_election.cc:304] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:49.380896 30916 raft_consensus.cc:2749] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260203 09:17:49.382964 28851 leader_election.cc:304] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:49.384176 30916 raft_consensus.cc:2749] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:17:49.391271 28633 catalog_manager.cc:5654] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 5 to 7, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 7 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:49.400429 30877 leader_election.cc:290] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:49.398967 28806 raft_consensus.cc:2468] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 6.
W20260203 09:17:49.420115 28777 leader_election.cc:336] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
W20260203 09:17:49.420904 28777 leader_election.cc:336] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.421289 28777 leader_election.cc:304] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:49.422014 30805 raft_consensus.cc:2749] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:49.426445 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcfe4116093a4fe49ba4dfa67b48cedf" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:49.427047 28888 raft_consensus.cc:3060] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:49.427275 28851 leader_election.cc:304] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:49.429126 30916 raft_consensus.cc:2804] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Leader election won for term 6
W20260203 09:17:49.429494 28777 leader_election.cc:336] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.429677 30916 raft_consensus.cc:697] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 6 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:49.430024 28777 leader_election.cc:304] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:49.430969 30805 raft_consensus.cc:2749] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260203 09:17:49.430721 30916 consensus_queue.cc:237] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:49.446575 30925 raft_consensus.cc:493] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.447162 30925 raft_consensus.cc:515] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.449337 30925 leader_election.cc:290] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
W20260203 09:17:49.463606 28852 leader_election.cc:336] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.468865 30805 raft_consensus.cc:493] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.469448 30805 raft_consensus.cc:515] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.471360 30805 leader_election.cc:290] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:49.475736 28888 raft_consensus.cc:2468] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 6.
I20260203 09:17:49.478845 28813 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:49.479486 28813 raft_consensus.cc:2468] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 6.
I20260203 09:17:49.487512 28635 catalog_manager.cc:5654] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 5 to 6, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 6 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:49.493463 30925 raft_consensus.cc:493] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.494069 30925 raft_consensus.cc:515] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.496062 30925 leader_election.cc:290] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:49.496955 30805 raft_consensus.cc:493] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.497488 30805 raft_consensus.cc:515] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.499305 30805 leader_election.cc:290] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:49.500447 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
W20260203 09:17:49.502480 28852 leader_election.cc:336] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.502717 28851 leader_election.cc:304] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:49.504495 28777 leader_election.cc:304] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:49.505249 30805 raft_consensus.cc:2804] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Leader election won for term 6
I20260203 09:17:49.505560 30917 raft_consensus.cc:2804] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260203 09:17:49.505968 30917 raft_consensus.cc:493] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.506301 30917 raft_consensus.cc:3060] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Advancing to term 7
W20260203 09:17:49.506433 28777 leader_election.cc:336] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.509150 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:49.509205 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
W20260203 09:17:49.509474 28777 leader_election.cc:336] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.509835 28880 raft_consensus.cc:2468] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 5.
I20260203 09:17:49.509915 28777 leader_election.cc:304] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 77541303e1934638ba82f0f43f707adc, 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:49.510886 30940 raft_consensus.cc:2749] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:49.512784 30940 raft_consensus.cc:493] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.513310 30940 raft_consensus.cc:515] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.515306 30940 leader_election.cc:290] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:49.516947 28777 leader_election.cc:304] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:49.517197 28851 leader_election.cc:304] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:49.517479 30805 raft_consensus.cc:697] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:49.517742 30999 raft_consensus.cc:2804] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260203 09:17:49.518201 30999 raft_consensus.cc:493] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.518304 30916 raft_consensus.cc:493] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.518589 30999 raft_consensus.cc:3060] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:49.518791 30916 raft_consensus.cc:515] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:49.519475 28777 leader_election.cc:336] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.519603 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:49.520186 28880 raft_consensus.cc:2468] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 4.
I20260203 09:17:49.521993 28777 leader_election.cc:304] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:49.521345 30805 consensus_queue.cc:237] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:49.525835 28852 leader_election.cc:336] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.526577 30925 raft_consensus.cc:2749] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:49.526818 30940 raft_consensus.cc:2804] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:49.527319 30940 raft_consensus.cc:493] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.527699 30940 raft_consensus.cc:3060] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:49.528862 30916 leader_election.cc:290] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:49.530889 30999 raft_consensus.cc:515] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.516430 30917 raft_consensus.cc:515] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.532853 30999 leader_election.cc:290] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:49.533332 28777 leader_election.cc:336] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.535024 30940 raft_consensus.cc:515] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.536983 30940 leader_election.cc:290] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:49.537436 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:49.537601 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e18f9202613d46f68396231b64ee4ada" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:49.538084 28806 raft_consensus.cc:2468] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
I20260203 09:17:49.538233 28880 raft_consensus.cc:3060] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Advancing to term 6
W20260203 09:17:49.539983 28852 leader_election.cc:336] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.551115 30917 leader_election.cc:290] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 7 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:49.563309 28635 catalog_manager.cc:5654] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 5 to 6, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 6 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:49.567795 28880 raft_consensus.cc:2468] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 6.
I20260203 09:17:49.575578 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74236b7aaa67439b807775f90674420c" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:49.576252 28880 raft_consensus.cc:3060] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:49.579248 30805 raft_consensus.cc:493] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.579809 30805 raft_consensus.cc:515] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.585523 30805 leader_election.cc:290] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:49.594758 28880 raft_consensus.cc:2468] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 5.
I20260203 09:17:49.595728 28851 leader_election.cc:304] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:49.596693 28777 leader_election.cc:336] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.597553 30917 raft_consensus.cc:2804] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:49.598105 30917 raft_consensus.cc:493] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.598488 30917 raft_consensus.cc:3060] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:49.601744 28881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47301e2bbfc94767a9905b0e12141d6d" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:49.602072 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b21247fc3af467fa74a89f61d43143f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:49.602667 28806 raft_consensus.cc:3060] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Advancing to term 7
I20260203 09:17:49.607267 30917 raft_consensus.cc:515] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.608884 28881 raft_consensus.cc:2468] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 1.
I20260203 09:17:49.610201 28806 raft_consensus.cc:2468] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 7.
I20260203 09:17:49.612272 28777 leader_election.cc:304] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:49.614516 30805 raft_consensus.cc:2804] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Leader election won for term 6
I20260203 09:17:49.615026 30805 raft_consensus.cc:697] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:49.614964 28777 leader_election.cc:304] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:49.616014 30999 raft_consensus.cc:2804] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:17:49.616448 30999 raft_consensus.cc:493] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.616094 30805 consensus_queue.cc:237] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:49.616607 28777 leader_election.cc:336] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.616874 30999 raft_consensus.cc:3060] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Advancing to term 2
W20260203 09:17:49.617437 28777 consensus_peers.cc:597] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:17:49.618228 28852 leader_election.cc:336] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.618613 28851 leader_election.cc:304] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:49.619242 30917 leader_election.cc:290] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:49.619823 30917 raft_consensus.cc:2804] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 7 FOLLOWER]: Leader election won for term 7
I20260203 09:17:49.620313 30917 raft_consensus.cc:697] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 7 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:49.624452 30999 raft_consensus.cc:515] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.624838 28777 leader_election.cc:304] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:49.625754 30940 raft_consensus.cc:2804] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader election won for term 5
I20260203 09:17:49.625530 30917 consensus_queue.cc:237] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.626573 30999 leader_election.cc:290] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:49.626261 30940 raft_consensus.cc:697] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:49.627568 31000 raft_consensus.cc:493] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.627687 30940 consensus_queue.cc:237] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.628142 31000 raft_consensus.cc:515] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.630191 31000 leader_election.cc:290] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
W20260203 09:17:49.638111 28852 leader_election.cc:336] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.646238 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47301e2bbfc94767a9905b0e12141d6d" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:49.653424 28880 raft_consensus.cc:3060] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:17:49.657167 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06f7408dc6eb4aea9a8acfbe1c0b482c" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:49.657899 28806 raft_consensus.cc:3060] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:49.671468 30916 raft_consensus.cc:493] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.672192 30916 raft_consensus.cc:515] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:49.675143 30916 leader_election.cc:290] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
I20260203 09:17:49.675398 29460 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:49.677394 28810 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" is_pre_election: true
I20260203 09:17:49.678066 28810 raft_consensus.cc:2468] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 3.
W20260203 09:17:49.686746 28852 leader_election.cc:336] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.687448 28852 leader_election.cc:304] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77541303e1934638ba82f0f43f707adc; no voters: 847a7af9f0e2497cbb9025cc2c62557e, cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:49.688479 30916 raft_consensus.cc:2749] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260203 09:17:49.691440 28777 leader_election.cc:336] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.693626 28880 raft_consensus.cc:2468] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 2.
I20260203 09:17:49.675451 28806 raft_consensus.cc:2468] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 4.
I20260203 09:17:49.690560 30877 raft_consensus.cc:493] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.698721 28777 leader_election.cc:304] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:49.699589 30877 raft_consensus.cc:515] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.701539 28851 leader_election.cc:304] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:49.702522 30916 raft_consensus.cc:2804] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:17:49.702688 30877 leader_election.cc:290] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:49.702976 30916 raft_consensus.cc:493] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
W20260203 09:17:49.706429 28776 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 72971.4us
W20260203 09:17:49.716681 28777 leader_election.cc:336] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.705142 31006 raft_consensus.cc:2804] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Leader election won for term 2
W20260203 09:17:49.724116 28777 leader_election.cc:336] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.703368 30916 raft_consensus.cc:3060] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:49.723831 30718 raft_consensus.cc:493] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.742933 31006 raft_consensus.cc:697] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:49.745510 31006 consensus_queue.cc:237] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:49.747339 29426 consensus_peers.cc:597] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260203 09:17:49.748214 30718 raft_consensus.cc:515] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:49.750319 30718 leader_election.cc:290] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:49.751331 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:49.751960 28880 raft_consensus.cc:2468] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 5.
W20260203 09:17:49.753409 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 50179.5us
I20260203 09:17:49.754101 28851 leader_election.cc:304] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:49.755568 29426 leader_election.cc:304] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:49.757668 30718 raft_consensus.cc:2804] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260203 09:17:49.756246 31007 raft_consensus.cc:2804] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:17:49.767462 28635 catalog_manager.cc:5654] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 5 to 6, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 6 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:49.768700 30718 raft_consensus.cc:493] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.769150 30718 raft_consensus.cc:3060] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:49.770398 30916 raft_consensus.cc:515] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.773202 30916 leader_election.cc:290] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:49.776917 30718 raft_consensus.cc:515] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:49.787073 30718 leader_election.cc:290] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:49.788458 31007 raft_consensus.cc:697] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 4 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:49.789309 28880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:49.789958 28880 raft_consensus.cc:2468] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 4.
I20260203 09:17:49.789467 31007 consensus_queue.cc:237] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.794023 28777 leader_election.cc:304] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
W20260203 09:17:49.779762 29426 consensus_peers.cc:597] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:17:49.794925 29426 leader_election.cc:336] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.795365 31009 raft_consensus.cc:2804] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:17:49.795842 31009 raft_consensus.cc:493] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Starting leader election (detected failure of leader 847a7af9f0e2497cbb9025cc2c62557e)
I20260203 09:17:49.796168 31009 raft_consensus.cc:3060] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Advancing to term 5
W20260203 09:17:49.801754 28777 consensus_peers.cc:597] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260203 09:17:49.802953 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1bac12c6ee43d6901400e02b35d82f" candidate_uuid: "cf00f643e7da4a98a0a11ea92869c24a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:49.803561 28888 raft_consensus.cc:3060] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:49.806200 31009 raft_consensus.cc:515] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:49.808069 28806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ce53cd3bb1847daa8cecd00aacff824" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee"
I20260203 09:17:49.817020 28806 raft_consensus.cc:3060] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:17:49.812393 28888 raft_consensus.cc:2468] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf00f643e7da4a98a0a11ea92869c24a in term 6.
W20260203 09:17:49.810271 28852 leader_election.cc:336] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
W20260203 09:17:49.810609 29426 leader_election.cc:336] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.825882 28806 raft_consensus.cc:2468] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 4.
I20260203 09:17:49.828020 31009 leader_election.cc:290] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:49.832849 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a924eec8e84d4192bc0e30ae0829e54b" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
W20260203 09:17:49.833386 28777 leader_election.cc:336] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:49.833489 28888 raft_consensus.cc:3060] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:17:49.835564 29426 leader_election.cc:304] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:49.841061 28635 catalog_manager.cc:5654] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 6 to 7, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 7 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:17:49.849364 30450 raft_consensus.cc:2804] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 6 FOLLOWER]: Leader election won for term 6
I20260203 09:17:49.849879 30450 raft_consensus.cc:697] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 6 LEADER]: Becoming Leader. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Running, Role: LEADER
I20260203 09:17:49.848408 28851 leader_election.cc:304] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:49.850800 30450 consensus_queue.cc:237] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:49.856230 31008 raft_consensus.cc:2804] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:17:49.856874 31008 raft_consensus.cc:697] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 4 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:49.857779 31008 consensus_queue.cc:237] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:49.861783 28777 consensus_peers.cc:597] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260203 09:17:49.864483 28633 catalog_manager.cc:5654] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 4 to 5, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 5 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:49.866740 28633 catalog_manager.cc:5654] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 1 to 2, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 2 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:49.886214 29458 raft_consensus.cc:1275] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 7 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260203 09:17:49.848816 28888 raft_consensus.cc:2468] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 5.
I20260203 09:17:49.889849 31009 consensus_queue.cc:1048] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
W20260203 09:17:49.910851 27553 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 28759)
W20260203 09:17:49.912209 28777 consensus_peers.cc:597] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:17:49.915880 29426 consensus_peers.cc:597] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260203 09:17:49.917326 28777 leader_election.cc:304] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters: 847a7af9f0e2497cbb9025cc2c62557e
I20260203 09:17:49.919467 31009 raft_consensus.cc:2804] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Leader election won for term 5
I20260203 09:17:49.920034 31009 raft_consensus.cc:697] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
W20260203 09:17:49.925688 29426 consensus_peers.cc:597] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260203 09:17:49.926414 31009 consensus_queue.cc:237] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
W20260203 09:17:49.943528 28777 consensus_peers.cc:597] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:49.954561 28806 raft_consensus.cc:1275] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260203 09:17:49.965739 28852 consensus_peers.cc:597] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:49.978308 29460 raft_consensus.cc:3060] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [term 5 LEARNER]: Advancing to term 6
I20260203 09:17:49.987468 28633 catalog_manager.cc:5654] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 3 to 4, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 4 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:17:49.989161 28633 catalog_manager.cc:5654] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 3 to 4, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 4 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } }
I20260203 09:17:50.001744 28635 catalog_manager.cc:5654] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: term changed from 5 to 6, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68). New cstate: current_term: 6 leader_uuid: "cf00f643e7da4a98a0a11ea92869c24a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260203 09:17:49.989967 31008 consensus_queue.cc:1048] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260203 09:17:50.020577 29460 raft_consensus.cc:1275] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [term 6 LEARNER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260203 09:17:50.052533 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 80698.8us
W20260203 09:17:50.053838 29426 consensus_peers.cc:597] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:17:50.089756 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 53594.7us
I20260203 09:17:50.099359 28881 raft_consensus.cc:1275] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260203 09:17:50.067418 30916 consensus_queue.cc:1048] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260203 09:17:50.088130 31010 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:50.117046 31010 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:50.117758 31006 consensus_queue.cc:1048] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:50.119398 31010 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:50.123196 28777 consensus_peers.cc:597] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:50.124133 28852 consensus_peers.cc:597] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260203 09:17:50.129215 28806 consensus_queue.cc:237] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:50.131969 28634 catalog_manager.cc:5654] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 4 to 5, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 5 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
W20260203 09:17:50.143095 29425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:41611, user_credentials={real_user=slave}} blocked reactor thread for 52565.6us
W20260203 09:17:50.154623 31023 log.cc:927] Time spent T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee: Append to log took a long time: real 0.061s user 0.000s sys 0.000s
W20260203 09:17:50.154796 28777 consensus_peers.cc:597] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:50.155328 28777 consensus_peers.cc:597] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:17:50.166721 29426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:42899, user_credentials={real_user=slave}} blocked reactor thread for 107201us
I20260203 09:17:50.184129 28881 raft_consensus.cc:1275] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260203 09:17:50.190598 28813 raft_consensus.cc:1275] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 7 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260203 09:17:50.193917 31010 consensus_queue.cc:1048] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:50.205714 29456 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a" is_pre_election: true
I20260203 09:17:50.206429 29456 raft_consensus.cc:2468] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 5.
W20260203 09:17:50.211433 28777 consensus_peers.cc:597] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:50.212072 28777 consensus_peers.cc:597] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:17:50.215024 28776 consensus_peers.cc:597] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2fe435e0235d42ec88a9773010ea1fec. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:50.220556 28851 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:50.222533 31010 raft_consensus.cc:2804] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260203 09:17:50.222968 31010 raft_consensus.cc:493] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260203 09:17:50.225586 29426 consensus_peers.cc:597] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260203 09:17:50.225859 31010 raft_consensus.cc:3060] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Advancing to term 6
W20260203 09:17:50.233943 28852 leader_election.cc:336] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
W20260203 09:17:50.226148 29426 consensus_peers.cc:597] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260203 09:17:50.253319 31009 consensus_queue.cc:1048] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260203 09:17:50.254411 28777 consensus_peers.cc:597] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:50.257160 31010 raft_consensus.cc:515] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:50.264961 31010 leader_election.cc:290] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627)
W20260203 09:17:50.265784 28777 consensus_peers.cc:597] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:50.268205 28806 raft_consensus.cc:1275] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260203 09:17:50.271557 30917 consensus_queue.cc:1048] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:50.278136 31000 raft_consensus.cc:1064] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:50.281639 29458 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f2a68daf4384c47ba2a6a46ac297f00" candidate_uuid: "77541303e1934638ba82f0f43f707adc" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "cf00f643e7da4a98a0a11ea92869c24a"
I20260203 09:17:50.282399 29458 raft_consensus.cc:3060] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:17:50.280488 31000 consensus_queue.cc:237] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:50.288874 29426 consensus_peers.cc:597] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260203 09:17:50.300367 28804 raft_consensus.cc:1275] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260203 09:17:50.302510 30917 consensus_queue.cc:1048] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260203 09:17:50.296380 29458 raft_consensus.cc:2468] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77541303e1934638ba82f0f43f707adc in term 6.
I20260203 09:17:50.312624 28851 leader_election.cc:304] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, cf00f643e7da4a98a0a11ea92869c24a; no voters:
I20260203 09:17:50.323951 31010 raft_consensus.cc:2804] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Leader election won for term 6
I20260203 09:17:50.324474 31010 raft_consensus.cc:697] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 6 LEADER]: Becoming Leader. State: Replica: 77541303e1934638ba82f0f43f707adc, State: Running, Role: LEADER
I20260203 09:17:50.325328 31010 consensus_queue.cc:237] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:50.331743 29458 raft_consensus.cc:1275] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [term 6 LEARNER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260203 09:17:50.335630 29426 consensus_peers.cc:597] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:50.337082 31007 consensus_queue.cc:1048] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260203 09:17:50.339349 28881 raft_consensus.cc:1275] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260203 09:17:50.349382 28880 raft_consensus.cc:1275] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260203 09:17:50.349674 28885 raft_consensus.cc:1275] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260203 09:17:50.353261 28852 consensus_peers.cc:597] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:50.355726 30877 consensus_queue.cc:1048] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:50.357299 30940 consensus_queue.cc:1048] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:50.357606 30877 consensus_queue.cc:1048] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260203 09:17:50.359326 28852 leader_election.cc:336] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
W20260203 09:17:50.360105 28852 consensus_peers.cc:597] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:50.360534 28852 consensus_peers.cc:597] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:50.386113 30916 raft_consensus.cc:2955] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 2 to 6, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
W20260203 09:17:50.393244 28852 consensus_peers.cc:597] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260203 09:17:50.394686 28635 catalog_manager.cc:5654] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc reported cstate change: term changed from 2 to 6, leader changed from cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) to 77541303e1934638ba82f0f43f707adc (127.26.232.67). New cstate: current_term: 6 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260203 09:17:50.396598 28777 consensus_peers.cc:597] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:50.397486 30877 raft_consensus.cc:493] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:50.397993 30877 raft_consensus.cc:515] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:50.402194 30877 leader_election.cc:290] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:50.403724 28888 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc" is_pre_election: true
I20260203 09:17:50.404431 28888 raft_consensus.cc:2468] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 6.
I20260203 09:17:50.408708 28777 leader_election.cc:304] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
W20260203 09:17:50.409623 28777 leader_election.cc:336] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
W20260203 09:17:50.411163 28852 consensus_peers.cc:597] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260203 09:17:50.424723 30877 raft_consensus.cc:2804] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260203 09:17:50.429507 30877 raft_consensus.cc:493] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:17:50.429885 30877 raft_consensus.cc:3060] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Advancing to term 7
I20260203 09:17:50.432754 29458 raft_consensus.cc:2955] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 2 to 6, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
W20260203 09:17:50.435914 28777 consensus_peers.cc:597] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:17:50.441401 28852 consensus_peers.cc:597] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260203 09:17:50.438800 28804 raft_consensus.cc:2955] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 2 to 6, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:50.447615 30877 raft_consensus.cc:515] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:50.449628 30877 leader_election.cc:290] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 7 election: Requested vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
I20260203 09:17:50.458451 28886 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "298c016813da45bdbc537b5851b5e728" candidate_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "77541303e1934638ba82f0f43f707adc"
I20260203 09:17:50.459149 28886 raft_consensus.cc:3060] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Advancing to term 7
I20260203 09:17:50.469558 28634 catalog_manager.cc:5654] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: config changed from index 2 to 6, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:50.474243 28886 raft_consensus.cc:2468] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be3b58b70fd74625a8ae8dfd7db7f6ee in term 7.
W20260203 09:17:50.479526 28852 consensus_peers.cc:597] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:50.487331 28886 raft_consensus.cc:1275] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Refusing update from remote peer cf00f643e7da4a98a0a11ea92869c24a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260203 09:17:50.495100 30718 consensus_queue.cc:1048] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260203 09:17:50.497359 30805 raft_consensus.cc:2955] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:50.504627 28777 leader_election.cc:304] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee; no voters:
I20260203 09:17:50.505470 31006 raft_consensus.cc:2804] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 7 FOLLOWER]: Leader election won for term 7
I20260203 09:17:50.505949 31006 raft_consensus.cc:697] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 7 LEADER]: Becoming Leader. State: Replica: be3b58b70fd74625a8ae8dfd7db7f6ee, State: Running, Role: LEADER
I20260203 09:17:50.506871 31006 consensus_queue.cc:237] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } }
I20260203 09:17:50.524966 28806 raft_consensus.cc:1275] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260203 09:17:50.525710 28885 consensus_queue.cc:237] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
W20260203 09:17:50.527468 28777 leader_election.cc:336] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:50.534547 30916 consensus_queue.cc:1048] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260203 09:17:50.530779 28880 raft_consensus.cc:2955] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:50.537969 28888 raft_consensus.cc:1275] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260203 09:17:50.540544 30877 consensus_queue.cc:1048] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:50.544433 28635 catalog_manager.cc:5654] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: term changed from 2 to 7, leader changed from 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) to be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66). New cstate: current_term: 7 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: UNKNOWN } } }
W20260203 09:17:50.579347 28851 consensus_peers.cc:597] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c8f123f58ac4b3da0beed1215102a98. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:50.594091 28804 raft_consensus.cc:1275] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260203 09:17:50.598554 28635 catalog_manager.cc:5654] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index -1 to 4, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 4 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:50.601486 31008 consensus_queue.cc:1048] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
W20260203 09:17:50.613283 28852 consensus_peers.cc:597] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:50.633718 28852 consensus_peers.cc:597] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260203 09:17:50.648818 31010 raft_consensus.cc:2955] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:50.652549 28804 raft_consensus.cc:2955] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:50.667624 28813 consensus_queue.cc:237] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:50.682387 28880 raft_consensus.cc:1275] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260203 09:17:50.684249 28776 consensus_peers.cc:597] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 74236b7aaa67439b807775f90674420c. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:50.685616 30877 consensus_queue.cc:1048] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:17:50.690477 28635 catalog_manager.cc:5654] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc reported cstate change: config changed from index -1 to 4, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 4 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:50.700073 30805 raft_consensus.cc:2955] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 LEADER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
W20260203 09:17:50.723625 28777 consensus_peers.cc:597] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:50.726313 28804 consensus_queue.cc:237] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
W20260203 09:17:50.732793 28776 consensus_peers.cc:597] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68:40627): Couldn't send request to peer cf00f643e7da4a98a0a11ea92869c24a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1dd859ca9f8b4cda8cca01872e191b47. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:50.744201 28880 raft_consensus.cc:2955] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:50.747377 28634 catalog_manager.cc:5654] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index -1 to 4, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 5 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:50.756280 28885 raft_consensus.cc:1275] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260203 09:17:50.761646 28777 consensus_peers.cc:597] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:50.766243 30805 consensus_queue.cc:1048] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260203 09:17:50.800104 28852 consensus_peers.cc:597] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:50.829994 29456 raft_consensus.cc:1275] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 6 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260203 09:17:50.832386 30916 consensus_queue.cc:1048] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260203 09:17:50.845762 31046 ts_tablet_manager.cc:933] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:50.848726 31006 raft_consensus.cc:2955] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 LEADER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:50.869473 28885 raft_consensus.cc:2955] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } } }
I20260203 09:17:50.893115 31046 tablet_copy_client.cc:323] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.66:41611
I20260203 09:17:50.896286 28823 tablet_copy_service.cc:140] P be3b58b70fd74625a8ae8dfd7db7f6ee: Received BeginTabletCopySession request for tablet 2fe435e0235d42ec88a9773010ea1fec from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:50256)
I20260203 09:17:50.896997 28823 tablet_copy_service.cc:161] P be3b58b70fd74625a8ae8dfd7db7f6ee: Beginning new tablet copy session on tablet 2fe435e0235d42ec88a9773010ea1fec from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:50256: session id = cf00f643e7da4a98a0a11ea92869c24a-2fe435e0235d42ec88a9773010ea1fec
W20260203 09:17:50.911532 27553 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 28759)
I20260203 09:17:50.913111 28823 tablet_copy_source_session.cc:215] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:50.926087 31046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fe435e0235d42ec88a9773010ea1fec. 1 dirs total, 0 dirs full, 0 dirs failed
W20260203 09:17:50.930117 28852 consensus_peers.cc:597] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260203 09:17:50.915936 28635 catalog_manager.cc:5654] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index -1 to 4, NON_VOTER cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) added. New cstate: current_term: 5 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260203 09:17:50.943667 31046 tablet_copy_client.cc:806] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:50.944315 31046 tablet_copy_client.cc:670] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:50.948179 31046 tablet_copy_client.cc:538] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:50.969633 31046 tablet_bootstrap.cc:492] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
W20260203 09:17:50.985219 28852 consensus_peers.cc:597] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:17:51.034163 28777 consensus_peers.cc:597] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:51.038300 31046 tablet_bootstrap.cc:492] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:51.039254 31046 tablet_bootstrap.cc:492] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:51.040036 31046 ts_tablet_manager.cc:1403] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.071s user 0.022s sys 0.007s
I20260203 09:17:51.042996 31046 raft_consensus.cc:359] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:51.043859 31046 raft_consensus.cc:740] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:51.044533 31046 consensus_queue.cc:260] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:51.062387 31046 ts_tablet_manager.cc:1434] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.022s user 0.009s sys 0.000s
I20260203 09:17:51.069537 28823 tablet_copy_service.cc:342] P be3b58b70fd74625a8ae8dfd7db7f6ee: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-2fe435e0235d42ec88a9773010ea1fec received from {username='slave'} at 127.0.0.1:50256
I20260203 09:17:51.070031 28823 tablet_copy_service.cc:434] P be3b58b70fd74625a8ae8dfd7db7f6ee: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-2fe435e0235d42ec88a9773010ea1fec on tablet 2fe435e0235d42ec88a9773010ea1fec with peer cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:51.075452 28852 consensus_peers.cc:597] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260203 09:17:51.085310 28880 raft_consensus.cc:1275] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 7 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260203 09:17:51.087399 30805 consensus_queue.cc:1048] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:17:51.105729 31046 ts_tablet_manager.cc:933] T 7c8f123f58ac4b3da0beed1215102a98 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:51.125062 28852 consensus_peers.cc:597] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260203 09:17:51.130623 31046 tablet_copy_client.cc:323] T 7c8f123f58ac4b3da0beed1215102a98 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.67:42899
I20260203 09:17:51.132570 28899 tablet_copy_service.cc:140] P 77541303e1934638ba82f0f43f707adc: Received BeginTabletCopySession request for tablet 7c8f123f58ac4b3da0beed1215102a98 from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:59280)
I20260203 09:17:51.133209 28899 tablet_copy_service.cc:161] P 77541303e1934638ba82f0f43f707adc: Beginning new tablet copy session on tablet 7c8f123f58ac4b3da0beed1215102a98 from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:59280: session id = cf00f643e7da4a98a0a11ea92869c24a-7c8f123f58ac4b3da0beed1215102a98
I20260203 09:17:51.142727 28899 tablet_copy_source_session.cc:215] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:51.147424 31046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c8f123f58ac4b3da0beed1215102a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:51.165699 31046 tablet_copy_client.cc:806] T 7c8f123f58ac4b3da0beed1215102a98 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:51.166299 31046 tablet_copy_client.cc:670] T 7c8f123f58ac4b3da0beed1215102a98 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
W20260203 09:17:51.169288 29426 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111) [suppressed 383 similar messages]
I20260203 09:17:51.172298 31046 tablet_copy_client.cc:538] T 7c8f123f58ac4b3da0beed1215102a98 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:51.183871 31046 tablet_bootstrap.cc:492] T 7c8f123f58ac4b3da0beed1215102a98 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
W20260203 09:17:51.195528 28777 consensus_peers.cc:597] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:51.221869 31046 tablet_bootstrap.cc:492] T 7c8f123f58ac4b3da0beed1215102a98 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:51.222816 31046 tablet_bootstrap.cc:492] T 7c8f123f58ac4b3da0beed1215102a98 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:51.223508 31046 ts_tablet_manager.cc:1403] T 7c8f123f58ac4b3da0beed1215102a98 P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.040s user 0.027s sys 0.000s
I20260203 09:17:51.226394 31046 raft_consensus.cc:359] T 7c8f123f58ac4b3da0beed1215102a98 P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:51.227262 31046 raft_consensus.cc:740] T 7c8f123f58ac4b3da0beed1215102a98 P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:51.227916 31046 consensus_queue.cc:260] T 7c8f123f58ac4b3da0beed1215102a98 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:51.244787 31046 ts_tablet_manager.cc:1434] T 7c8f123f58ac4b3da0beed1215102a98 P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.021s user 0.007s sys 0.003s
I20260203 09:17:51.252414 28899 tablet_copy_service.cc:342] P 77541303e1934638ba82f0f43f707adc: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-7c8f123f58ac4b3da0beed1215102a98 received from {username='slave'} at 127.0.0.1:59280
I20260203 09:17:51.252914 28899 tablet_copy_service.cc:434] P 77541303e1934638ba82f0f43f707adc: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-7c8f123f58ac4b3da0beed1215102a98 on tablet 7c8f123f58ac4b3da0beed1215102a98 with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:51.258965 31046 ts_tablet_manager.cc:933] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
W20260203 09:17:51.273077 28852 consensus_peers.cc:597] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:51.281059 31046 tablet_copy_client.cc:323] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.66:41611
I20260203 09:17:51.282817 28823 tablet_copy_service.cc:140] P be3b58b70fd74625a8ae8dfd7db7f6ee: Received BeginTabletCopySession request for tablet 1dd859ca9f8b4cda8cca01872e191b47 from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:50256)
I20260203 09:17:51.283360 28823 tablet_copy_service.cc:161] P be3b58b70fd74625a8ae8dfd7db7f6ee: Beginning new tablet copy session on tablet 1dd859ca9f8b4cda8cca01872e191b47 from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:50256: session id = cf00f643e7da4a98a0a11ea92869c24a-1dd859ca9f8b4cda8cca01872e191b47
I20260203 09:17:51.292519 28823 tablet_copy_source_session.cc:215] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:51.296303 31053 ts_tablet_manager.cc:933] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a: Initiating tablet copy from peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
I20260203 09:17:51.296680 31046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dd859ca9f8b4cda8cca01872e191b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:51.299758 31053 tablet_copy_client.cc:323] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Beginning tablet copy session from remote peer at address 127.26.232.66:41611
I20260203 09:17:51.301412 28823 tablet_copy_service.cc:140] P be3b58b70fd74625a8ae8dfd7db7f6ee: Received BeginTabletCopySession request for tablet 74236b7aaa67439b807775f90674420c from peer cf00f643e7da4a98a0a11ea92869c24a ({username='slave'} at 127.0.0.1:50256)
I20260203 09:17:51.301862 28823 tablet_copy_service.cc:161] P be3b58b70fd74625a8ae8dfd7db7f6ee: Beginning new tablet copy session on tablet 74236b7aaa67439b807775f90674420c from peer cf00f643e7da4a98a0a11ea92869c24a at {username='slave'} at 127.0.0.1:50256: session id = cf00f643e7da4a98a0a11ea92869c24a-74236b7aaa67439b807775f90674420c
W20260203 09:17:51.314574 28852 consensus_peers.cc:597] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260203 09:17:51.315357 28823 tablet_copy_source_session.cc:215] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260203 09:17:51.315492 31046 tablet_copy_client.cc:806] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:51.316111 31046 tablet_copy_client.cc:670] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:51.321180 31046 tablet_copy_client.cc:538] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:51.322693 31053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74236b7aaa67439b807775f90674420c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260203 09:17:51.334836 29426 consensus_peers.cc:597] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260203 09:17:51.349735 31046 tablet_bootstrap.cc:492] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:51.364014 31053 tablet_copy_client.cc:806] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 0 data blocks...
I20260203 09:17:51.364629 31053 tablet_copy_client.cc:670] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Starting download of 1 WAL segments...
I20260203 09:17:51.368245 31053 tablet_copy_client.cc:538] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260203 09:17:51.381245 31053 tablet_bootstrap.cc:492] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap starting.
I20260203 09:17:51.397652 29456 raft_consensus.cc:1217] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4] Dedup: 4.4->[]
W20260203 09:17:51.418972 29426 consensus_peers.cc:597] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260203 09:17:51.423259 31046 tablet_bootstrap.cc:492] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:51.435516 31046 tablet_bootstrap.cc:492] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:51.437274 31046 ts_tablet_manager.cc:1403] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.088s user 0.022s sys 0.005s
W20260203 09:17:51.440778 28852 consensus_peers.cc:597] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260203 09:17:51.442008 31046 raft_consensus.cc:359] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:51.443488 31046 raft_consensus.cc:740] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:51.436322 31053 tablet_bootstrap.cc:492] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:17:51.444104 31046 consensus_queue.cc:260] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:51.445444 31053 tablet_bootstrap.cc:492] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a: Bootstrap complete.
I20260203 09:17:51.446178 31053 ts_tablet_manager.cc:1403] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a: Time spent bootstrapping tablet: real 0.065s user 0.026s sys 0.005s
I20260203 09:17:51.446424 31046 ts_tablet_manager.cc:1434] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260203 09:17:51.449209 31053 raft_consensus.cc:359] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:51.450013 31053 raft_consensus.cc:740] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: cf00f643e7da4a98a0a11ea92869c24a, State: Initialized, Role: LEARNER
I20260203 09:17:51.450611 31053 consensus_queue.cc:260] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: NON_VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: true } }
I20260203 09:17:51.451342 28823 tablet_copy_service.cc:342] P be3b58b70fd74625a8ae8dfd7db7f6ee: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-1dd859ca9f8b4cda8cca01872e191b47 received from {username='slave'} at 127.0.0.1:50256
I20260203 09:17:51.451771 28823 tablet_copy_service.cc:434] P be3b58b70fd74625a8ae8dfd7db7f6ee: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-1dd859ca9f8b4cda8cca01872e191b47 on tablet 1dd859ca9f8b4cda8cca01872e191b47 with peer cf00f643e7da4a98a0a11ea92869c24a
I20260203 09:17:51.453174 31053 ts_tablet_manager.cc:1434] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260203 09:17:51.457882 28823 tablet_copy_service.cc:342] P be3b58b70fd74625a8ae8dfd7db7f6ee: Request end of tablet copy session cf00f643e7da4a98a0a11ea92869c24a-74236b7aaa67439b807775f90674420c received from {username='slave'} at 127.0.0.1:50256
I20260203 09:17:51.458307 28823 tablet_copy_service.cc:434] P be3b58b70fd74625a8ae8dfd7db7f6ee: ending tablet copy session cf00f643e7da4a98a0a11ea92869c24a-74236b7aaa67439b807775f90674420c on tablet 74236b7aaa67439b807775f90674420c with peer cf00f643e7da4a98a0a11ea92869c24a
W20260203 09:17:51.531085 28777 consensus_peers.cc:597] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:51.626319 29456 raft_consensus.cc:1217] T 7c8f123f58ac4b3da0beed1215102a98 P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4] Dedup: 4.4->[]
W20260203 09:17:51.665180 28852 consensus_peers.cc:597] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260203 09:17:51.756942 29456 raft_consensus.cc:1217] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a [term 5 LEARNER]: Deduplicated request from leader. Original: 5.3->[5.4-5.4] Dedup: 5.4->[]
I20260203 09:17:51.767387 29456 raft_consensus.cc:1217] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a [term 5 LEARNER]: Deduplicated request from leader. Original: 5.3->[5.4-5.4] Dedup: 5.4->[]
W20260203 09:17:51.815743 29426 consensus_peers.cc:597] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:17:51.862380 28852 consensus_peers.cc:597] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260203 09:17:51.909044 31009 raft_consensus.cc:1064] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
W20260203 09:17:51.912123 27553 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 28759)
I20260203 09:17:51.911952 31009 consensus_queue.cc:237] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:51.919471 29458 raft_consensus.cc:1275] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEARNER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260203 09:17:51.920987 30805 consensus_queue.cc:1048] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:51.931221 28886 raft_consensus.cc:1275] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260203 09:17:51.934333 30805 consensus_queue.cc:1048] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260203 09:17:51.935568 28777 consensus_peers.cc:597] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:51.954578 30805 raft_consensus.cc:2955] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:51.956060 29458 raft_consensus.cc:2955] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:51.976522 28634 catalog_manager.cc:5654] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: config changed from index 4 to 5, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:51.991496 28886 raft_consensus.cc:2955] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:52.018065 31007 raft_consensus.cc:1064] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:52.020797 31007 consensus_queue.cc:237] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:52.046703 29458 raft_consensus.cc:1275] T 7c8f123f58ac4b3da0beed1215102a98 P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEARNER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260203 09:17:52.048098 28804 raft_consensus.cc:1275] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260203 09:17:52.061410 31066 consensus_queue.cc:1048] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260203 09:17:52.074028 31066 consensus_queue.cc:1048] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260203 09:17:52.083968 28852 consensus_peers.cc:597] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:52.090366 31008 raft_consensus.cc:2955] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:52.092185 28806 raft_consensus.cc:2955] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:52.108803 28635 catalog_manager.cc:5654] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index 4 to 5, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:52.117889 29458 raft_consensus.cc:2955] T 7c8f123f58ac4b3da0beed1215102a98 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:52.134635 28886 consensus_queue.cc:237] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:52.139993 29458 raft_consensus.cc:1275] T 7c8f123f58ac4b3da0beed1215102a98 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260203 09:17:52.144840 29426 consensus_peers.cc:597] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260203 09:17:52.146230 31007 consensus_queue.cc:1048] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260203 09:17:52.149686 28806 raft_consensus.cc:1275] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Refusing update from remote peer 77541303e1934638ba82f0f43f707adc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260203 09:17:52.152347 31008 consensus_queue.cc:1048] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [LEADER]: Connected to new peer: Peer: permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260203 09:17:52.161293 29458 raft_consensus.cc:2955] T 7c8f123f58ac4b3da0beed1215102a98 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:52.159684 31066 raft_consensus.cc:2955] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:52.183163 28633 catalog_manager.cc:5654] T 7c8f123f58ac4b3da0beed1215102a98 P cf00f643e7da4a98a0a11ea92869c24a reported cstate change: config changed from index 5 to 6, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New cstate: current_term: 4 leader_uuid: "77541303e1934638ba82f0f43f707adc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:52.188769 28619 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 7c8f123f58ac4b3da0beed1215102a98 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260203 09:17:52.194134 28804 raft_consensus.cc:2955] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
W20260203 09:17:52.213691 28777 consensus_peers.cc:597] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:17:52.220504 29426 consensus_peers.cc:597] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:17:52.230348 28619 catalog_manager.cc:4712] TS 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7c8f123f58ac4b3da0beed1215102a98: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:52.281158 31006 raft_consensus.cc:1064] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
I20260203 09:17:52.283540 31006 consensus_queue.cc:237] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 2, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:52.288177 30805 raft_consensus.cc:1064] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee: attempting to promote NON_VOTER cf00f643e7da4a98a0a11ea92869c24a to VOTER
W20260203 09:17:52.290572 28777 consensus_peers.cc:597] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260203 09:17:52.290514 30805 consensus_queue.cc:237] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 2, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:52.294207 29458 raft_consensus.cc:1275] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a [term 5 LEARNER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260203 09:17:52.296255 31009 consensus_queue.cc:1048] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260203 09:17:52.303186 28886 raft_consensus.cc:1275] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260203 09:17:52.307257 31006 consensus_queue.cc:1048] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260203 09:17:52.310179 28777 consensus_peers.cc:597] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:52.341548 29426 consensus_peers.cc:597] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:17:52.428421 31075 log.cc:927] Time spent T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a: Append to log took a long time: real 0.075s user 0.001s sys 0.000s
W20260203 09:17:52.445592 29426 consensus_peers.cc:597] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:17:52.446316 29426 consensus_peers.cc:597] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:17:52.486454 28851 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.68:40627, user_credentials={real_user=slave}} blocked reactor thread for 81079.7us
I20260203 09:17:52.492796 29458 raft_consensus.cc:1275] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a [term 5 LEARNER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260203 09:17:52.511137 31078 consensus_queue.cc:1048] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260203 09:17:52.515098 28886 raft_consensus.cc:1275] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260203 09:17:52.519439 31077 consensus_queue.cc:1048] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260203 09:17:52.522017 31009 raft_consensus.cc:2955] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index 4 to 5, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:52.543731 28888 raft_consensus.cc:2955] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
W20260203 09:17:52.549532 28852 consensus_peers.cc:597] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:17:52.552201 28777 consensus_peers.cc:597] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:52.577278 28777 consensus_peers.cc:597] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260203 09:17:52.616329 29460 raft_consensus.cc:2955] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:52.622611 28633 catalog_manager.cc:5654] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee reported cstate change: config changed from index 4 to 5, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260203 09:17:52.641855 29426 consensus_peers.cc:597] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260203 09:17:52.641929 31079 raft_consensus.cc:2955] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index 4 to 5, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:52.645323 28888 raft_consensus.cc:2955] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:52.674603 28813 consensus_queue.cc:237] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
W20260203 09:17:52.678418 29426 consensus_peers.cc:597] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:17:52.681495 28852 consensus_peers.cc:597] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260203 09:17:52.694084 28886 raft_consensus.cc:1275] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260203 09:17:52.699914 31079 consensus_queue.cc:1048] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260203 09:17:52.699173 29456 raft_consensus.cc:2955] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
W20260203 09:17:52.706632 28777 consensus_peers.cc:597] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260203 09:17:52.708019 31078 raft_consensus.cc:2955] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:52.717048 28888 raft_consensus.cc:2955] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:52.721612 28618 catalog_manager.cc:5167] ChangeConfig:REMOVE_PEER RPC for tablet 1dd859ca9f8b4cda8cca01872e191b47 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260203 09:17:52.725131 29426 consensus_peers.cc:597] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260203 09:17:52.738955 29458 raft_consensus.cc:1275] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Refusing update from remote peer be3b58b70fd74625a8ae8dfd7db7f6ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260203 09:17:52.742722 31009 consensus_queue.cc:1048] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260203 09:17:52.735025 28633 catalog_manager.cc:5654] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc reported cstate change: config changed from index 4 to 5, cf00f643e7da4a98a0a11ea92869c24a (127.26.232.68) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:52.782235 29456 raft_consensus.cc:2955] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
I20260203 09:17:52.810634 28635 catalog_manager.cc:5654] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc reported cstate change: config changed from index 5 to 6, VOTER 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65) evicted. New cstate: current_term: 5 leader_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } } }
W20260203 09:17:52.811622 28852 consensus_peers.cc:597] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:17:52.829620 28777 consensus_peers.cc:597] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:17:52.830767 29426 consensus_peers.cc:597] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:17:52.831634 28852 consensus_peers.cc:597] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:17:52.832811 28777 consensus_peers.cc:597] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:17:52.836056 28777 consensus_peers.cc:597] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:17:52.867705 28852 consensus_peers.cc:597] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260203 09:17:52.880697 28777 consensus_peers.cc:597] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:17:52.912771 27553 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 28759)
W20260203 09:17:53.020798 28777 consensus_peers.cc:597] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:17:53.042459 28852 consensus_peers.cc:597] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260203 09:17:53.060485 28777 consensus_peers.cc:597] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:17:53.071796 28852 consensus_peers.cc:597] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:17:53.078373 28852 consensus_peers.cc:597] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:17:53.085296 28852 consensus_peers.cc:597] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:17:53.124023 28777 consensus_peers.cc:597] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:17:53.312713 28852 consensus_peers.cc:597] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260203 09:17:53.380808 29426 consensus_peers.cc:597] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:17:53.430470 28852 consensus_peers.cc:597] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260203 09:17:53.446444 28852 consensus_peers.cc:597] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:17:53.484570 28777 consensus_peers.cc:597] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:17:53.485204 28852 consensus_peers.cc:597] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260203 09:17:53.510660 28619 catalog_manager.cc:4712] TS 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 1dd859ca9f8b4cda8cca01872e191b47: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
W20260203 09:17:53.707576 28852 consensus_peers.cc:597] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260203 09:17:53.715873 28852 consensus_peers.cc:597] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:17:53.746753 29426 consensus_peers.cc:597] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260203 09:17:53.807710 28777 consensus_peers.cc:597] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:17:53.856410 28852 consensus_peers.cc:597] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260203 09:17:53.907270 28852 consensus_peers.cc:597] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260203 09:17:53.913322 27553 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 28759)
W20260203 09:17:54.036410 28777 consensus_peers.cc:597] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:17:54.107136 28852 consensus_peers.cc:597] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260203 09:17:54.123898 27553 tablet_server.cc:195] TabletServer@127.26.232.65:0 shutdown complete.
I20260203 09:17:54.279472 27553 tablet_server.cc:178] TabletServer@127.26.232.66:0 shutting down...
W20260203 09:17:54.286285 28683 auto_rebalancer.cc:726] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:54.286696 28683 auto_rebalancer.cc:266] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:54.291143 28683 auto_rebalancer.cc:726] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:54.291519 28683 auto_rebalancer.cc:266] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:54.293599 28851 consensus_peers.cc:597] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:54.297628 28851 consensus_peers.cc:597] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:54.298153 29425 consensus_peers.cc:597] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:54.308387 28851 consensus_peers.cc:597] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:54.345263 28851 consensus_peers.cc:597] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:54.346596 29425 consensus_peers.cc:597] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:54.348242 27553 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260203 09:17:54.349287 27553 tablet_replica.cc:333] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.350419 27553 raft_consensus.cc:2243] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 LEADER]: Raft consensus shutting down.
I20260203 09:17:54.351336 27553 raft_consensus.cc:2272] T 31afe6e1e9d24b89b4ac6d2e837fca22 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.362455 27553 tablet_replica.cc:333] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.363399 27553 raft_consensus.cc:2243] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.364339 27553 raft_consensus.cc:2272] T fba8b1b8685b431e8328cdb7df4ad1d0 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:54.366004 29426 consensus_peers.cc:597] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260203 09:17:54.367539 27553 tablet_replica.cc:333] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.369714 27553 raft_consensus.cc:2243] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 LEADER]: Raft consensus shutting down.
W20260203 09:17:54.369925 28851 consensus_peers.cc:597] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:54.370702 27553 raft_consensus.cc:2272] T 1dd859ca9f8b4cda8cca01872e191b47 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:54.372679 28851 consensus_peers.cc:597] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:54.374033 29425 consensus_peers.cc:597] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:54.376269 27553 tablet_replica.cc:333] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.377225 27553 raft_consensus.cc:2243] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.377763 27553 raft_consensus.cc:2272] T 0322ad4122a64f6abccdfb1906919b8e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.380010 27553 tablet_replica.cc:333] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.380601 27553 raft_consensus.cc:2243] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:17:54.381425 27553 raft_consensus.cc:2272] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.383324 27553 tablet_replica.cc:333] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.383862 27553 raft_consensus.cc:2243] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.384328 27553 raft_consensus.cc:2272] T 428e0a1fef8d467da4a30ece11cc6e5c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.386188 27553 tablet_replica.cc:333] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.386888 27553 raft_consensus.cc:2243] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 7 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.387428 27553 raft_consensus.cc:2272] T 6b21247fc3af467fa74a89f61d43143f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 7 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.389942 27553 tablet_replica.cc:333] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.390448 27553 raft_consensus.cc:2243] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.390887 27553 raft_consensus.cc:2272] T f40d17692ce0424589f3962011b49824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.392551 27553 tablet_replica.cc:333] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.393244 27553 raft_consensus.cc:2243] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.393746 27553 raft_consensus.cc:2272] T b6c0f69b8ce94c9b9b4e64882eb25a2c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.396044 27553 tablet_replica.cc:333] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.396703 27553 raft_consensus.cc:2243] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.397235 27553 raft_consensus.cc:2272] T b5ccabd714ab40bab140c7a90667ddd6 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.399370 27553 tablet_replica.cc:333] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.399899 27553 raft_consensus.cc:2243] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.400321 27553 raft_consensus.cc:2272] T 8b2c469d7255413d9f61a7cbaa4481a7 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.402091 27553 tablet_replica.cc:333] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.402595 27553 raft_consensus.cc:2243] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.403282 27553 raft_consensus.cc:2272] T 15917cb595b149fd847e4ab4424f8262 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.405537 27553 tablet_replica.cc:333] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.406060 27553 raft_consensus.cc:2243] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 LEADER]: Raft consensus shutting down.
I20260203 09:17:54.407052 27553 raft_consensus.cc:2272] T d146929ef3874ea3a955fd4c49d19d4c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.409389 27553 tablet_replica.cc:333] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.410120 27553 raft_consensus.cc:2243] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.410601 27553 raft_consensus.cc:2272] T 649a6d7dbffd49cf9969715dea1c841d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.412354 27553 tablet_replica.cc:333] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.412945 27553 raft_consensus.cc:2243] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 7 LEADER]: Raft consensus shutting down.
I20260203 09:17:54.413794 27553 raft_consensus.cc:2272] T 298c016813da45bdbc537b5851b5e728 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 7 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.415648 27553 tablet_replica.cc:333] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.416288 27553 raft_consensus.cc:2243] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.416883 27553 raft_consensus.cc:2272] T 06f7408dc6eb4aea9a8acfbe1c0b482c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.419428 27553 tablet_replica.cc:333] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.420004 27553 raft_consensus.cc:2243] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.420449 27553 raft_consensus.cc:2272] T bf838e5b1f6141bfb1cd1bc26a8b0006 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.422258 27553 tablet_replica.cc:333] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.422801 27553 raft_consensus.cc:2243] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.423220 27553 raft_consensus.cc:2272] T a720779d5e3444dc8825e118d9880b72 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.425014 27553 tablet_replica.cc:333] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.425534 27553 raft_consensus.cc:2243] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.425935 27553 raft_consensus.cc:2272] T 438ed0267e3148da951c6dc25761c745 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.427691 27553 tablet_replica.cc:333] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.428198 27553 raft_consensus.cc:2243] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.428891 27553 raft_consensus.cc:2272] T 7c8f123f58ac4b3da0beed1215102a98 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.430639 27553 tablet_replica.cc:333] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.431191 27553 raft_consensus.cc:2243] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 LEADER]: Raft consensus shutting down.
I20260203 09:17:54.432458 27553 raft_consensus.cc:2272] T 74236b7aaa67439b807775f90674420c P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.435418 27553 tablet_replica.cc:333] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.436115 27553 raft_consensus.cc:2243] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.436782 27553 raft_consensus.cc:2272] T 1862780e910a42d5a3414a9329cd9259 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.439196 27553 tablet_replica.cc:333] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.439867 27553 raft_consensus.cc:2243] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.440517 27553 raft_consensus.cc:2272] T 6645a0476f6e40bda131d06fa0f15f7b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:54.442886 28851 consensus_peers.cc:597] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:54.443140 27553 tablet_replica.cc:333] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.443759 27553 raft_consensus.cc:2243] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 LEADER]: Raft consensus shutting down.
I20260203 09:17:54.444538 27553 raft_consensus.cc:2272] T a924eec8e84d4192bc0e30ae0829e54b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.446494 27553 tablet_replica.cc:333] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.447254 27553 raft_consensus.cc:2243] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.447811 27553 raft_consensus.cc:2272] T b149dd40ec15465299cdb910e5385206 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.450429 27553 tablet_replica.cc:333] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.451156 27553 raft_consensus.cc:2243] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Raft consensus shutting down.
W20260203 09:17:54.451229 29425 consensus_peers.cc:597] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:54.451726 27553 raft_consensus.cc:2272] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 1 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:54.453632 28851 consensus_peers.cc:597] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:54.454182 27553 tablet_replica.cc:333] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.454864 27553 raft_consensus.cc:2243] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.455394 27553 raft_consensus.cc:2272] T 2339220aa4ac4160839f61543c6c60d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:54.455783 28851 consensus_peers.cc:597] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:54.457578 27553 tablet_replica.cc:333] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.458280 27553 raft_consensus.cc:2243] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.458842 27553 raft_consensus.cc:2272] T 6063a063fced4ff38761f892acbdfa76 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.460698 27553 tablet_replica.cc:333] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.461236 27553 raft_consensus.cc:2243] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.461855 27553 raft_consensus.cc:2272] T 2f652d76b6054b738b66531829291e55 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.463714 27553 tablet_replica.cc:333] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.464223 27553 raft_consensus.cc:2243] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 LEADER]: Raft consensus shutting down.
I20260203 09:17:54.465026 27553 raft_consensus.cc:2272] T e18f9202613d46f68396231b64ee4ada P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.466764 27553 tablet_replica.cc:333] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.467279 27553 raft_consensus.cc:2243] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.467684 27553 raft_consensus.cc:2272] T a10f51ea1a844376bb4dce51f655be6b P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.469521 27553 tablet_replica.cc:333] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.470050 27553 raft_consensus.cc:2243] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:17:54.471109 27553 raft_consensus.cc:2272] T 2fe435e0235d42ec88a9773010ea1fec P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.472929 27553 tablet_replica.cc:333] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.473531 27553 raft_consensus.cc:2243] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:17:54.474460 27553 raft_consensus.cc:2272] T a0b96e8815b1443c99aaa50410b2c6d1 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.477031 27553 tablet_replica.cc:333] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
W20260203 09:17:54.477294 29425 consensus_peers.cc:597] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:54.477862 27553 raft_consensus.cc:2243] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:17:54.478928 27553 raft_consensus.cc:2272] T 47301e2bbfc94767a9905b0e12141d6d P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.481563 27553 tablet_replica.cc:333] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.482108 27553 raft_consensus.cc:2243] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:17:54.483214 27553 raft_consensus.cc:2272] T 113a394f120048c58168ad22915e0187 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.485947 27553 tablet_replica.cc:333] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.486599 27553 raft_consensus.cc:2243] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.487124 27553 raft_consensus.cc:2272] T 021e904a783c4cbc96e5aa625a34a2d8 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.489666 27553 tablet_replica.cc:333] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.490393 27553 raft_consensus.cc:2243] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 LEADER]: Raft consensus shutting down.
W20260203 09:17:54.490988 29425 consensus_peers.cc:597] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:54.491335 27553 raft_consensus.cc:2272] T 574d0205e57547c6938037563109a6d2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.493834 27553 tablet_replica.cc:333] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.494566 27553 raft_consensus.cc:2243] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Raft consensus shutting down.
W20260203 09:17:54.494619 29425 consensus_peers.cc:597] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:54.495111 27553 raft_consensus.cc:2272] T bd8e39da0721419098d343e576a8c0a2 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.497107 27553 tablet_replica.cc:333] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.497613 27553 raft_consensus.cc:2243] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:17:54.498521 27553 raft_consensus.cc:2272] T c4b4d20256154aa1a7644698755531fd P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.500963 27553 tablet_replica.cc:333] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.501492 27553 raft_consensus.cc:2243] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.501938 27553 raft_consensus.cc:2272] T 0ce53cd3bb1847daa8cecd00aacff824 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.503723 27553 tablet_replica.cc:333] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.504216 27553 raft_consensus.cc:2243] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 LEADER]: Raft consensus shutting down.
I20260203 09:17:54.505056 27553 raft_consensus.cc:2272] T 6b71c6a3f2db4b738de03d5e4190cf27 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.507400 27553 tablet_replica.cc:333] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
W20260203 09:17:54.507882 29425 consensus_peers.cc:597] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:54.508013 27553 raft_consensus.cc:2243] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 7 LEADER]: Raft consensus shutting down.
I20260203 09:17:54.508893 27553 raft_consensus.cc:2272] T f4da79410aa74f5abca9517bbae98420 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 7 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.510656 27553 tablet_replica.cc:333] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.511214 27553 raft_consensus.cc:2243] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:17:54.512231 27553 raft_consensus.cc:2272] T 6bf3d38eba3b4894b7f18f2d5733f63e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.514485 27553 tablet_replica.cc:333] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.514963 27553 raft_consensus.cc:2243] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:17:54.515772 27553 raft_consensus.cc:2272] T fd89e8aac3604bd48c5553ce7e5aa905 P be3b58b70fd74625a8ae8dfd7db7f6ee [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.517666 27553 tablet_replica.cc:333] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.518157 27553 raft_consensus.cc:2243] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:17:54.518920 27553 raft_consensus.cc:2272] T eac7b86aa8d340e3a4d61a5c982b1f2e P be3b58b70fd74625a8ae8dfd7db7f6ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.520797 27553 tablet_replica.cc:333] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.521273 27553 raft_consensus.cc:2243] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.521685 27553 raft_consensus.cc:2272] T 7e336e3590fc428e88c5353c9e96a36f P be3b58b70fd74625a8ae8dfd7db7f6ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.523382 27553 tablet_replica.cc:333] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.523876 27553 raft_consensus.cc:2243] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 LEADER]: Raft consensus shutting down.
I20260203 09:17:54.524709 27553 raft_consensus.cc:2272] T bcfe4116093a4fe49ba4dfa67b48cedf P be3b58b70fd74625a8ae8dfd7db7f6ee [term 6 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:54.526362 27553 tablet_replica.cc:333] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee: stopping tablet replica
I20260203 09:17:54.526777 27553 raft_consensus.cc:2243] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:54.527194 27553 raft_consensus.cc:2272] T 4630d6f6a17e4819a2daf0560e4013ad P be3b58b70fd74625a8ae8dfd7db7f6ee [term 5 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:54.543885 29425 consensus_peers.cc:597] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:54.552557 28851 consensus_peers.cc:597] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:54.567504 28852 consensus_peers.cc:597] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260203 09:17:54.571472 28851 consensus_peers.cc:597] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:54.571915 29425 consensus_peers.cc:597] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:54.625854 29426 consensus_peers.cc:597] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260203 09:17:54.637364 28851 consensus_peers.cc:597] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.66:41611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:54.650236 28851 consensus_peers.cc:597] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.66:41611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:54.651846 28619 catalog_manager.cc:4712] TS 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7c8f123f58ac4b3da0beed1215102a98: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
W20260203 09:17:54.654352 28852 consensus_peers.cc:597] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260203 09:17:54.686607 28851 consensus_peers.cc:597] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.66:41611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:54.737708 28851 consensus_peers.cc:597] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.66:41611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:54.767103 28851 consensus_peers.cc:597] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.66:41611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:54.769073 28851 consensus_peers.cc:597] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.66:41611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:54.797442 28851 consensus_peers.cc:597] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc -> Peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Couldn't send request to peer be3b58b70fd74625a8ae8dfd7db7f6ee. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.66:41611: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:54.805316 29426 consensus_peers.cc:597] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260203 09:17:54.838047 29426 consensus_peers.cc:597] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260203 09:17:54.868263 29426 consensus_peers.cc:597] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260203 09:17:54.929364 29426 consensus_peers.cc:597] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260203 09:17:54.945740 27553 tablet_server.cc:195] TabletServer@127.26.232.66:0 shutdown complete.
W20260203 09:17:54.951231 29426 consensus_peers.cc:597] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260203 09:17:55.048883 27553 tablet_server.cc:178] TabletServer@127.26.232.67:0 shutting down...
W20260203 09:17:55.088076 28852 consensus_peers.cc:597] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260203 09:17:55.099594 29426 consensus_peers.cc:597] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Couldn't send request to peer 77541303e1934638ba82f0f43f707adc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:55.127326 27553 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260203 09:17:55.128460 27553 tablet_replica.cc:333] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.129449 27553 raft_consensus.cc:2243] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.130321 27553 raft_consensus.cc:2272] T 31afe6e1e9d24b89b4ac6d2e837fca22 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.132988 27553 tablet_replica.cc:333] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.133908 27553 raft_consensus.cc:2243] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.134982 27553 raft_consensus.cc:2272] T 1dd859ca9f8b4cda8cca01872e191b47 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.137322 27553 tablet_replica.cc:333] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.137969 27553 raft_consensus.cc:2243] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.138458 27553 raft_consensus.cc:2272] T fd89e8aac3604bd48c5553ce7e5aa905 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.141111 27553 tablet_replica.cc:333] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.141886 27553 raft_consensus.cc:2243] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 6 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.143366 27553 raft_consensus.cc:2272] T 15917cb595b149fd847e4ab4424f8262 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.146090 27553 tablet_replica.cc:333] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.147078 27553 raft_consensus.cc:2243] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.147796 27553 raft_consensus.cc:2272] T d146929ef3874ea3a955fd4c49d19d4c P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.150914 27553 tablet_replica.cc:333] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.151777 27553 raft_consensus.cc:2243] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 6 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.152978 27553 raft_consensus.cc:2272] T 09f2301096ce4f4689e1e7f24f013e52 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:55.155102 29426 consensus_peers.cc:597] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a -> Peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Couldn't send request to peer 77541303e1934638ba82f0f43f707adc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:55.155510 27553 tablet_replica.cc:333] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.156217 27553 raft_consensus.cc:2243] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.156715 27553 raft_consensus.cc:2272] T 0322ad4122a64f6abccdfb1906919b8e P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.158555 27553 tablet_replica.cc:333] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.159134 27553 raft_consensus.cc:2243] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.159530 27553 raft_consensus.cc:2272] T 428e0a1fef8d467da4a30ece11cc6e5c P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.161646 27553 tablet_replica.cc:333] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.162289 27553 raft_consensus.cc:2243] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.162906 27553 raft_consensus.cc:2272] T c49cb7ba1af14dfcbe637cf12fbe669c P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.165469 27553 tablet_replica.cc:333] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.166281 27553 raft_consensus.cc:2243] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 7 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.167383 27553 raft_consensus.cc:2272] T 6b21247fc3af467fa74a89f61d43143f P 77541303e1934638ba82f0f43f707adc [term 7 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:55.168761 28852 consensus_peers.cc:597] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260203 09:17:55.170029 27553 tablet_replica.cc:333] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.170742 27553 raft_consensus.cc:2243] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 6 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.171808 27553 raft_consensus.cc:2272] T f40d17692ce0424589f3962011b49824 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.175194 27553 tablet_replica.cc:333] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.176342 27553 raft_consensus.cc:2243] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.177024 27553 raft_consensus.cc:2272] T b5ccabd714ab40bab140c7a90667ddd6 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.179844 27553 tablet_replica.cc:333] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.180713 27553 raft_consensus.cc:2243] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.181845 27553 raft_consensus.cc:2272] T 8b2c469d7255413d9f61a7cbaa4481a7 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.184177 27553 tablet_replica.cc:333] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.184813 27553 raft_consensus.cc:2243] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.185560 27553 raft_consensus.cc:2272] T 649a6d7dbffd49cf9969715dea1c841d P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.187743 27553 tablet_replica.cc:333] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.188505 27553 raft_consensus.cc:2243] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 7 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.189136 27553 raft_consensus.cc:2272] T 298c016813da45bdbc537b5851b5e728 P 77541303e1934638ba82f0f43f707adc [term 7 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.191797 27553 tablet_replica.cc:333] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.192613 27553 raft_consensus.cc:2243] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.193763 27553 raft_consensus.cc:2272] T 06f7408dc6eb4aea9a8acfbe1c0b482c P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.196890 27553 tablet_replica.cc:333] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.197551 27553 raft_consensus.cc:2243] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.198506 27553 raft_consensus.cc:2272] T 7c8f123f58ac4b3da0beed1215102a98 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.200953 27553 tablet_replica.cc:333] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.201575 27553 raft_consensus.cc:2243] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.202458 27553 raft_consensus.cc:2272] T 74236b7aaa67439b807775f90674420c P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.204627 27553 tablet_replica.cc:333] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.205222 27553 raft_consensus.cc:2243] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.205715 27553 raft_consensus.cc:2272] T fabfb779b8894cf0b22204fe12768dc3 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.207661 27553 tablet_replica.cc:333] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.208158 27553 raft_consensus.cc:2243] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.208696 27553 raft_consensus.cc:2272] T 438ed0267e3148da951c6dc25761c745 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.210901 27553 tablet_replica.cc:333] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.211604 27553 raft_consensus.cc:2243] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.212152 27553 raft_consensus.cc:2272] T 0d2d0debbeba46b086bb9d7344d2181b P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.214154 27553 tablet_replica.cc:333] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.214689 27553 raft_consensus.cc:2243] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.215375 27553 raft_consensus.cc:2272] T bd8e39da0721419098d343e576a8c0a2 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.217509 27553 tablet_replica.cc:333] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.218048 27553 raft_consensus.cc:2243] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 5 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.218837 27553 raft_consensus.cc:2272] T bf838e5b1f6141bfb1cd1bc26a8b0006 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.220788 27553 tablet_replica.cc:333] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.221457 27553 raft_consensus.cc:2243] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.222749 27553 raft_consensus.cc:2272] T a720779d5e3444dc8825e118d9880b72 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.225771 27553 tablet_replica.cc:333] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.227690 27553 raft_consensus.cc:2243] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.228832 27553 raft_consensus.cc:2272] T 3b6f1d6e275f4a8ba99a70dbb3ea3235 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.231734 27553 tablet_replica.cc:333] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
W20260203 09:17:55.232182 29426 consensus_peers.cc:597] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Couldn't send request to peer 77541303e1934638ba82f0f43f707adc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:55.232460 27553 raft_consensus.cc:2243] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.233333 27553 raft_consensus.cc:2272] T 2339220aa4ac4160839f61543c6c60d2 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.235395 27553 tablet_replica.cc:333] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.236114 27553 raft_consensus.cc:2243] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.237833 27553 raft_consensus.cc:2272] T 1862780e910a42d5a3414a9329cd9259 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.240455 27553 tablet_replica.cc:333] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.241384 27553 raft_consensus.cc:2243] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.242496 27553 raft_consensus.cc:2272] T 6645a0476f6e40bda131d06fa0f15f7b P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:55.242964 29426 consensus_peers.cc:597] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Couldn't send request to peer 77541303e1934638ba82f0f43f707adc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:55.245406 27553 tablet_replica.cc:333] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.246238 27553 raft_consensus.cc:2243] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.247169 27553 raft_consensus.cc:2272] T 7e1bac12c6ee43d6901400e02b35d82f P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:55.248220 29426 consensus_peers.cc:597] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260203 09:17:55.249393 27553 tablet_replica.cc:333] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.249980 27553 raft_consensus.cc:2243] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.250427 27553 raft_consensus.cc:2272] T a924eec8e84d4192bc0e30ae0829e54b P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.252594 27553 tablet_replica.cc:333] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.253736 27553 raft_consensus.cc:2243] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.254438 27553 raft_consensus.cc:2272] T e18f9202613d46f68396231b64ee4ada P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.257316 27553 tablet_replica.cc:333] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.258074 27553 raft_consensus.cc:2243] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.258659 27553 raft_consensus.cc:2272] T a10f51ea1a844376bb4dce51f655be6b P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:55.259166 29426 consensus_peers.cc:597] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a -> Peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Couldn't send request to peer 77541303e1934638ba82f0f43f707adc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:55.260613 27553 tablet_replica.cc:333] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.261279 27553 raft_consensus.cc:2243] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.261713 27553 raft_consensus.cc:2272] T 47301e2bbfc94767a9905b0e12141d6d P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.263665 27553 tablet_replica.cc:333] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.264199 27553 raft_consensus.cc:2243] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.265064 27553 raft_consensus.cc:2272] T b149dd40ec15465299cdb910e5385206 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.267076 27553 tablet_replica.cc:333] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.267619 27553 raft_consensus.cc:2243] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.268086 27553 raft_consensus.cc:2272] T 4915f49d9ce24ab29a5c09e91dafd667 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.269974 27553 tablet_replica.cc:333] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.270514 27553 raft_consensus.cc:2243] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.270929 27553 raft_consensus.cc:2272] T 0fbefdb5cdae4df9ab3c78a3b6b42ae2 P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.272989 27553 tablet_replica.cc:333] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.273659 27553 raft_consensus.cc:2243] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.274518 27553 raft_consensus.cc:2272] T 3a09fae92b37497d8efa250f727c0fd9 P 77541303e1934638ba82f0f43f707adc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.276569 27553 tablet_replica.cc:333] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.277130 27553 raft_consensus.cc:2243] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.277900 27553 raft_consensus.cc:2272] T 797be23efb5c447da7f2d0ba9af2e84d P 77541303e1934638ba82f0f43f707adc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.280225 27553 tablet_replica.cc:333] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.280910 27553 raft_consensus.cc:2243] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 6 LEADER]: Raft consensus shutting down.
W20260203 09:17:55.281708 29426 consensus_peers.cc:597] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a -> Peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Couldn't send request to peer 77541303e1934638ba82f0f43f707adc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:55.281816 27553 raft_consensus.cc:2272] T 3f2a68daf4384c47ba2a6a46ac297f00 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.283958 27553 tablet_replica.cc:333] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.284507 27553 raft_consensus.cc:2243] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.285355 27553 raft_consensus.cc:2272] T 0ce53cd3bb1847daa8cecd00aacff824 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.287645 27553 tablet_replica.cc:333] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.288417 27553 raft_consensus.cc:2243] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.289091 27553 raft_consensus.cc:2272] T 6b71c6a3f2db4b738de03d5e4190cf27 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.291565 27553 tablet_replica.cc:333] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.292289 27553 raft_consensus.cc:2243] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.293093 27553 raft_consensus.cc:2272] T 9fcb41fb74694d87acc7c8963bdf4bcf P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:55.295446 29426 consensus_peers.cc:597] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Couldn't send request to peer 77541303e1934638ba82f0f43f707adc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:55.295746 27553 tablet_replica.cc:333] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.296396 27553 raft_consensus.cc:2243] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.296908 27553 raft_consensus.cc:2272] T 574d0205e57547c6938037563109a6d2 P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:55.296918 29426 consensus_peers.cc:597] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a -> Peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Couldn't send request to peer 77541303e1934638ba82f0f43f707adc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:55.299834 27553 tablet_replica.cc:333] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.300426 27553 raft_consensus.cc:2243] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.301074 27553 raft_consensus.cc:2272] T 113a394f120048c58168ad22915e0187 P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.303395 27553 tablet_replica.cc:333] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.304131 27553 raft_consensus.cc:2243] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.305198 27553 raft_consensus.cc:2272] T 021e904a783c4cbc96e5aa625a34a2d8 P 77541303e1934638ba82f0f43f707adc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:55.305586 29426 consensus_peers.cc:597] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a -> Peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Couldn't send request to peer 77541303e1934638ba82f0f43f707adc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:55.307837 27553 tablet_replica.cc:333] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.308626 27553 raft_consensus.cc:2243] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.309211 27553 raft_consensus.cc:2272] T c4b4d20256154aa1a7644698755531fd P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.311915 27553 tablet_replica.cc:333] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.312610 27553 raft_consensus.cc:2243] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.313380 27553 raft_consensus.cc:2272] T 2fe435e0235d42ec88a9773010ea1fec P 77541303e1934638ba82f0f43f707adc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.316001 27553 tablet_replica.cc:333] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.316726 27553 raft_consensus.cc:2243] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.317309 27553 raft_consensus.cc:2272] T bcfe4116093a4fe49ba4dfa67b48cedf P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.319753 27553 tablet_replica.cc:333] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.320420 27553 raft_consensus.cc:2243] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 5 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.321514 27553 raft_consensus.cc:2272] T 4630d6f6a17e4819a2daf0560e4013ad P 77541303e1934638ba82f0f43f707adc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.324291 27553 tablet_replica.cc:333] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc: stopping tablet replica
I20260203 09:17:55.324966 27553 raft_consensus.cc:2243] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.325512 27553 raft_consensus.cc:2272] T c13ab397c8524e6ca30e36e5fca2ff35 P 77541303e1934638ba82f0f43f707adc [term 6 FOLLOWER]: Raft consensus is shut down!
W20260203 09:17:55.377702 28683 auto_rebalancer.cc:256] failed to send replica move request: Network error: Client connection negotiation failed: client connection to 127.26.232.66:41611: connect: Connection refused (error 111)
I20260203 09:17:55.377918 31093 raft_consensus.cc:493] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:55.378499 31093 raft_consensus.cc:515] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:55.380609 31093 leader_election.cc:290] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:55.388159 28683 auto_rebalancer.cc:726] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.26.232.66:41611: connect: Connection refused (error 111)
W20260203 09:17:55.389912 28683 auto_rebalancer.cc:266] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.26.232.66:41611: connect: Connection refused (error 111)
W20260203 09:17:55.395288 29425 leader_election.cc:336] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Network error: Client connection negotiation failed: client connection to 127.26.232.66:41611: connect: Connection refused (error 111)
W20260203 09:17:55.398231 28683 auto_rebalancer.cc:726] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.26.232.66:41611: connect: Connection refused (error 111)
W20260203 09:17:55.398604 28683 auto_rebalancer.cc:266] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.26.232.66:41611: connect: Connection refused (error 111)
W20260203 09:17:55.400810 29426 leader_election.cc:336] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:17:55.401328 29426 leader_election.cc:304] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:55.402846 31082 raft_consensus.cc:2749] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260203 09:17:55.403867 29426 consensus_peers.cc:597] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260203 09:17:55.405823 28683 auto_rebalancer.cc:726] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.26.232.66:41611: connect: Connection refused (error 111)
W20260203 09:17:55.406219 28683 auto_rebalancer.cc:266] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.26.232.66:41611: connect: Connection refused (error 111)
W20260203 09:17:55.410851 28683 auto_rebalancer.cc:726] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:55.411258 28683 auto_rebalancer.cc:266] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:17:55.432377 29426 consensus_peers.cc:597] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260203 09:17:55.442759 29426 consensus_peers.cc:597] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a -> Peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Couldn't send request to peer 77541303e1934638ba82f0f43f707adc. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.67:42899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:55.512584 31082 raft_consensus.cc:493] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:55.513161 31082 raft_consensus.cc:515] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:55.516171 31082 leader_election.cc:290] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:55.522228 29425 leader_election.cc:336] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Network error: Client connection negotiation failed: client connection to 127.26.232.66:41611: connect: Connection refused (error 111)
W20260203 09:17:55.522712 29426 leader_election.cc:336] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Network error: Client connection negotiation failed: client connection to 127.26.232.67:42899: connect: Connection refused (error 111)
I20260203 09:17:55.523192 29426 leader_election.cc:304] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:55.524000 31082 raft_consensus.cc:2749] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260203 09:17:55.530175 31082 raft_consensus.cc:493] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:55.530694 31082 raft_consensus.cc:515] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:55.533191 31082 leader_election.cc:290] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:55.539055 29425 leader_election.cc:336] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Network error: Client connection negotiation failed: client connection to 127.26.232.66:41611: connect: Connection refused (error 111)
W20260203 09:17:55.539947 29426 leader_election.cc:336] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:55.540263 29426 leader_election.cc:304] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:55.540843 31082 raft_consensus.cc:2749] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260203 09:17:55.540978 29426 leader_election.cc:336] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Network error: Client connection negotiation failed: client connection to 127.26.232.67:42899: connect: Connection refused (error 111)
W20260203 09:17:55.575543 29426 consensus_peers.cc:597] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a -> Peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Couldn't send request to peer 77541303e1934638ba82f0f43f707adc. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.67:42899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:17:55.589383 29426 consensus_peers.cc:597] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a -> Peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Couldn't send request to peer 77541303e1934638ba82f0f43f707adc. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.67:42899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:17:55.616457 31090 raft_consensus.cc:493] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:55.617116 31090 raft_consensus.cc:515] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:55.619171 31090 leader_election.cc:290] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
W20260203 09:17:55.623219 29426 leader_election.cc:336] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
W20260203 09:17:55.624693 29425 leader_election.cc:336] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Network error: Client connection negotiation failed: client connection to 127.26.232.66:41611: connect: Connection refused (error 111)
I20260203 09:17:55.625146 29425 leader_election.cc:304] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:55.625931 31090 raft_consensus.cc:2749] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:55.644093 31093 raft_consensus.cc:493] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:55.644723 31093 raft_consensus.cc:515] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } attrs { replace: true } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:55.647341 31093 leader_election.cc:290] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:55.661481 29425 leader_election.cc:336] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Network error: Client connection negotiation failed: client connection to 127.26.232.66:41611: connect: Connection refused (error 111)
W20260203 09:17:55.663292 29426 leader_election.cc:336] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:55.664006 29426 leader_election.cc:304] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:55.665241 31093 raft_consensus.cc:2749] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260203 09:17:55.670004 29426 leader_election.cc:336] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Network error: Client connection negotiation failed: client connection to 127.26.232.67:42899: connect: Connection refused (error 111)
I20260203 09:17:55.685954 31093 raft_consensus.cc:493] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:55.686509 31093 raft_consensus.cc:515] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:55.688436 31093 leader_election.cc:290] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:55.692938 29426 leader_election.cc:336] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Network error: Client connection negotiation failed: client connection to 127.26.232.67:42899: connect: Connection refused (error 111)
W20260203 09:17:55.693558 29425 leader_election.cc:336] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Network error: Client connection negotiation failed: client connection to 127.26.232.66:41611: connect: Connection refused (error 111)
I20260203 09:17:55.693969 29425 leader_election.cc:304] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:55.694645 31093 raft_consensus.cc:2749] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260203 09:17:55.756366 31090 raft_consensus.cc:493] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:55.756914 31090 raft_consensus.cc:515] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:55.758889 31090 leader_election.cc:290] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
W20260203 09:17:55.768074 29425 leader_election.cc:336] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Network error: Client connection negotiation failed: client connection to 127.26.232.66:41611: connect: Connection refused (error 111)
W20260203 09:17:55.770735 29426 leader_election.cc:336] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:55.771267 29426 leader_election.cc:304] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:55.772032 31093 raft_consensus.cc:2749] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:17:55.782799 27553 tablet_server.cc:195] TabletServer@127.26.232.67:0 shutdown complete.
I20260203 09:17:55.801317 31093 raft_consensus.cc:493] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:55.802059 31093 raft_consensus.cc:515] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "77541303e1934638ba82f0f43f707adc" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42899 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:55.804319 31093 leader_election.cc:290] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611), 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899)
W20260203 09:17:55.810952 29425 leader_election.cc:336] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Network error: Client connection negotiation failed: client connection to 127.26.232.66:41611: connect: Connection refused (error 111)
W20260203 09:17:55.812335 29426 leader_election.cc:336] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 77541303e1934638ba82f0f43f707adc (127.26.232.67:42899): Network error: Client connection negotiation failed: client connection to 127.26.232.67:42899: connect: Connection refused (error 111)
I20260203 09:17:55.812808 29426 leader_election.cc:304] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 77541303e1934638ba82f0f43f707adc, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:55.813603 31093 raft_consensus.cc:2749] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260203 09:17:55.838702 31093 raft_consensus.cc:493] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:55.839430 31093 raft_consensus.cc:515] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:55.841856 31093 leader_election.cc:290] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
W20260203 09:17:55.847188 29425 leader_election.cc:336] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Network error: Client connection negotiation failed: client connection to 127.26.232.66:41611: connect: Connection refused (error 111)
W20260203 09:17:55.847971 29426 leader_election.cc:336] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:55.848532 29426 leader_election.cc:304] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:55.849339 31093 raft_consensus.cc:2749] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260203 09:17:55.896366 31093 raft_consensus.cc:493] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader be3b58b70fd74625a8ae8dfd7db7f6ee)
I20260203 09:17:55.897424 27553 tablet_server.cc:178] TabletServer@127.26.232.68:0 shutting down...
I20260203 09:17:55.897240 31093 raft_consensus.cc:515] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "847a7af9f0e2497cbb9025cc2c62557e" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 37967 } } peers { permanent_uuid: "be3b58b70fd74625a8ae8dfd7db7f6ee" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 41611 } } peers { permanent_uuid: "cf00f643e7da4a98a0a11ea92869c24a" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 40627 } attrs { promote: false } }
I20260203 09:17:55.899415 31093 leader_election.cc:290] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967), be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611)
W20260203 09:17:55.904515 29426 leader_election.cc:336] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
W20260203 09:17:55.906448 29425 leader_election.cc:336] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer be3b58b70fd74625a8ae8dfd7db7f6ee (127.26.232.66:41611): Network error: Client connection negotiation failed: client connection to 127.26.232.66:41611: connect: Connection refused (error 111)
I20260203 09:17:55.906843 29425 leader_election.cc:304] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf00f643e7da4a98a0a11ea92869c24a; no voters: 847a7af9f0e2497cbb9025cc2c62557e, be3b58b70fd74625a8ae8dfd7db7f6ee
I20260203 09:17:55.907406 31093 raft_consensus.cc:2749] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260203 09:17:55.939073 29426 consensus_peers.cc:597] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a -> Peer 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): Couldn't send request to peer 847a7af9f0e2497cbb9025cc2c62557e. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260203 09:17:55.949452 27553 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260203 09:17:55.950358 27553 tablet_replica.cc:333] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:55.951193 27553 raft_consensus.cc:2243] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [term 6 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.951892 27553 raft_consensus.cc:2272] T 15917cb595b149fd847e4ab4424f8262 P cf00f643e7da4a98a0a11ea92869c24a [term 6 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.953923 27553 tablet_replica.cc:333] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:55.954571 27553 raft_consensus.cc:2243] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.955050 27553 raft_consensus.cc:2272] T 1862780e910a42d5a3414a9329cd9259 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.956931 27553 tablet_replica.cc:333] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:55.957471 27553 raft_consensus.cc:2243] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 6 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.958402 27553 raft_consensus.cc:2272] T 7e1bac12c6ee43d6901400e02b35d82f P cf00f643e7da4a98a0a11ea92869c24a [term 6 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.960225 27553 tablet_replica.cc:333] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:55.960809 27553 raft_consensus.cc:2243] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.961309 27553 raft_consensus.cc:2272] T 3a09fae92b37497d8efa250f727c0fd9 P cf00f643e7da4a98a0a11ea92869c24a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.963115 27553 tablet_replica.cc:333] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:55.963704 27553 raft_consensus.cc:2243] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.964430 27553 raft_consensus.cc:2272] T b5ccabd714ab40bab140c7a90667ddd6 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.966367 27553 tablet_replica.cc:333] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:55.966876 27553 raft_consensus.cc:2243] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.967550 27553 raft_consensus.cc:2272] T a10f51ea1a844376bb4dce51f655be6b P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.969345 27553 tablet_replica.cc:333] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:55.969826 27553 raft_consensus.cc:2243] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.970310 27553 raft_consensus.cc:2272] T a0b96e8815b1443c99aaa50410b2c6d1 P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.972040 27553 tablet_replica.cc:333] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:55.972527 27553 raft_consensus.cc:2243] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.973436 27553 raft_consensus.cc:2272] T 6063a063fced4ff38761f892acbdfa76 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.975283 27553 tablet_replica.cc:333] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:55.975800 27553 raft_consensus.cc:2243] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 6 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.976188 27553 raft_consensus.cc:2272] T 3f2a68daf4384c47ba2a6a46ac297f00 P cf00f643e7da4a98a0a11ea92869c24a [term 6 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.977941 27553 tablet_replica.cc:333] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:55.978457 27553 raft_consensus.cc:2243] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.978847 27553 raft_consensus.cc:2272] T 31afe6e1e9d24b89b4ac6d2e837fca22 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.980597 27553 tablet_replica.cc:333] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:55.981114 27553 raft_consensus.cc:2243] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.981789 27553 raft_consensus.cc:2272] T b6c0f69b8ce94c9b9b4e64882eb25a2c P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.983496 27553 tablet_replica.cc:333] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:55.984012 27553 raft_consensus.cc:2243] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.984635 27553 raft_consensus.cc:2272] T 6bf3d38eba3b4894b7f18f2d5733f63e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.986974 27553 tablet_replica.cc:333] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:55.987529 27553 raft_consensus.cc:2243] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 6 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.988339 27553 raft_consensus.cc:2272] T c13ab397c8524e6ca30e36e5fca2ff35 P cf00f643e7da4a98a0a11ea92869c24a [term 6 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.990202 27553 tablet_replica.cc:333] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:55.990763 27553 raft_consensus.cc:2243] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:55.991204 27553 raft_consensus.cc:2272] T eac7b86aa8d340e3a4d61a5c982b1f2e P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.993005 27553 tablet_replica.cc:333] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:55.993525 27553 raft_consensus.cc:2243] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.994232 27553 raft_consensus.cc:2272] T 2f652d76b6054b738b66531829291e55 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.996055 27553 tablet_replica.cc:333] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:55.996541 27553 raft_consensus.cc:2243] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:17:55.997346 27553 raft_consensus.cc:2272] T c49cb7ba1af14dfcbe637cf12fbe669c P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:55.999353 27553 tablet_replica.cc:333] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:55.999908 27553 raft_consensus.cc:2243] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 6 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:56.000340 27553 raft_consensus.cc:2272] T 09f2301096ce4f4689e1e7f24f013e52 P cf00f643e7da4a98a0a11ea92869c24a [term 6 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:56.002211 27553 tablet_replica.cc:333] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:56.002719 27553 raft_consensus.cc:2243] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 5 LEADER]: Raft consensus shutting down.
I20260203 09:17:56.003641 27553 raft_consensus.cc:2272] T 0d2d0debbeba46b086bb9d7344d2181b P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:56.005445 27553 tablet_replica.cc:333] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:56.005942 27553 raft_consensus.cc:2243] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:56.006366 27553 raft_consensus.cc:2272] T c4b4d20256154aa1a7644698755531fd P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:56.008433 27553 tablet_replica.cc:333] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:56.009006 27553 raft_consensus.cc:2243] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 7 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:56.009457 27553 raft_consensus.cc:2272] T f4da79410aa74f5abca9517bbae98420 P cf00f643e7da4a98a0a11ea92869c24a [term 7 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:56.011346 27553 tablet_replica.cc:333] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:56.011873 27553 raft_consensus.cc:2243] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:17:56.012605 27553 raft_consensus.cc:2272] T fba8b1b8685b431e8328cdb7df4ad1d0 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:56.014498 27553 tablet_replica.cc:333] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:56.015041 27553 raft_consensus.cc:2243] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:56.015588 27553 raft_consensus.cc:2272] T bf838e5b1f6141bfb1cd1bc26a8b0006 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:56.017433 27553 tablet_replica.cc:333] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:56.017946 27553 raft_consensus.cc:2243] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:56.018343 27553 raft_consensus.cc:2272] T 797be23efb5c447da7f2d0ba9af2e84d P cf00f643e7da4a98a0a11ea92869c24a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:56.021430 27553 tablet_replica.cc:333] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:56.021997 27553 raft_consensus.cc:2243] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:56.022437 27553 raft_consensus.cc:2272] T b149dd40ec15465299cdb910e5385206 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:56.024281 27553 tablet_replica.cc:333] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:56.024869 27553 raft_consensus.cc:2243] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:56.025312 27553 raft_consensus.cc:2272] T 74236b7aaa67439b807775f90674420c P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:56.027107 27553 tablet_replica.cc:333] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:56.027644 27553 raft_consensus.cc:2243] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:56.028093 27553 raft_consensus.cc:2272] T 2fe435e0235d42ec88a9773010ea1fec P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:56.029886 27553 tablet_replica.cc:333] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:56.030395 27553 raft_consensus.cc:2243] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:17:56.031121 27553 raft_consensus.cc:2272] T fabfb779b8894cf0b22204fe12768dc3 P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:56.032910 27553 tablet_replica.cc:333] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:56.033396 27553 raft_consensus.cc:2243] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:56.033874 27553 raft_consensus.cc:2272] T 1dd859ca9f8b4cda8cca01872e191b47 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:56.035566 27553 tablet_replica.cc:333] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:56.036024 27553 raft_consensus.cc:2243] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 5 LEADER]: Raft consensus shutting down.
I20260203 09:17:56.036782 27553 raft_consensus.cc:2272] T 0322ad4122a64f6abccdfb1906919b8e P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:56.038551 27553 tablet_replica.cc:333] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:56.039036 27553 raft_consensus.cc:2243] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:17:56.039737 27553 raft_consensus.cc:2272] T 428e0a1fef8d467da4a30ece11cc6e5c P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:56.041488 27553 tablet_replica.cc:333] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:56.041985 27553 raft_consensus.cc:2243] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:56.042400 27553 raft_consensus.cc:2272] T 574d0205e57547c6938037563109a6d2 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:56.044071 27553 tablet_replica.cc:333] T 7c8f123f58ac4b3da0beed1215102a98 P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:56.044536 27553 raft_consensus.cc:2243] T 7c8f123f58ac4b3da0beed1215102a98 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:17:56.045054 27553 raft_consensus.cc:2272] T 7c8f123f58ac4b3da0beed1215102a98 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:56.047351 27553 tablet_replica.cc:333] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:56.048043 27553 raft_consensus.cc:2243] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:17:56.048925 27553 raft_consensus.cc:2272] T 4915f49d9ce24ab29a5c09e91dafd667 P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:56.050814 27553 tablet_replica.cc:333] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:56.051309 27553 raft_consensus.cc:2243] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 5 LEADER]: Raft consensus shutting down.
I20260203 09:17:56.051985 27553 raft_consensus.cc:2272] T 438ed0267e3148da951c6dc25761c745 P cf00f643e7da4a98a0a11ea92869c24a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:56.053959 27553 tablet_replica.cc:333] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:56.054435 27553 raft_consensus.cc:2243] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:17:56.055174 27553 raft_consensus.cc:2272] T 9fcb41fb74694d87acc7c8963bdf4bcf P cf00f643e7da4a98a0a11ea92869c24a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:56.057052 27553 tablet_replica.cc:333] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a: stopping tablet replica
I20260203 09:17:56.057477 27553 raft_consensus.cc:2243] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:17:56.058768 27553 raft_consensus.cc:2272] T 7e336e3590fc428e88c5353c9e96a36f P cf00f643e7da4a98a0a11ea92869c24a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:56.253191 27553 tablet_server.cc:195] TabletServer@127.26.232.68:0 shutdown complete.
I20260203 09:17:56.307224 27553 master.cc:561] Master@127.26.232.126:35239 shutting down...
W20260203 09:17:56.718612 28619 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111) [suppressed 524 similar messages]
W20260203 09:17:56.721570 28619 catalog_manager.cc:4712] TS 847a7af9f0e2497cbb9025cc2c62557e (127.26.232.65:37967): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 7c8f123f58ac4b3da0beed1215102a98: Network error: Client connection negotiation failed: client connection to 127.26.232.65:37967: connect: Connection refused (error 111)
I20260203 09:17:57.297685 27553 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:17:57.298344 27553 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:17:57.298663 27553 tablet_replica.cc:333] T 00000000000000000000000000000000 P 05c246c53fdc4d75bc7c798afa64084f: stopping tablet replica
I20260203 09:17:57.429186 27553 master.cc:583] Master@127.26.232.126:35239 shutdown complete.
I20260203 09:17:57.463129 27553 test_util.cc:183] -----------------------------------------------
I20260203 09:17:57.463362 27553 test_util.cc:184] Had failures, leaving test files at /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1770110140020880-27553-0
[ FAILED ] LeaderRebalancerTest.AddTserver (77295 ms)
[ RUN ] LeaderRebalancerTest.RestartTserver
I20260203 09:17:57.466451 27553 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.26.232.126:40067
I20260203 09:17:57.467617 27553 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 09:17:57.473287 31099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:17:57.473680 31098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:17:57.474212 31101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:17:57.474620 27553 server_base.cc:1060] running on GCE node
I20260203 09:17:57.476231 27553 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260203 09:17:57.476404 27553 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260203 09:17:57.476550 27553 hybrid_clock.cc:648] HybridClock initialized: now 1770110277476533 us; error 0 us; skew 500 ppm
I20260203 09:17:57.477133 27553 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260203 09:17:57.479722 27553 webserver.cc:492] Webserver started at http://127.26.232.126:45495/ using document root <none> and password file <none>
I20260203 09:17:57.480211 27553 fs_manager.cc:362] Metadata directory not provided
I20260203 09:17:57.480386 27553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 09:17:57.480684 27553 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 09:17:57.481866 27553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/master-0-root/instance:
uuid: "91c47e3417a14e65bbb34ee9fc8e3723"
format_stamp: "Formatted at 2026-02-03 09:17:57 on dist-test-slave-x12j"
I20260203 09:17:57.486352 27553 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260203 09:17:57.490239 31106 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 09:17:57.491221 27553 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260203 09:17:57.491569 27553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/master-0-root
uuid: "91c47e3417a14e65bbb34ee9fc8e3723"
format_stamp: "Formatted at 2026-02-03 09:17:57 on dist-test-slave-x12j"
I20260203 09:17:57.491878 27553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 09:17:57.510834 27553 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 09:17:57.512089 27553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 09:17:57.554230 27553 rpc_server.cc:307] RPC server started. Bound to: 127.26.232.126:40067
I20260203 09:17:57.554337 31157 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.232.126:40067 every 8 connection(s)
I20260203 09:17:57.558681 31158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:57.572327 31158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723: Bootstrap starting.
I20260203 09:17:57.578507 31158 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723: Neither blocks nor log segments found. Creating new log.
I20260203 09:17:57.583884 31158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723: No bootstrap required, opened a new log
I20260203 09:17:57.586144 31158 raft_consensus.cc:359] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91c47e3417a14e65bbb34ee9fc8e3723" member_type: VOTER }
I20260203 09:17:57.586549 31158 raft_consensus.cc:385] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:17:57.586796 31158 raft_consensus.cc:740] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91c47e3417a14e65bbb34ee9fc8e3723, State: Initialized, Role: FOLLOWER
I20260203 09:17:57.587399 31158 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91c47e3417a14e65bbb34ee9fc8e3723" member_type: VOTER }
I20260203 09:17:57.587869 31158 raft_consensus.cc:399] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260203 09:17:57.588104 31158 raft_consensus.cc:493] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260203 09:17:57.588364 31158 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:17:57.593070 31158 raft_consensus.cc:515] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91c47e3417a14e65bbb34ee9fc8e3723" member_type: VOTER }
I20260203 09:17:57.593638 31158 leader_election.cc:304] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91c47e3417a14e65bbb34ee9fc8e3723; no voters:
I20260203 09:17:57.594921 31158 leader_election.cc:290] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260203 09:17:57.595244 31161 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:17:57.596769 31161 raft_consensus.cc:697] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723 [term 1 LEADER]: Becoming Leader. State: Replica: 91c47e3417a14e65bbb34ee9fc8e3723, State: Running, Role: LEADER
I20260203 09:17:57.597446 31161 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91c47e3417a14e65bbb34ee9fc8e3723" member_type: VOTER }
I20260203 09:17:57.598454 31158 sys_catalog.cc:565] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723 [sys.catalog]: configured and running, proceeding with master startup.
I20260203 09:17:57.602759 31162 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "91c47e3417a14e65bbb34ee9fc8e3723" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91c47e3417a14e65bbb34ee9fc8e3723" member_type: VOTER } }
I20260203 09:17:57.602974 31163 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91c47e3417a14e65bbb34ee9fc8e3723. Latest consensus state: current_term: 1 leader_uuid: "91c47e3417a14e65bbb34ee9fc8e3723" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91c47e3417a14e65bbb34ee9fc8e3723" member_type: VOTER } }
I20260203 09:17:57.603889 31162 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723 [sys.catalog]: This master's current role is: LEADER
I20260203 09:17:57.604238 31163 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723 [sys.catalog]: This master's current role is: LEADER
I20260203 09:17:57.609434 31169 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260203 09:17:57.614441 31169 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260203 09:17:57.617386 27553 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260203 09:17:57.625001 31169 catalog_manager.cc:1357] Generated new cluster ID: c3340604340a44a282a6f36224dbdfc7
I20260203 09:17:57.625391 31169 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260203 09:17:57.642728 31169 catalog_manager.cc:1380] Generated new certificate authority record
I20260203 09:17:57.644059 31169 catalog_manager.cc:1514] Loading token signing keys...
I20260203 09:17:57.661923 31169 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723: Generated new TSK 0
I20260203 09:17:57.662856 31169 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260203 09:17:57.685128 27553 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 09:17:57.691638 31179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:17:57.692385 31180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:17:57.693802 31182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:17:57.694654 27553 server_base.cc:1060] running on GCE node
I20260203 09:17:57.696174 27553 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260203 09:17:57.696373 27553 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260203 09:17:57.696521 27553 hybrid_clock.cc:648] HybridClock initialized: now 1770110277696505 us; error 0 us; skew 500 ppm
I20260203 09:17:57.697057 27553 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260203 09:17:57.700002 27553 webserver.cc:492] Webserver started at http://127.26.232.65:37223/ using document root <none> and password file <none>
I20260203 09:17:57.700740 27553 fs_manager.cc:362] Metadata directory not provided
I20260203 09:17:57.701012 27553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 09:17:57.701296 27553 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 09:17:57.702509 27553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/ts-0-root/instance:
uuid: "d44c40c0ed244c4e962a26f9aebea76a"
format_stamp: "Formatted at 2026-02-03 09:17:57 on dist-test-slave-x12j"
I20260203 09:17:57.707038 27553 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260203 09:17:57.710362 31187 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 09:17:57.711236 27553 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260203 09:17:57.711561 27553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/ts-0-root
uuid: "d44c40c0ed244c4e962a26f9aebea76a"
format_stamp: "Formatted at 2026-02-03 09:17:57 on dist-test-slave-x12j"
I20260203 09:17:57.711865 27553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 09:17:57.723100 27553 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 09:17:57.724299 27553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 09:17:57.725860 27553 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260203 09:17:57.728243 27553 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260203 09:17:57.728442 27553 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260203 09:17:57.728703 27553 ts_tablet_manager.cc:616] Registered 0 tablets
I20260203 09:17:57.728860 27553 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260203 09:17:57.770663 27553 rpc_server.cc:307] RPC server started. Bound to: 127.26.232.65:45511
I20260203 09:17:57.770802 31250 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.232.65:45511 every 8 connection(s)
I20260203 09:17:57.775537 27553 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 09:17:57.783675 31255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:17:57.783838 31256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:17:57.787166 31258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:17:57.787199 27553 server_base.cc:1060] running on GCE node
I20260203 09:17:57.790138 27553 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260203 09:17:57.790365 27553 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260203 09:17:57.790562 27553 hybrid_clock.cc:648] HybridClock initialized: now 1770110277790543 us; error 0 us; skew 500 ppm
I20260203 09:17:57.791158 27553 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260203 09:17:57.791221 31251 heartbeater.cc:344] Connected to a master server at 127.26.232.126:40067
I20260203 09:17:57.791666 31251 heartbeater.cc:461] Registering TS with master...
I20260203 09:17:57.792553 31251 heartbeater.cc:507] Master 127.26.232.126:40067 requested a full tablet report, sending...
I20260203 09:17:57.793895 27553 webserver.cc:492] Webserver started at http://127.26.232.66:42909/ using document root <none> and password file <none>
I20260203 09:17:57.794544 27553 fs_manager.cc:362] Metadata directory not provided
I20260203 09:17:57.794795 27553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 09:17:57.794807 31123 ts_manager.cc:194] Registered new tserver with Master: d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:17:57.795229 27553 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 09:17:57.796741 27553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/ts-1-root/instance:
uuid: "79b10fa125f242419f66b577440e66d0"
format_stamp: "Formatted at 2026-02-03 09:17:57 on dist-test-slave-x12j"
I20260203 09:17:57.797390 31123 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60892
I20260203 09:17:57.802220 27553 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260203 09:17:57.806113 31263 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 09:17:57.806861 27553 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260203 09:17:57.807153 27553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/ts-1-root
uuid: "79b10fa125f242419f66b577440e66d0"
format_stamp: "Formatted at 2026-02-03 09:17:57 on dist-test-slave-x12j"
I20260203 09:17:57.807407 27553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 09:17:57.835178 27553 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 09:17:57.836894 27553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 09:17:57.838418 27553 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260203 09:17:57.840811 27553 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260203 09:17:57.841029 27553 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260203 09:17:57.841272 27553 ts_tablet_manager.cc:616] Registered 0 tablets
I20260203 09:17:57.841427 27553 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260203 09:17:57.887997 27553 rpc_server.cc:307] RPC server started. Bound to: 127.26.232.66:45019
I20260203 09:17:57.888067 31325 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.232.66:45019 every 8 connection(s)
I20260203 09:17:57.892686 27553 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 09:17:57.899639 31329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:17:57.901675 31330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:17:57.904021 27553 server_base.cc:1060] running on GCE node
W20260203 09:17:57.905386 31333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:17:57.906809 31326 heartbeater.cc:344] Connected to a master server at 127.26.232.126:40067
I20260203 09:17:57.907436 31326 heartbeater.cc:461] Registering TS with master...
I20260203 09:17:57.908149 27553 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260203 09:17:57.908207 31326 heartbeater.cc:507] Master 127.26.232.126:40067 requested a full tablet report, sending...
W20260203 09:17:57.908495 27553 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260203 09:17:57.908759 27553 hybrid_clock.cc:648] HybridClock initialized: now 1770110277908740 us; error 0 us; skew 500 ppm
I20260203 09:17:57.909439 27553 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260203 09:17:57.910550 31123 ts_manager.cc:194] Registered new tserver with Master: 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:17:57.912225 31123 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60896
I20260203 09:17:57.912812 27553 webserver.cc:492] Webserver started at http://127.26.232.67:35209/ using document root <none> and password file <none>
I20260203 09:17:57.913915 27553 fs_manager.cc:362] Metadata directory not provided
I20260203 09:17:57.914149 27553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 09:17:57.914466 27553 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 09:17:57.916131 27553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/ts-2-root/instance:
uuid: "73bf755165c4487c81c67b5ab44f7104"
format_stamp: "Formatted at 2026-02-03 09:17:57 on dist-test-slave-x12j"
I20260203 09:17:57.921181 27553 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260203 09:17:57.925154 31337 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 09:17:57.926172 27553 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260203 09:17:57.926586 27553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/ts-2-root
uuid: "73bf755165c4487c81c67b5ab44f7104"
format_stamp: "Formatted at 2026-02-03 09:17:57 on dist-test-slave-x12j"
I20260203 09:17:57.926905 27553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 09:17:57.939492 27553 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 09:17:57.940903 27553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 09:17:57.942509 27553 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260203 09:17:57.944878 27553 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260203 09:17:57.945102 27553 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260203 09:17:57.945320 27553 ts_tablet_manager.cc:616] Registered 0 tablets
I20260203 09:17:57.945468 27553 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260203 09:17:57.988099 27553 rpc_server.cc:307] RPC server started. Bound to: 127.26.232.67:41289
I20260203 09:17:57.988229 31400 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.232.67:41289 every 8 connection(s)
I20260203 09:17:57.992671 27553 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 09:17:58.000530 31405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:17:58.003986 31404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:17:58.004807 31401 heartbeater.cc:344] Connected to a master server at 127.26.232.126:40067
I20260203 09:17:58.005275 31401 heartbeater.cc:461] Registering TS with master...
I20260203 09:17:58.006076 31401 heartbeater.cc:507] Master 127.26.232.126:40067 requested a full tablet report, sending...
W20260203 09:17:58.007179 31407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:17:58.008610 31123 ts_manager.cc:194] Registered new tserver with Master: 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:17:58.009920 27553 server_base.cc:1060] running on GCE node
I20260203 09:17:58.010831 31123 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60908
I20260203 09:17:58.011234 27553 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260203 09:17:58.011533 27553 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260203 09:17:58.011772 27553 hybrid_clock.cc:648] HybridClock initialized: now 1770110278011749 us; error 0 us; skew 500 ppm
I20260203 09:17:58.013022 27553 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260203 09:17:58.015928 27553 webserver.cc:492] Webserver started at http://127.26.232.68:39479/ using document root <none> and password file <none>
I20260203 09:17:58.016475 27553 fs_manager.cc:362] Metadata directory not provided
I20260203 09:17:58.016691 27553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 09:17:58.016973 27553 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 09:17:58.018090 27553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/ts-3-root/instance:
uuid: "2bf9aa3533b14841a52177c8cc3130ec"
format_stamp: "Formatted at 2026-02-03 09:17:58 on dist-test-slave-x12j"
I20260203 09:17:58.022964 27553 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.005s
I20260203 09:17:58.026906 31412 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 09:17:58.027935 27553 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260203 09:17:58.028261 27553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/ts-3-root
uuid: "2bf9aa3533b14841a52177c8cc3130ec"
format_stamp: "Formatted at 2026-02-03 09:17:58 on dist-test-slave-x12j"
I20260203 09:17:58.028559 27553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 09:17:58.042552 27553 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 09:17:58.043869 27553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 09:17:58.045379 27553 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260203 09:17:58.047669 27553 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260203 09:17:58.047878 27553 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260203 09:17:58.048099 27553 ts_tablet_manager.cc:616] Registered 0 tablets
I20260203 09:17:58.048249 27553 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260203 09:17:58.091665 27553 rpc_server.cc:307] RPC server started. Bound to: 127.26.232.68:42099
I20260203 09:17:58.091794 31474 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.232.68:42099 every 8 connection(s)
I20260203 09:17:58.106189 31475 heartbeater.cc:344] Connected to a master server at 127.26.232.126:40067
I20260203 09:17:58.106721 31475 heartbeater.cc:461] Registering TS with master...
I20260203 09:17:58.107678 31475 heartbeater.cc:507] Master 127.26.232.126:40067 requested a full tablet report, sending...
I20260203 09:17:58.109855 31123 ts_manager.cc:194] Registered new tserver with Master: 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:17:58.110558 27553 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015666097s
I20260203 09:17:58.111668 31123 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60910
I20260203 09:17:58.139092 31123 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60914:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260203 09:17:58.388167 31365 tablet_service.cc:1505] Processing CreateTablet for tablet defda4c9fc6a4d0ba46ec287eb2f08d1 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260203 09:17:58.389338 31362 tablet_service.cc:1505] Processing CreateTablet for tablet 2975d753fec1406eadec135c189d3ec3 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260203 09:17:58.389830 31365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet defda4c9fc6a4d0ba46ec287eb2f08d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.391659 31363 tablet_service.cc:1505] Processing CreateTablet for tablet 420f71f998fb4c24a607beff32960d0d (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260203 09:17:58.392244 31291 tablet_service.cc:1505] Processing CreateTablet for tablet 3abbec594ab143a1ade1030741cf9e7d (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260203 09:17:58.393142 31363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 420f71f998fb4c24a607beff32960d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.393800 31291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3abbec594ab143a1ade1030741cf9e7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.395305 31364 tablet_service.cc:1505] Processing CreateTablet for tablet 247b062505fb476790c4f06d074d67aa (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260203 09:17:58.396138 31361 tablet_service.cc:1505] Processing CreateTablet for tablet e57c5a8761da4a818b634fda6687de01 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260203 09:17:58.396806 31364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247b062505fb476790c4f06d074d67aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.397430 31361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e57c5a8761da4a818b634fda6687de01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.399178 31362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2975d753fec1406eadec135c189d3ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.400606 31360 tablet_service.cc:1505] Processing CreateTablet for tablet 55ce9fa640064a68a12f7f2c60a74bfd (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260203 09:17:58.402007 31360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55ce9fa640064a68a12f7f2c60a74bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.407011 31359 tablet_service.cc:1505] Processing CreateTablet for tablet afe2065ab01641aa86dc384050ab810a (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260203 09:17:58.408442 31359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe2065ab01641aa86dc384050ab810a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.414471 31358 tablet_service.cc:1505] Processing CreateTablet for tablet 58d31844d41c408f9fd7f2cbd1270b6c (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260203 09:17:58.416023 31358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58d31844d41c408f9fd7f2cbd1270b6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.416290 31289 tablet_service.cc:1505] Processing CreateTablet for tablet 420f71f998fb4c24a607beff32960d0d (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260203 09:17:58.414539 31290 tablet_service.cc:1505] Processing CreateTablet for tablet defda4c9fc6a4d0ba46ec287eb2f08d1 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260203 09:17:58.417753 31289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 420f71f998fb4c24a607beff32960d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.418480 31290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet defda4c9fc6a4d0ba46ec287eb2f08d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.426801 31357 tablet_service.cc:1505] Processing CreateTablet for tablet fc8de34393ac472590f28a52d1bf55ff (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260203 09:17:58.430377 31356 tablet_service.cc:1505] Processing CreateTablet for tablet e02dfb7bfdec4c3db78522766f8f710d (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260203 09:17:58.430461 31288 tablet_service.cc:1505] Processing CreateTablet for tablet 2975d753fec1406eadec135c189d3ec3 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260203 09:17:58.433244 31288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2975d753fec1406eadec135c189d3ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.433831 31287 tablet_service.cc:1505] Processing CreateTablet for tablet 0b92ba54a16143c08cfa7303819aa929 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260203 09:17:58.435114 31287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b92ba54a16143c08cfa7303819aa929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.439438 31357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc8de34393ac472590f28a52d1bf55ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.441107 31356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e02dfb7bfdec4c3db78522766f8f710d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.446545 31286 tablet_service.cc:1505] Processing CreateTablet for tablet 55ce9fa640064a68a12f7f2c60a74bfd (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260203 09:17:58.446866 31440 tablet_service.cc:1505] Processing CreateTablet for tablet 3abbec594ab143a1ade1030741cf9e7d (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260203 09:17:58.448125 31286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55ce9fa640064a68a12f7f2c60a74bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.448180 31440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3abbec594ab143a1ade1030741cf9e7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.458468 31439 tablet_service.cc:1505] Processing CreateTablet for tablet 247b062505fb476790c4f06d074d67aa (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260203 09:17:58.459964 31439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247b062505fb476790c4f06d074d67aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.461927 31363 tablet_service.cc:1505] Processing CreateTablet for tablet 03943e5b830f4ab4be9fe0b4e0ca4697 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260203 09:17:58.459846 31362 tablet_service.cc:1505] Processing CreateTablet for tablet 5c17aa1880254f13a38a3c550b0894af (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260203 09:17:58.464421 31362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c17aa1880254f13a38a3c550b0894af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.469086 31363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03943e5b830f4ab4be9fe0b4e0ca4697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.470398 31438 tablet_service.cc:1505] Processing CreateTablet for tablet 420f71f998fb4c24a607beff32960d0d (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260203 09:17:58.471846 31438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 420f71f998fb4c24a607beff32960d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.482599 31437 tablet_service.cc:1505] Processing CreateTablet for tablet 0b92ba54a16143c08cfa7303819aa929 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260203 09:17:58.484218 31437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b92ba54a16143c08cfa7303819aa929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.494407 31436 tablet_service.cc:1505] Processing CreateTablet for tablet e57c5a8761da4a818b634fda6687de01 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260203 09:17:58.495985 31436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e57c5a8761da4a818b634fda6687de01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.511193 31435 tablet_service.cc:1505] Processing CreateTablet for tablet 55ce9fa640064a68a12f7f2c60a74bfd (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260203 09:17:58.513278 31435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55ce9fa640064a68a12f7f2c60a74bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.514249 31285 tablet_service.cc:1505] Processing CreateTablet for tablet afe2065ab01641aa86dc384050ab810a (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260203 09:17:58.515782 31285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe2065ab01641aa86dc384050ab810a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.531361 31434 tablet_service.cc:1505] Processing CreateTablet for tablet 14fd7c3d313847f591177ebba8df09c4 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260203 09:17:58.539520 31358 tablet_service.cc:1505] Processing CreateTablet for tablet 730e665d69354cad93df20607e256d58 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260203 09:17:58.540967 31358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 730e665d69354cad93df20607e256d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.541008 31434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14fd7c3d313847f591177ebba8df09c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.549641 31433 tablet_service.cc:1505] Processing CreateTablet for tablet 58d31844d41c408f9fd7f2cbd1270b6c (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260203 09:17:58.551080 31433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58d31844d41c408f9fd7f2cbd1270b6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.554559 31286 tablet_service.cc:1505] Processing CreateTablet for tablet 14fd7c3d313847f591177ebba8df09c4 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260203 09:17:58.554885 31284 tablet_service.cc:1505] Processing CreateTablet for tablet fc8de34393ac472590f28a52d1bf55ff (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260203 09:17:58.555692 31432 tablet_service.cc:1505] Processing CreateTablet for tablet fc8de34393ac472590f28a52d1bf55ff (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260203 09:17:58.557015 31432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc8de34393ac472590f28a52d1bf55ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.556205 31286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14fd7c3d313847f591177ebba8df09c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.555722 31362 tablet_service.cc:1505] Processing CreateTablet for tablet a8fd0dd8dc8d432b8e8bb19f4f3448cc (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260203 09:17:58.559655 31284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc8de34393ac472590f28a52d1bf55ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.567230 31495 tablet_bootstrap.cc:492] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:17:58.574563 31291 tablet_service.cc:1505] Processing CreateTablet for tablet e02dfb7bfdec4c3db78522766f8f710d (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260203 09:17:58.576005 31291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e02dfb7bfdec4c3db78522766f8f710d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.577283 31362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8fd0dd8dc8d432b8e8bb19f4f3448cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.579761 31283 tablet_service.cc:1505] Processing CreateTablet for tablet 5c2f90aaa7514d27a5a15b4fd6f90669 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260203 09:17:58.539585 31363 tablet_service.cc:1505] Processing CreateTablet for tablet 374ce202ecd540008cded117a37bfeba (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260203 09:17:58.581203 31283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c2f90aaa7514d27a5a15b4fd6f90669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.581403 31363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374ce202ecd540008cded117a37bfeba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.586886 31431 tablet_service.cc:1505] Processing CreateTablet for tablet 5c17aa1880254f13a38a3c550b0894af (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260203 09:17:58.588310 31431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c17aa1880254f13a38a3c550b0894af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.592962 31495 tablet_bootstrap.cc:654] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:17:58.603063 31360 tablet_service.cc:1505] Processing CreateTablet for tablet dbf01f6b7a2f4b7db0978441f72e138d (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
W20260203 09:17:58.609760 31171 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:17:58.621739 31435 tablet_service.cc:1505] Processing CreateTablet for tablet 92861fb258ec44228e1c191bee2fee0b (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260203 09:17:58.622833 31288 tablet_service.cc:1505] Processing CreateTablet for tablet 730e665d69354cad93df20607e256d58 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260203 09:17:58.623333 31439 tablet_service.cc:1505] Processing CreateTablet for tablet 5c2f90aaa7514d27a5a15b4fd6f90669 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260203 09:17:58.624444 31288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 730e665d69354cad93df20607e256d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.626081 31282 tablet_service.cc:1505] Processing CreateTablet for tablet 92861fb258ec44228e1c191bee2fee0b (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260203 09:17:58.627341 31436 tablet_service.cc:1505] Processing CreateTablet for tablet 374ce202ecd540008cded117a37bfeba (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260203 09:17:58.628762 31438 tablet_service.cc:1505] Processing CreateTablet for tablet 03943e5b830f4ab4be9fe0b4e0ca4697 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260203 09:17:58.629714 31361 tablet_service.cc:1505] Processing CreateTablet for tablet 70796ace22d548219e05b0c9a86346e7 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260203 09:17:58.636054 31358 tablet_service.cc:1505] Processing CreateTablet for tablet 8dbd55217e2546b5b3361ddf019f01d6 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260203 09:17:58.636961 31287 tablet_service.cc:1505] Processing CreateTablet for tablet 03943e5b830f4ab4be9fe0b4e0ca4697 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260203 09:17:58.655476 31282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92861fb258ec44228e1c191bee2fee0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.641176 31364 tablet_service.cc:1505] Processing CreateTablet for tablet 93cc0a94606149e18c8764e851f4b826 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260203 09:17:58.643786 31289 tablet_service.cc:1505] Processing CreateTablet for tablet a8fd0dd8dc8d432b8e8bb19f4f3448cc (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260203 09:17:58.657161 31289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8fd0dd8dc8d432b8e8bb19f4f3448cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.627341 31357 tablet_service.cc:1505] Processing CreateTablet for tablet 707a391491654853bba7daefe8451eca (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260203 09:17:58.623217 31435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92861fb258ec44228e1c191bee2fee0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.644523 31359 tablet_service.cc:1505] Processing CreateTablet for tablet 9e9201a8d64c4b45982d775e4406a3fd (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260203 09:17:58.644510 31363 tablet_service.cc:1505] Processing CreateTablet for tablet c84b4a1f3d804ae39a009a23ea4e90f3 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260203 09:17:58.647095 31365 tablet_service.cc:1505] Processing CreateTablet for tablet 03e1544e85d94310a17e919716a0e5b9 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260203 09:17:58.652107 31356 tablet_service.cc:1505] Processing CreateTablet for tablet c2ce342ceda546bbad30e8eff5485a48 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260203 09:17:58.667589 31439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c2f90aaa7514d27a5a15b4fd6f90669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.604604 31360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbf01f6b7a2f4b7db0978441f72e138d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.687495 31290 tablet_service.cc:1505] Processing CreateTablet for tablet dbf01f6b7a2f4b7db0978441f72e138d (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260203 09:17:58.694190 31434 tablet_service.cc:1505] Processing CreateTablet for tablet d1d1f5b1c3b64ebaa2824e9136285fbe (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260203 09:17:58.694190 31432 tablet_service.cc:1505] Processing CreateTablet for tablet a8fd0dd8dc8d432b8e8bb19f4f3448cc (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260203 09:17:58.695881 31434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d1f5b1c3b64ebaa2824e9136285fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.692615 31362 tablet_service.cc:1505] Processing CreateTablet for tablet f5ccddc8d332443c97a92e59957dfa69 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260203 09:17:58.697386 31362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ccddc8d332443c97a92e59957dfa69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.699797 31438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03943e5b830f4ab4be9fe0b4e0ca4697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.699740 31287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03943e5b830f4ab4be9fe0b4e0ca4697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.702273 31284 tablet_service.cc:1505] Processing CreateTablet for tablet 707a391491654853bba7daefe8451eca (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260203 09:17:58.697309 31496 tablet_bootstrap.cc:492] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:17:58.703363 31436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374ce202ecd540008cded117a37bfeba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.703729 31284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 707a391491654853bba7daefe8451eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.702750 31358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dbd55217e2546b5b3361ddf019f01d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.708382 31365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03e1544e85d94310a17e919716a0e5b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.708962 31290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbf01f6b7a2f4b7db0978441f72e138d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.711386 31286 tablet_service.cc:1505] Processing CreateTablet for tablet d1d1f5b1c3b64ebaa2824e9136285fbe (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260203 09:17:58.711987 31435 tablet_service.cc:1505] Processing CreateTablet for tablet 707a391491654853bba7daefe8451eca (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260203 09:17:58.717198 31435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 707a391491654853bba7daefe8451eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.712905 31286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d1f5b1c3b64ebaa2824e9136285fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.712037 31364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93cc0a94606149e18c8764e851f4b826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.723639 31432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8fd0dd8dc8d432b8e8bb19f4f3448cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.725167 31440 tablet_service.cc:1505] Processing CreateTablet for tablet e4d4fa5c03a74205a7c5fdda5e37cfe4 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260203 09:17:58.726632 31440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4d4fa5c03a74205a7c5fdda5e37cfe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.729176 31363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c84b4a1f3d804ae39a009a23ea4e90f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.733259 31359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e9201a8d64c4b45982d775e4406a3fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.733230 31437 tablet_service.cc:1505] Processing CreateTablet for tablet 9e9201a8d64c4b45982d775e4406a3fd (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260203 09:17:58.734755 31437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e9201a8d64c4b45982d775e4406a3fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.737674 31361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70796ace22d548219e05b0c9a86346e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.740362 31356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2ce342ceda546bbad30e8eff5485a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.763022 31494 tablet_bootstrap.cc:492] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:17:58.780900 31357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 707a391491654853bba7daefe8451eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.792395 31494 tablet_bootstrap.cc:654] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:17:58.800335 31251 heartbeater.cc:499] Master 127.26.232.126:40067 was elected leader, sending a full tablet report...
I20260203 09:17:58.808920 31285 tablet_service.cc:1505] Processing CreateTablet for tablet 93cc0a94606149e18c8764e851f4b826 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260203 09:17:58.809096 31282 tablet_service.cc:1505] Processing CreateTablet for tablet e4d4fa5c03a74205a7c5fdda5e37cfe4 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260203 09:17:58.810339 31285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93cc0a94606149e18c8764e851f4b826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.811034 31282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4d4fa5c03a74205a7c5fdda5e37cfe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.812563 31289 tablet_service.cc:1505] Processing CreateTablet for tablet 8dbd55217e2546b5b3361ddf019f01d6 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260203 09:17:58.813947 31289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dbd55217e2546b5b3361ddf019f01d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.815920 31291 tablet_service.cc:1505] Processing CreateTablet for tablet c84b4a1f3d804ae39a009a23ea4e90f3 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260203 09:17:58.817250 31291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c84b4a1f3d804ae39a009a23ea4e90f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.819334 31283 tablet_service.cc:1505] Processing CreateTablet for tablet 8301405e2ead406caa7440c0337df77d (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260203 09:17:58.825464 31283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8301405e2ead406caa7440c0337df77d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.808956 31496 tablet_bootstrap.cc:654] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:17:58.835872 31438 tablet_service.cc:1505] Processing CreateTablet for tablet 70796ace22d548219e05b0c9a86346e7 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260203 09:17:58.836179 31364 tablet_service.cc:1505] Processing CreateTablet for tablet 87ac8c99d77e47c2b1a373820b27c804 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260203 09:17:58.832270 31287 tablet_service.cc:1505] Processing CreateTablet for tablet c2ce342ceda546bbad30e8eff5485a48 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260203 09:17:58.835968 31431 tablet_service.cc:1505] Processing CreateTablet for tablet 8dbd55217e2546b5b3361ddf019f01d6 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260203 09:17:58.837423 31438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70796ace22d548219e05b0c9a86346e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.840155 31288 tablet_service.cc:1505] Processing CreateTablet for tablet f5ccddc8d332443c97a92e59957dfa69 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260203 09:17:58.840752 31284 tablet_service.cc:1505] Processing CreateTablet for tablet 3eab34196fcb483abc69a625b7ca6300 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260203 09:17:58.847882 31364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ac8c99d77e47c2b1a373820b27c804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.860464 31431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dbd55217e2546b5b3361ddf019f01d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.865391 31495 tablet_bootstrap.cc:492] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:17:58.865990 31495 ts_tablet_manager.cc:1403] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.299s user 0.022s sys 0.041s
I20260203 09:17:58.872906 31286 tablet_service.cc:1505] Processing CreateTablet for tablet f0a785c5c3bf4846b008f0bc6de21607 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260203 09:17:58.875985 31284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eab34196fcb483abc69a625b7ca6300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.881862 31495 raft_consensus.cc:359] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:17:58.893271 31495 raft_consensus.cc:385] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:17:58.893661 31495 raft_consensus.cc:740] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:17:58.894236 31358 tablet_service.cc:1505] Processing CreateTablet for tablet f0a785c5c3bf4846b008f0bc6de21607 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260203 09:17:58.894474 31495 consensus_queue.cc:260] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:17:58.895860 31358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0a785c5c3bf4846b008f0bc6de21607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.897804 31433 tablet_service.cc:1505] Processing CreateTablet for tablet 03e1544e85d94310a17e919716a0e5b9 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260203 09:17:58.899199 31433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03e1544e85d94310a17e919716a0e5b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.904793 31286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0a785c5c3bf4846b008f0bc6de21607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.905318 31361 tablet_service.cc:1505] Processing CreateTablet for tablet c9884e996f0443f2ae2ab5606633ce3c (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260203 09:17:58.906612 31361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9884e996f0443f2ae2ab5606633ce3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.914496 31496 tablet_bootstrap.cc:492] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:17:58.915061 31326 heartbeater.cc:499] Master 127.26.232.126:40067 was elected leader, sending a full tablet report...
I20260203 09:17:58.915139 31496 ts_tablet_manager.cc:1403] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.218s user 0.012s sys 0.008s
I20260203 09:17:58.918365 31496 raft_consensus.cc:359] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:17:58.886523 31434 tablet_service.cc:1505] Processing CreateTablet for tablet 8301405e2ead406caa7440c0337df77d (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260203 09:17:58.919154 31496 raft_consensus.cc:385] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:17:58.919520 31496 raft_consensus.cc:740] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:17:58.925318 31432 tablet_service.cc:1505] Processing CreateTablet for tablet c2ce342ceda546bbad30e8eff5485a48 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260203 09:17:58.926805 31432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2ce342ceda546bbad30e8eff5485a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.935791 31357 tablet_service.cc:1505] Processing CreateTablet for tablet a3cb6ffb2d8d4a528e8f6108d59adb09 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260203 09:17:58.918426 31365 tablet_service.cc:1505] Processing CreateTablet for tablet 2a5ca73a494b4d7389eec90025653337 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260203 09:17:58.939006 31359 tablet_service.cc:1505] Processing CreateTablet for tablet 9f6fed7d1dca4d4184fd89b136a55ec1 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260203 09:17:58.948813 31287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2ce342ceda546bbad30e8eff5485a48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.952481 31363 tablet_service.cc:1505] Processing CreateTablet for tablet c43e17bc65f048a9a9fd229bb9c98bfb (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260203 09:17:58.956425 31439 tablet_service.cc:1505] Processing CreateTablet for tablet 3eab34196fcb483abc69a625b7ca6300 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260203 09:17:58.960602 31494 tablet_bootstrap.cc:492] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:17:58.972438 31494 ts_tablet_manager.cc:1403] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.210s user 0.009s sys 0.008s
I20260203 09:17:58.974103 31359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f6fed7d1dca4d4184fd89b136a55ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.953359 31434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8301405e2ead406caa7440c0337df77d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.976125 31435 tablet_service.cc:1505] Processing CreateTablet for tablet 87ac8c99d77e47c2b1a373820b27c804 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260203 09:17:58.976874 31363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c43e17bc65f048a9a9fd229bb9c98bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.977464 31435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ac8c99d77e47c2b1a373820b27c804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.978600 31494 raft_consensus.cc:359] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:17:58.963677 31285 tablet_service.cc:1505] Processing CreateTablet for tablet c9884e996f0443f2ae2ab5606633ce3c (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260203 09:17:58.970851 31288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ccddc8d332443c97a92e59957dfa69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.980334 31362 tablet_service.cc:1505] Processing CreateTablet for tablet 14073202fe424a9b9a72f4c7e6075bdf (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260203 09:17:59.014107 31401 heartbeater.cc:499] Master 127.26.232.126:40067 was elected leader, sending a full tablet report...
I20260203 09:17:58.981194 31439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eab34196fcb483abc69a625b7ca6300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.987071 31365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a5ca73a494b4d7389eec90025653337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:58.987464 31291 tablet_service.cc:1505] Processing CreateTablet for tablet a3cb6ffb2d8d4a528e8f6108d59adb09 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260203 09:17:58.987663 31215 tablet_service.cc:1505] Processing CreateTablet for tablet 3abbec594ab143a1ade1030741cf9e7d (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260203 09:17:59.015619 31357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3cb6ffb2d8d4a528e8f6108d59adb09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.016553 31215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3abbec594ab143a1ade1030741cf9e7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.018332 31362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14073202fe424a9b9a72f4c7e6075bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.007740 31289 tablet_service.cc:1505] Processing CreateTablet for tablet 14073202fe424a9b9a72f4c7e6075bdf (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260203 09:17:59.021422 31291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3cb6ffb2d8d4a528e8f6108d59adb09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.025204 31289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14073202fe424a9b9a72f4c7e6075bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.027828 31210 tablet_service.cc:1505] Processing CreateTablet for tablet e57c5a8761da4a818b634fda6687de01 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260203 09:17:59.029481 31210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e57c5a8761da4a818b634fda6687de01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.031733 31433 tablet_service.cc:1505] Processing CreateTablet for tablet a3cb6ffb2d8d4a528e8f6108d59adb09 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260203 09:17:58.944458 31360 tablet_service.cc:1505] Processing CreateTablet for tablet 4d46f012a03d4d73afb2cffe5d847486 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260203 09:17:58.990056 31437 tablet_service.cc:1505] Processing CreateTablet for tablet f0a785c5c3bf4846b008f0bc6de21607 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260203 09:17:59.033134 31433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3cb6ffb2d8d4a528e8f6108d59adb09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.033411 31360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d46f012a03d4d73afb2cffe5d847486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.034003 31437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0a785c5c3bf4846b008f0bc6de21607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.035173 31359 tablet_service.cc:1505] Processing CreateTablet for tablet 2b0e416075b74212b54e341eba13fd78 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260203 09:17:59.036497 31359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b0e416075b74212b54e341eba13fd78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.036937 31285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9884e996f0443f2ae2ab5606633ce3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.039633 31431 tablet_service.cc:1505] Processing CreateTablet for tablet 2a5ca73a494b4d7389eec90025653337 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260203 09:17:59.008869 31494 raft_consensus.cc:385] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:17:58.999200 31284 tablet_service.cc:1505] Processing CreateTablet for tablet 9f6fed7d1dca4d4184fd89b136a55ec1 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260203 09:17:58.920418 31496 consensus_queue.cc:260] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:17:58.996735 31495 ts_tablet_manager.cc:1434] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.130s user 0.017s sys 0.021s
I20260203 09:17:58.991500 31282 tablet_service.cc:1505] Processing CreateTablet for tablet 20dfe4990e0a46ef9b0cf1cdf3dfdb09 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260203 09:17:59.000355 31214 tablet_service.cc:1505] Processing CreateTablet for tablet defda4c9fc6a4d0ba46ec287eb2f08d1 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260203 09:17:59.003854 31283 tablet_service.cc:1505] Processing CreateTablet for tablet 06460fafee594578bed03068236ad9f2 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260203 09:17:59.004747 31213 tablet_service.cc:1505] Processing CreateTablet for tablet 247b062505fb476790c4f06d074d67aa (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260203 09:17:59.006455 31290 tablet_service.cc:1505] Processing CreateTablet for tablet c43e17bc65f048a9a9fd229bb9c98bfb (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260203 09:17:59.007390 31212 tablet_service.cc:1505] Processing CreateTablet for tablet 2975d753fec1406eadec135c189d3ec3 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260203 09:17:59.007400 31356 tablet_service.cc:1505] Processing CreateTablet for tablet 2a68c16f0da84e9683a5121f63b3f22c (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260203 09:17:59.010952 31211 tablet_service.cc:1505] Processing CreateTablet for tablet 0b92ba54a16143c08cfa7303819aa929 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260203 09:17:59.041016 31494 raft_consensus.cc:740] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:17:58.997766 31436 tablet_service.cc:1505] Processing CreateTablet for tablet 20dfe4990e0a46ef9b0cf1cdf3dfdb09 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260203 09:17:59.041216 31431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a5ca73a494b4d7389eec90025653337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.031981 31358 tablet_service.cc:1505] Processing CreateTablet for tablet 4d9139b651d14e5082793499087ed2d4 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260203 09:17:59.043275 31209 tablet_service.cc:1505] Processing CreateTablet for tablet afe2065ab01641aa86dc384050ab810a (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260203 09:17:59.057396 31207 tablet_service.cc:1505] Processing CreateTablet for tablet 58d31844d41c408f9fd7f2cbd1270b6c (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260203 09:17:59.044320 31214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet defda4c9fc6a4d0ba46ec287eb2f08d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.042009 31284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f6fed7d1dca4d4184fd89b136a55ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.058954 31290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c43e17bc65f048a9a9fd229bb9c98bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.053817 31494 consensus_queue.cc:260] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:17:59.055344 31208 tablet_service.cc:1505] Processing CreateTablet for tablet 14fd7c3d313847f591177ebba8df09c4 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260203 09:17:59.059613 31283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06460fafee594578bed03068236ad9f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.058907 31212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2975d753fec1406eadec135c189d3ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.060546 31208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14fd7c3d313847f591177ebba8df09c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.061188 31207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58d31844d41c408f9fd7f2cbd1270b6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.061853 31209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe2065ab01641aa86dc384050ab810a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.062516 31213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247b062505fb476790c4f06d074d67aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.063113 31211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b92ba54a16143c08cfa7303819aa929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.077459 31358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9139b651d14e5082793499087ed2d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.078704 31206 tablet_service.cc:1505] Processing CreateTablet for tablet e02dfb7bfdec4c3db78522766f8f710d (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260203 09:17:59.058179 31436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20dfe4990e0a46ef9b0cf1cdf3dfdb09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.080232 31206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e02dfb7bfdec4c3db78522766f8f710d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.092710 31356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a68c16f0da84e9683a5121f63b3f22c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.043030 31495 tablet_bootstrap.cc:492] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:17:59.108026 31361 tablet_service.cc:1505] Processing CreateTablet for tablet f617ef4ccf984446b1ab7084a92efe17 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260203 09:17:59.111290 31500 raft_consensus.cc:493] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:59.111837 31282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20dfe4990e0a46ef9b0cf1cdf3dfdb09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.114835 31475 heartbeater.cc:499] Master 127.26.232.126:40067 was elected leader, sending a full tablet report...
I20260203 09:17:59.128357 31438 tablet_service.cc:1505] Processing CreateTablet for tablet 4d46f012a03d4d73afb2cffe5d847486 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260203 09:17:59.151077 31438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d46f012a03d4d73afb2cffe5d847486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.152532 31500 raft_consensus.cc:515] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:17:59.119815 31435 tablet_service.cc:1505] Processing CreateTablet for tablet 06460fafee594578bed03068236ad9f2 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260203 09:17:59.137399 31431 tablet_service.cc:1505] Processing CreateTablet for tablet c43e17bc65f048a9a9fd229bb9c98bfb (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260203 09:17:59.141773 31440 tablet_service.cc:1505] Processing CreateTablet for tablet 4d9139b651d14e5082793499087ed2d4 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260203 09:17:59.143770 31327 tablet.cc:2378] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260203 09:17:59.166504 31361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f617ef4ccf984446b1ab7084a92efe17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.170836 31500 leader_election.cc:290] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
W20260203 09:17:59.145004 31110 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.26.232.68:42099, user_credentials={real_user=slave}} blocked reactor thread for 62049.8us
I20260203 09:17:59.193765 31286 tablet_service.cc:1505] Processing CreateTablet for tablet a9e063333ea146ed9efb0110b67e9520 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260203 09:17:59.195770 31286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e063333ea146ed9efb0110b67e9520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.200776 31289 tablet_service.cc:1505] Processing CreateTablet for tablet 4d9139b651d14e5082793499087ed2d4 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260203 09:17:59.200183 31495 tablet_bootstrap.cc:654] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:17:59.228844 31494 ts_tablet_manager.cc:1434] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.255s user 0.019s sys 0.019s
I20260203 09:17:59.230002 31494 tablet_bootstrap.cc:492] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:17:59.224992 31431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c43e17bc65f048a9a9fd229bb9c98bfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.227387 31289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9139b651d14e5082793499087ed2d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.238776 31364 tablet_service.cc:1505] Processing CreateTablet for tablet bd838f6bdcba4d728e975023e89894a5 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260203 09:17:59.239372 31504 tablet_bootstrap.cc:492] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:17:59.243772 31502 raft_consensus.cc:493] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:59.244345 31502 raft_consensus.cc:515] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:17:59.245147 31364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd838f6bdcba4d728e975023e89894a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.261125 31215 tablet_service.cc:1505] Processing CreateTablet for tablet 5c17aa1880254f13a38a3c550b0894af (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260203 09:17:59.262550 31215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c17aa1880254f13a38a3c550b0894af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.262204 31210 tablet_service.cc:1505] Processing CreateTablet for tablet 730e665d69354cad93df20607e256d58 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260203 09:17:59.263484 31210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 730e665d69354cad93df20607e256d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.268841 31435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06460fafee594578bed03068236ad9f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.270293 31495 tablet_bootstrap.cc:492] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:17:59.270828 31495 ts_tablet_manager.cc:1403] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.228s user 0.006s sys 0.006s
I20260203 09:17:59.273723 31440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9139b651d14e5082793499087ed2d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.273727 31495 raft_consensus.cc:359] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:17:59.274703 31495 raft_consensus.cc:385] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:17:59.275010 31495 raft_consensus.cc:740] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:17:59.275902 31495 consensus_queue.cc:260] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:17:59.290607 31501 raft_consensus.cc:493] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:59.291312 31501 raft_consensus.cc:515] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:17:59.280874 31495 ts_tablet_manager.cc:1434] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20260203 09:17:59.318526 31502 leader_election.cc:290] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:17:59.336845 31501 leader_election.cc:290] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:17:59.290656 31211 tablet_service.cc:1505] Processing CreateTablet for tablet 5c2f90aaa7514d27a5a15b4fd6f90669 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260203 09:17:59.342163 31495 tablet_bootstrap.cc:492] T 2975d753fec1406eadec135c189d3ec3 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:17:59.345208 31496 ts_tablet_manager.cc:1434] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.428s user 0.018s sys 0.018s
I20260203 09:17:59.369872 31209 tablet_service.cc:1505] Processing CreateTablet for tablet 92861fb258ec44228e1c191bee2fee0b (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260203 09:17:59.372177 31211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c2f90aaa7514d27a5a15b4fd6f90669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.373247 31496 tablet_bootstrap.cc:492] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:17:59.355871 31432 tablet_service.cc:1505] Processing CreateTablet for tablet 563e8640cca54f9cab7822a8136fb583 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260203 09:17:59.376705 31432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563e8640cca54f9cab7822a8136fb583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.379678 31287 tablet_service.cc:1505] Processing CreateTablet for tablet 2b0e416075b74212b54e341eba13fd78 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260203 09:17:59.389657 31357 tablet_service.cc:1505] Processing CreateTablet for tablet 653756c5b80f438b91b3d00ce86f52bb (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260203 09:17:59.391084 31357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 653756c5b80f438b91b3d00ce86f52bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.393755 31434 tablet_service.cc:1505] Processing CreateTablet for tablet f617ef4ccf984446b1ab7084a92efe17 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260203 09:17:59.395130 31434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f617ef4ccf984446b1ab7084a92efe17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.363651 31439 tablet_service.cc:1505] Processing CreateTablet for tablet a9e063333ea146ed9efb0110b67e9520 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260203 09:17:59.398103 31439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e063333ea146ed9efb0110b67e9520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.402249 31209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92861fb258ec44228e1c191bee2fee0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.403237 31359 tablet_service.cc:1505] Processing CreateTablet for tablet 15d598c8a8514ff5af7a0e48897dffa7 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260203 09:17:59.404793 31359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15d598c8a8514ff5af7a0e48897dffa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.410985 31360 tablet_service.cc:1505] Processing CreateTablet for tablet f94dad823fea42d2976b19da7bc7b258 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260203 09:17:59.412335 31360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f94dad823fea42d2976b19da7bc7b258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.414212 31365 tablet_service.cc:1505] Processing CreateTablet for tablet 563e8640cca54f9cab7822a8136fb583 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260203 09:17:59.415531 31365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563e8640cca54f9cab7822a8136fb583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.416966 31363 tablet_service.cc:1505] Processing CreateTablet for tablet ee25c6a8d94e49a2a9a5646d493c1bde (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260203 09:17:59.410167 31283 tablet_service.cc:1505] Processing CreateTablet for tablet ec42a05859cf4d5ebe1e1f268d01b3fc (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260203 09:17:59.419652 31288 tablet_service.cc:1505] Processing CreateTablet for tablet bd838f6bdcba4d728e975023e89894a5 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260203 09:17:59.410081 31287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b0e416075b74212b54e341eba13fd78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.428059 31433 tablet_service.cc:1505] Processing CreateTablet for tablet 2a68c16f0da84e9683a5121f63b3f22c (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260203 09:17:59.384574 31494 tablet_bootstrap.cc:654] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:17:59.407047 31495 tablet_bootstrap.cc:654] T 2975d753fec1406eadec135c189d3ec3 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:17:59.430284 31504 tablet_bootstrap.cc:654] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:17:59.447249 31212 tablet_service.cc:1505] Processing CreateTablet for tablet 93cc0a94606149e18c8764e851f4b826 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260203 09:17:59.449193 31283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec42a05859cf4d5ebe1e1f268d01b3fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.453264 31288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd838f6bdcba4d728e975023e89894a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.458114 31363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee25c6a8d94e49a2a9a5646d493c1bde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.456976 31212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93cc0a94606149e18c8764e851f4b826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.464594 31284 tablet_service.cc:1505] Processing CreateTablet for tablet f94dad823fea42d2976b19da7bc7b258 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260203 09:17:59.475749 31284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f94dad823fea42d2976b19da7bc7b258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.475623 31210 tablet_service.cc:1505] Processing CreateTablet for tablet e4d4fa5c03a74205a7c5fdda5e37cfe4 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260203 09:17:59.464671 31207 tablet_service.cc:1505] Processing CreateTablet for tablet d1d1f5b1c3b64ebaa2824e9136285fbe (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260203 09:17:59.465297 31208 tablet_service.cc:1505] Processing CreateTablet for tablet 374ce202ecd540008cded117a37bfeba (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260203 09:17:59.465772 31206 tablet_service.cc:1505] Processing CreateTablet for tablet 9e9201a8d64c4b45982d775e4406a3fd (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260203 09:17:59.460114 31496 tablet_bootstrap.cc:654] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:17:59.484164 31213 tablet_service.cc:1505] Processing CreateTablet for tablet dbf01f6b7a2f4b7db0978441f72e138d (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260203 09:17:59.484634 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3abbec594ab143a1ade1030741cf9e7d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
W20260203 09:17:59.486562 31267 leader_election.cc:343] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:17:59.487741 31214 tablet_service.cc:1505] Processing CreateTablet for tablet 70796ace22d548219e05b0c9a86346e7 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260203 09:17:59.492540 31500 raft_consensus.cc:493] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:59.493152 31500 raft_consensus.cc:515] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:17:59.495343 31500 leader_election.cc:290] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:17:59.457432 31433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a68c16f0da84e9683a5121f63b3f22c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.509793 31437 tablet_service.cc:1505] Processing CreateTablet for tablet bd838f6bdcba4d728e975023e89894a5 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260203 09:17:59.512311 31290 tablet_service.cc:1505] Processing CreateTablet for tablet 15d598c8a8514ff5af7a0e48897dffa7 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260203 09:17:59.513899 31290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15d598c8a8514ff5af7a0e48897dffa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.474261 31285 tablet_service.cc:1505] Processing CreateTablet for tablet 9adae0a7f8a243ad9a35cb7a2047f472 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260203 09:17:59.524123 31208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374ce202ecd540008cded117a37bfeba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.542936 31285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9adae0a7f8a243ad9a35cb7a2047f472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.474261 31436 tablet_service.cc:1505] Processing CreateTablet for tablet ec42a05859cf4d5ebe1e1f268d01b3fc (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260203 09:17:59.548321 31437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd838f6bdcba4d728e975023e89894a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.561195 31206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e9201a8d64c4b45982d775e4406a3fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.576032 31282 tablet_service.cc:1505] Processing CreateTablet for tablet 653756c5b80f438b91b3d00ce86f52bb (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260203 09:17:59.577730 31282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 653756c5b80f438b91b3d00ce86f52bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.593772 31286 tablet_service.cc:1505] Processing CreateTablet for tablet e9ac7485f9224e0b9a9e95ce8b3c5654 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260203 09:17:59.595386 31286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9ac7485f9224e0b9a9e95ce8b3c5654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.615123 31209 tablet_service.cc:1505] Processing CreateTablet for tablet c84b4a1f3d804ae39a009a23ea4e90f3 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260203 09:17:59.621955 31209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c84b4a1f3d804ae39a009a23ea4e90f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.623237 31435 tablet_service.cc:1505] Processing CreateTablet for tablet 9adae0a7f8a243ad9a35cb7a2047f472 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260203 09:17:59.626806 31436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec42a05859cf4d5ebe1e1f268d01b3fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.642634 31210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4d4fa5c03a74205a7c5fdda5e37cfe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.647111 31435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9adae0a7f8a243ad9a35cb7a2047f472. 1 dirs total, 0 dirs full, 0 dirs failed
W20260203 09:17:59.652982 31171 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:17:59.652595 31431 tablet_service.cc:1505] Processing CreateTablet for tablet 15d598c8a8514ff5af7a0e48897dffa7 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260203 09:17:59.654668 31431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15d598c8a8514ff5af7a0e48897dffa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.662338 31504 tablet_bootstrap.cc:492] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:17:59.662976 31504 ts_tablet_manager.cc:1403] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.424s user 0.015s sys 0.034s
I20260203 09:17:59.686014 31438 tablet_service.cc:1505] Processing CreateTablet for tablet ee25c6a8d94e49a2a9a5646d493c1bde (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260203 09:17:59.686708 31504 raft_consensus.cc:359] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:17:59.687493 31438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee25c6a8d94e49a2a9a5646d493c1bde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.681943 31440 tablet_service.cc:1505] Processing CreateTablet for tablet e9ac7485f9224e0b9a9e95ce8b3c5654 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260203 09:17:59.688525 31440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9ac7485f9224e0b9a9e95ce8b3c5654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.688732 31214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70796ace22d548219e05b0c9a86346e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.689463 31207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d1f5b1c3b64ebaa2824e9136285fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.693070 31213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbf01f6b7a2f4b7db0978441f72e138d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.687520 31504 raft_consensus.cc:385] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:17:59.696444 31504 raft_consensus.cc:740] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:17:59.706346 31496 tablet_bootstrap.cc:492] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:17:59.706986 31496 ts_tablet_manager.cc:1403] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.334s user 0.017s sys 0.010s
I20260203 09:17:59.697404 31504 consensus_queue.cc:260] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:17:59.715802 31494 tablet_bootstrap.cc:492] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:17:59.716391 31494 ts_tablet_manager.cc:1403] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.487s user 0.011s sys 0.006s
I20260203 09:17:59.720323 31494 raft_consensus.cc:359] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:17:59.721076 31494 raft_consensus.cc:385] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:17:59.721364 31494 raft_consensus.cc:740] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:17:59.722129 31494 consensus_queue.cc:260] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:17:59.723343 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b062505fb476790c4f06d074d67aa" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:17:59.724205 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b062505fb476790c4f06d074d67aa" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:17:59.730751 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "55ce9fa640064a68a12f7f2c60a74bfd" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
W20260203 09:17:59.732823 31341 leader_election.cc:343] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:17:59.733975 31264 leader_election.cc:343] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:17:59.740675 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b92ba54a16143c08cfa7303819aa929" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:17:59.743996 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3abbec594ab143a1ade1030741cf9e7d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:17:59.745764 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "55ce9fa640064a68a12f7f2c60a74bfd" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
W20260203 09:17:59.747092 31267 leader_election.cc:343] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:17:59.747565 31267 leader_election.cc:304] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:17:59.748768 31500 raft_consensus.cc:2749] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260203 09:17:59.749821 31267 leader_election.cc:343] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:17:59.750277 31267 leader_election.cc:304] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:17:59.751313 31500 raft_consensus.cc:2749] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260203 09:17:59.753250 31416 leader_election.cc:343] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:17:59.754058 31211 tablet_service.cc:1505] Processing CreateTablet for tablet f5ccddc8d332443c97a92e59957dfa69 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260203 09:17:59.756888 31211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5ccddc8d332443c97a92e59957dfa69. 1 dirs total, 0 dirs full, 0 dirs failed
W20260203 09:17:59.772396 31341 leader_election.cc:343] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:17:59.773135 31341 leader_election.cc:304] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:17:59.775650 31502 raft_consensus.cc:2749] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:17:59.779754 31496 raft_consensus.cc:359] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:17:59.727782 31215 tablet_service.cc:1505] Processing CreateTablet for tablet 8301405e2ead406caa7440c0337df77d (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260203 09:17:59.773185 31494 ts_tablet_manager.cc:1434] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.056s user 0.007s sys 0.000s
I20260203 09:17:59.782274 31523 raft_consensus.cc:493] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:59.784636 31301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b92ba54a16143c08cfa7303819aa929" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:17:59.785779 31208 tablet_service.cc:1505] Processing CreateTablet for tablet 3eab34196fcb483abc69a625b7ca6300 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260203 09:17:59.786463 31210 tablet_service.cc:1505] Processing CreateTablet for tablet 87ac8c99d77e47c2b1a373820b27c804 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260203 09:17:59.787894 31212 tablet_service.cc:1505] Processing CreateTablet for tablet c9884e996f0443f2ae2ab5606633ce3c (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260203 09:17:59.780524 31496 raft_consensus.cc:385] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260203 09:17:59.796965 31416 leader_election.cc:343] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:17:59.794935 31215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8301405e2ead406caa7440c0337df77d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.792294 31214 tablet_service.cc:1505] Processing CreateTablet for tablet 20dfe4990e0a46ef9b0cf1cdf3dfdb09 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260203 09:17:59.806463 31416 leader_election.cc:304] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:17:59.807394 31501 raft_consensus.cc:2749] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:17:59.797299 31504 ts_tablet_manager.cc:1434] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.134s user 0.011s sys 0.002s
I20260203 09:17:59.809216 31496 raft_consensus.cc:740] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:17:59.810276 31496 consensus_queue.cc:260] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:17:59.813086 31206 tablet_service.cc:1505] Processing CreateTablet for tablet 03e1544e85d94310a17e919716a0e5b9 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260203 09:17:59.816327 31495 tablet_bootstrap.cc:492] T 2975d753fec1406eadec135c189d3ec3 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:17:59.816972 31495 ts_tablet_manager.cc:1403] T 2975d753fec1406eadec135c189d3ec3 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.485s user 0.015s sys 0.010s
I20260203 09:17:59.818878 31494 tablet_bootstrap.cc:492] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:17:59.820087 31495 raft_consensus.cc:359] T 2975d753fec1406eadec135c189d3ec3 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:17:59.821318 31495 raft_consensus.cc:385] T 2975d753fec1406eadec135c189d3ec3 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:17:59.821492 31210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87ac8c99d77e47c2b1a373820b27c804. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.823349 31214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20dfe4990e0a46ef9b0cf1cdf3dfdb09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.824935 31504 tablet_bootstrap.cc:492] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:17:59.828101 31496 ts_tablet_manager.cc:1434] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.121s user 0.001s sys 0.008s
I20260203 09:17:59.799350 31211 tablet_service.cc:1505] Processing CreateTablet for tablet 2a5ca73a494b4d7389eec90025653337 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260203 09:17:59.828320 31215 tablet_service.cc:1505] Processing CreateTablet for tablet 9f6fed7d1dca4d4184fd89b136a55ec1 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260203 09:17:59.829401 31212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9884e996f0443f2ae2ab5606633ce3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.830291 31523 raft_consensus.cc:515] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:17:59.832861 31495 raft_consensus.cc:740] T 2975d753fec1406eadec135c189d3ec3 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:17:59.833859 31495 consensus_queue.cc:260] T 2975d753fec1406eadec135c189d3ec3 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:17:59.836743 31495 ts_tablet_manager.cc:1434] T 2975d753fec1406eadec135c189d3ec3 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.019s user 0.008s sys 0.000s
I20260203 09:17:59.837252 31215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f6fed7d1dca4d4184fd89b136a55ec1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.844007 31496 tablet_bootstrap.cc:492] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:17:59.845033 31208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eab34196fcb483abc69a625b7ca6300. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.845238 31523 leader_election.cc:290] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:17:59.847412 31211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a5ca73a494b4d7389eec90025653337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.853107 31206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03e1544e85d94310a17e919716a0e5b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.855225 31213 tablet_service.cc:1505] Processing CreateTablet for tablet 06460fafee594578bed03068236ad9f2 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260203 09:17:59.857195 31495 tablet_bootstrap.cc:492] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:17:59.864104 31494 tablet_bootstrap.cc:654] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:17:59.866510 31496 tablet_bootstrap.cc:654] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:17:59.867173 31504 tablet_bootstrap.cc:654] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:17:59.874910 31209 tablet_service.cc:1505] Processing CreateTablet for tablet 4d46f012a03d4d73afb2cffe5d847486 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260203 09:17:59.885313 31207 tablet_service.cc:1505] Processing CreateTablet for tablet 2b0e416075b74212b54e341eba13fd78 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260203 09:17:59.885694 31211 tablet_service.cc:1505] Processing CreateTablet for tablet 14073202fe424a9b9a72f4c7e6075bdf (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260203 09:17:59.901373 31209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d46f012a03d4d73afb2cffe5d847486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.905236 31214 tablet_service.cc:1505] Processing CreateTablet for tablet a9e063333ea146ed9efb0110b67e9520 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260203 09:17:59.906878 31214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9e063333ea146ed9efb0110b67e9520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.931725 31502 raft_consensus.cc:493] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:17:59.940284 31502 raft_consensus.cc:515] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:17:59.940532 31210 tablet_service.cc:1505] Processing CreateTablet for tablet ec42a05859cf4d5ebe1e1f268d01b3fc (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260203 09:17:59.942211 31495 tablet_bootstrap.cc:654] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:17:59.943710 31494 tablet_bootstrap.cc:492] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:17:59.934163 31212 tablet_service.cc:1505] Processing CreateTablet for tablet 2a68c16f0da84e9683a5121f63b3f22c (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260203 09:17:59.944072 31211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14073202fe424a9b9a72f4c7e6075bdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.947652 31213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06460fafee594578bed03068236ad9f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.948737 31208 tablet_service.cc:1505] Processing CreateTablet for tablet f617ef4ccf984446b1ab7084a92efe17 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260203 09:17:59.950166 31210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec42a05859cf4d5ebe1e1f268d01b3fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.951658 31212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a68c16f0da84e9683a5121f63b3f22c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.944497 31502 leader_election.cc:290] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:17:59.954509 31504 tablet_bootstrap.cc:492] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:17:59.955255 31504 ts_tablet_manager.cc:1403] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.131s user 0.007s sys 0.021s
I20260203 09:17:59.954603 31207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b0e416075b74212b54e341eba13fd78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.969026 31208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f617ef4ccf984446b1ab7084a92efe17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.971275 31496 tablet_bootstrap.cc:492] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:17:59.971096 31209 tablet_service.cc:1505] Processing CreateTablet for tablet f94dad823fea42d2976b19da7bc7b258 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260203 09:17:59.972733 31209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f94dad823fea42d2976b19da7bc7b258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.979591 31206 tablet_service.cc:1505] Processing CreateTablet for tablet 9adae0a7f8a243ad9a35cb7a2047f472 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260203 09:17:59.981351 31504 raft_consensus.cc:359] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:17:59.982623 31494 ts_tablet_manager.cc:1403] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.164s user 0.018s sys 0.011s
I20260203 09:17:59.982381 31215 tablet_service.cc:1505] Processing CreateTablet for tablet 563e8640cca54f9cab7822a8136fb583 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260203 09:17:59.982311 31504 raft_consensus.cc:385] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:17:59.984148 31504 raft_consensus.cc:740] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:17:59.984535 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2975d753fec1406eadec135c189d3ec3" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:17:59.984936 31504 consensus_queue.cc:260] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:17:59.985805 31301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2975d753fec1406eadec135c189d3ec3" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:17:59.986464 31301 raft_consensus.cc:2468] T 2975d753fec1406eadec135c189d3ec3 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 0.
W20260203 09:17:59.987118 31341 leader_election.cc:343] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:17:59.971874 31496 ts_tablet_manager.cc:1403] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.128s user 0.019s sys 0.007s
I20260203 09:17:59.987882 31341 leader_election.cc:304] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:17:59.989215 31495 tablet_bootstrap.cc:492] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:17:59.989777 31495 ts_tablet_manager.cc:1403] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.133s user 0.012s sys 0.000s
I20260203 09:17:59.990226 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3abbec594ab143a1ade1030741cf9e7d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:17:59.991654 31301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3abbec594ab143a1ade1030741cf9e7d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
W20260203 09:17:59.992106 31191 leader_election.cc:343] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:17:59.983886 31215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563e8640cca54f9cab7822a8136fb583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:17:59.992703 31301 raft_consensus.cc:2468] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 0.
I20260203 09:17:59.993340 31504 ts_tablet_manager.cc:1434] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.038s user 0.007s sys 0.003s
I20260203 09:17:59.994556 31504 tablet_bootstrap.cc:492] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:17:59.995047 31495 raft_consensus.cc:359] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:17:59.995848 31495 raft_consensus.cc:385] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:17:59.996147 31495 raft_consensus.cc:740] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.001585 31496 raft_consensus.cc:359] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.002395 31496 raft_consensus.cc:385] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.002700 31496 raft_consensus.cc:740] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.003487 31496 consensus_queue.cc:260] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.008580 31191 leader_election.cc:304] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:00.009577 31523 raft_consensus.cc:2804] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:00.009963 31523 raft_consensus.cc:493] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:00.010295 31523 raft_consensus.cc:3060] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:00.001513 31495 consensus_queue.cc:260] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:00.010053 31206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9adae0a7f8a243ad9a35cb7a2047f472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:00.013024 31502 raft_consensus.cc:2804] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:00.013425 31502 raft_consensus.cc:493] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:00.013765 31502 raft_consensus.cc:3060] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:00.017824 31495 ts_tablet_manager.cc:1434] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.028s user 0.008s sys 0.000s
I20260203 09:18:00.019002 31495 tablet_bootstrap.cc:492] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:00.025506 31504 tablet_bootstrap.cc:654] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.027036 31502 raft_consensus.cc:515] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:00.030781 31494 raft_consensus.cc:359] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.031538 31494 raft_consensus.cc:385] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.031834 31494 raft_consensus.cc:740] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.038831 31495 tablet_bootstrap.cc:654] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.007977 31209 tablet_service.cc:1505] Processing CreateTablet for tablet 653756c5b80f438b91b3d00ce86f52bb (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260203 09:18:00.041230 31209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 653756c5b80f438b91b3d00ce86f52bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:00.045842 31523 raft_consensus.cc:515] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.046597 31215 tablet_service.cc:1505] Processing CreateTablet for tablet e9ac7485f9224e0b9a9e95ce8b3c5654 (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260203 09:18:00.048024 31215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9ac7485f9224e0b9a9e95ce8b3c5654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:00.048903 31504 tablet_bootstrap.cc:492] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:00.049494 31504 ts_tablet_manager.cc:1403] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.055s user 0.010s sys 0.005s
I20260203 09:18:00.048970 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3abbec594ab143a1ade1030741cf9e7d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:00.050374 31301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3abbec594ab143a1ade1030741cf9e7d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:00.051041 31301 raft_consensus.cc:3060] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:18:00.052870 31191 leader_election.cc:343] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:00.054109 31214 tablet_service.cc:1505] Processing CreateTablet for tablet ee25c6a8d94e49a2a9a5646d493c1bde (DEFAULT_TABLE table=test-workload [id=0196997058c94d87a92e2bec701c959e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260203 09:18:00.055382 31214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee25c6a8d94e49a2a9a5646d493c1bde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:00.055738 31504 raft_consensus.cc:359] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.061178 31504 raft_consensus.cc:385] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.062330 31301 raft_consensus.cc:2468] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:00.062812 31504 raft_consensus.cc:740] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.063660 31191 leader_election.cc:304] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:00.064301 31495 tablet_bootstrap.cc:492] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:00.064915 31495 ts_tablet_manager.cc:1403] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.046s user 0.014s sys 0.002s
I20260203 09:18:00.064750 31524 raft_consensus.cc:2804] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:00.065145 31523 leader_election.cc:290] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:00.063704 31504 consensus_queue.cc:260] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.071552 31495 raft_consensus.cc:359] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:00.072037 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2975d753fec1406eadec135c189d3ec3" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:00.072405 31495 raft_consensus.cc:385] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.072810 31495 raft_consensus.cc:740] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.073454 31502 leader_election.cc:290] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:00.073699 31495 consensus_queue.cc:260] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:00.074172 31494 consensus_queue.cc:260] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.076898 31495 ts_tablet_manager.cc:1434] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260203 09:18:00.078086 31495 tablet_bootstrap.cc:492] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
W20260203 09:18:00.080766 31341 leader_election.cc:343] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:00.081501 31523 raft_consensus.cc:493] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:00.082041 31523 raft_consensus.cc:515] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:00.083302 31301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2975d753fec1406eadec135c189d3ec3" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:00.084023 31301 raft_consensus.cc:3060] T 2975d753fec1406eadec135c189d3ec3 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:00.084296 31495 tablet_bootstrap.cc:654] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.086403 31496 ts_tablet_manager.cc:1434] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.098s user 0.001s sys 0.005s
I20260203 09:18:00.081995 31504 ts_tablet_manager.cc:1434] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.032s user 0.005s sys 0.002s
I20260203 09:18:00.092934 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b92ba54a16143c08cfa7303819aa929" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:00.093694 31450 raft_consensus.cc:2468] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 0.
I20260203 09:18:00.095356 31191 leader_election.cc:304] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:00.076514 31494 ts_tablet_manager.cc:1434] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.093s user 0.005s sys 0.001s
I20260203 09:18:00.125677 31494 tablet_bootstrap.cc:492] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:00.117210 31504 tablet_bootstrap.cc:492] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:00.128239 31496 tablet_bootstrap.cc:492] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:00.129426 31523 leader_election.cc:290] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:00.130641 31523 raft_consensus.cc:2804] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:00.131166 31523 raft_consensus.cc:493] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:00.131541 31523 raft_consensus.cc:3060] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:00.139115 31301 raft_consensus.cc:2468] T 2975d753fec1406eadec135c189d3ec3 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 1.
I20260203 09:18:00.140592 31341 leader_election.cc:304] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:00.141569 31502 raft_consensus.cc:2804] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:00.162532 31500 raft_consensus.cc:493] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:00.163219 31500 raft_consensus.cc:515] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:00.163993 31523 raft_consensus.cc:515] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:00.165635 31500 leader_election.cc:290] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:00.155611 31213 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49848 (request call id 31) took 1027 ms. Trace:
I20260203 09:18:00.166999 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "defda4c9fc6a4d0ba46ec287eb2f08d1" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
W20260203 09:18:00.172027 31191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:42099, user_credentials={real_user=slave}} blocked reactor thread for 76822.1us
I20260203 09:18:00.174278 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "defda4c9fc6a4d0ba46ec287eb2f08d1" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:00.174312 31504 tablet_bootstrap.cc:654] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.156867 31524 raft_consensus.cc:697] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:00.166451 31523 leader_election.cc:290] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:00.180051 31496 tablet_bootstrap.cc:654] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.181440 31301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b92ba54a16143c08cfa7303819aa929" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:00.181663 31495 tablet_bootstrap.cc:492] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:00.177785 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b92ba54a16143c08cfa7303819aa929" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:00.182202 31301 raft_consensus.cc:2468] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 0.
I20260203 09:18:00.182297 31495 ts_tablet_manager.cc:1403] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.104s user 0.025s sys 0.021s
W20260203 09:18:00.178900 31264 leader_election.cc:343] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:00.182147 31300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b92ba54a16143c08cfa7303819aa929" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:00.182289 31450 raft_consensus.cc:3060] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:00.183589 31300 raft_consensus.cc:3060] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:18:00.183347 31267 leader_election.cc:343] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:00.185920 31495 raft_consensus.cc:359] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.187776 31495 raft_consensus.cc:385] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.188112 31495 raft_consensus.cc:740] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.191962 31300 raft_consensus.cc:2468] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:00.166473 31213 rpcz_store.cc:276] 0203 09:17:59.124459 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:59.854304 (+729845us) service_pool.cc:225] Handling call
0203 09:17:59.931280 (+ 76976us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b580030ff98. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd0b478b1 00007f2cd0cc9db1 00007f2cd0cca3e2 00007f2cd9b9e189 00007f2cd8cf4108 00007f2cd8db6890 00007f2cd8d654c9 00007f2cd21fdbf4 00007f2cd21fdb82 00007f2cd21fdab1 00007f2cd21fda2c
0203 09:17:59.931928 (+ 648us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0203 09:17:59.936611 (+ 4683us) ts_tablet_manager.cc:682] Creating new metadata...
0203 09:17:59.968139 (+ 31528us) tablet_metadata.cc:641] Metadata flushed
0203 09:18:00.147312 (+179173us) tablet_replica.cc:206] Creating consensus instance
0203 09:18:00.151639 (+ 4327us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":13676416}
I20260203 09:18:00.193109 31523 raft_consensus.cc:493] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:00.186043 31267 leader_election.cc:304] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:00.194250 31523 raft_consensus.cc:515] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.180498 31537 raft_consensus.cc:493] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:00.195178 31537 raft_consensus.cc:515] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.194567 31495 consensus_queue.cc:260] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.199519 31500 raft_consensus.cc:493] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:00.200093 31500 raft_consensus.cc:515] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.200759 31537 leader_election.cc:290] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:00.177352 31502 raft_consensus.cc:697] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Becoming Leader. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:00.202651 31300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "420f71f998fb4c24a607beff32960d0d" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:00.204247 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "420f71f998fb4c24a607beff32960d0d" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:00.205211 31523 leader_election.cc:290] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:00.214538 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e57c5a8761da4a818b634fda6687de01" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
W20260203 09:18:00.219789 31191 leader_election.cc:343] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:00.212110 31449 raft_consensus.cc:2468] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 0.
I20260203 09:18:00.211593 31300 raft_consensus.cc:2468] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 0.
I20260203 09:18:00.221637 31341 leader_election.cc:304] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters:
I20260203 09:18:00.221757 31540 raft_consensus.cc:2749] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:00.224267 31500 leader_election.cc:290] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:00.225194 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "420f71f998fb4c24a607beff32960d0d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:00.214329 31524 consensus_queue.cc:237] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.227463 31191 leader_election.cc:304] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:00.228353 31523 raft_consensus.cc:2804] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:00.228869 31523 raft_consensus.cc:697] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:00.226356 31450 raft_consensus.cc:2468] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:00.221016 31494 tablet_bootstrap.cc:654] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.229480 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "420f71f998fb4c24a607beff32960d0d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:00.230221 31449 raft_consensus.cc:2468] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
I20260203 09:18:00.231485 31267 leader_election.cc:304] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:00.232084 31495 ts_tablet_manager.cc:1434] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.049s user 0.008s sys 0.011s
I20260203 09:18:00.225090 31502 consensus_queue.cc:237] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:00.223763 31538 raft_consensus.cc:2804] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:00.233263 31375 raft_consensus.cc:2468] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
I20260203 09:18:00.235178 31538 raft_consensus.cc:493] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:00.229669 31523 consensus_queue.cc:237] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:00.238148 31538 raft_consensus.cc:3060] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:00.240531 31495 tablet_bootstrap.cc:492] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:00.239411 31500 raft_consensus.cc:2804] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:00.243769 31496 tablet_bootstrap.cc:492] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:00.244942 31496 ts_tablet_manager.cc:1403] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.126s user 0.027s sys 0.010s
I20260203 09:18:00.247845 31496 raft_consensus.cc:359] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.244236 31500 raft_consensus.cc:493] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:00.248594 31496 raft_consensus.cc:385] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.249127 31500 raft_consensus.cc:3060] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:00.254041 31495 tablet_bootstrap.cc:654] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.257802 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e57c5a8761da4a818b634fda6687de01" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
W20260203 09:18:00.259528 31188 leader_election.cc:343] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:00.260023 31188 leader_election.cc:304] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:00.249442 31496 raft_consensus.cc:740] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.261274 31523 raft_consensus.cc:2749] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:00.261886 31494 tablet_bootstrap.cc:492] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:00.261453 31496 consensus_queue.cc:260] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.266920 31494 ts_tablet_manager.cc:1403] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.142s user 0.007s sys 0.009s
I20260203 09:18:00.273918 31496 ts_tablet_manager.cc:1434] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.029s user 0.006s sys 0.001s
I20260203 09:18:00.275260 31496 tablet_bootstrap.cc:492] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:00.277910 31494 raft_consensus.cc:359] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.281486 31494 raft_consensus.cc:385] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.281956 31494 raft_consensus.cc:740] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.282881 31494 consensus_queue.cc:260] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.281286 31500 raft_consensus.cc:515] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.265106 31538 raft_consensus.cc:515] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.281232 31504 tablet_bootstrap.cc:492] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:00.282696 31121 catalog_manager.cc:5654] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 0 to 1, leader changed from <none> to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 1 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:00.287776 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "420f71f998fb4c24a607beff32960d0d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:00.291901 31500 leader_election.cc:290] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:00.292486 31375 raft_consensus.cc:2393] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 79b10fa125f242419f66b577440e66d0 in current term 1: Already voted for candidate 73bf755165c4487c81c67b5ab44f7104 in this term.
I20260203 09:18:00.292790 31501 raft_consensus.cc:493] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:00.293077 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "420f71f998fb4c24a607beff32960d0d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:00.293260 31501 raft_consensus.cc:515] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.293671 31449 raft_consensus.cc:3060] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:00.295235 31501 leader_election.cc:290] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:00.288187 31495 tablet_bootstrap.cc:492] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:00.296276 31495 ts_tablet_manager.cc:1403] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.057s user 0.016s sys 0.014s
I20260203 09:18:00.297851 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b062505fb476790c4f06d074d67aa" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
W20260203 09:18:00.299353 31416 leader_election.cc:343] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:00.299510 31495 raft_consensus.cc:359] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.300362 31495 raft_consensus.cc:385] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.300710 31495 raft_consensus.cc:740] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.301518 31495 consensus_queue.cc:260] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.302429 31449 raft_consensus.cc:2468] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:00.288327 31538 leader_election.cc:290] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:00.301754 31122 catalog_manager.cc:5654] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67). New cstate: current_term: 1 leader_uuid: "73bf755165c4487c81c67b5ab44f7104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:00.303663 31267 leader_election.cc:304] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:00.304879 31500 raft_consensus.cc:2804] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:00.288713 31504 ts_tablet_manager.cc:1403] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.198s user 0.019s sys 0.000s
I20260203 09:18:00.290446 31300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "420f71f998fb4c24a607beff32960d0d" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:00.305598 31500 raft_consensus.cc:697] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:00.290722 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "420f71f998fb4c24a607beff32960d0d" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:00.306865 31450 raft_consensus.cc:2393] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 73bf755165c4487c81c67b5ab44f7104 in current term 1: Already voted for candidate 79b10fa125f242419f66b577440e66d0 in this term.
I20260203 09:18:00.306517 31500 consensus_queue.cc:237] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.286029 31496 tablet_bootstrap.cc:654] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.308154 31504 raft_consensus.cc:359] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:00.309197 31504 raft_consensus.cc:385] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.309530 31504 raft_consensus.cc:740] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.310354 31504 consensus_queue.cc:260] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:00.312989 31504 ts_tablet_manager.cc:1434] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20260203 09:18:00.314209 31504 tablet_bootstrap.cc:492] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:00.320356 31504 tablet_bootstrap.cc:654] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.319927 31123 catalog_manager.cc:5654] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 1 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:00.323236 31496 tablet_bootstrap.cc:492] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:00.305095 31495 ts_tablet_manager.cc:1434] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260203 09:18:00.327106 31495 tablet_bootstrap.cc:492] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:00.288668 31494 ts_tablet_manager.cc:1434] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.017s user 0.006s sys 0.001s
I20260203 09:18:00.331629 31494 tablet_bootstrap.cc:492] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:00.332993 31496 ts_tablet_manager.cc:1403] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.058s user 0.014s sys 0.006s
I20260203 09:18:00.338119 31495 tablet_bootstrap.cc:654] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.341851 31504 tablet_bootstrap.cc:492] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:00.342445 31504 ts_tablet_manager.cc:1403] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.028s user 0.014s sys 0.006s
I20260203 09:18:00.343101 31341 leader_election.cc:304] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:00.343994 31538 raft_consensus.cc:2749] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260203 09:18:00.345738 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b062505fb476790c4f06d074d67aa" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:00.346458 31375 raft_consensus.cc:2468] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 0.
I20260203 09:18:00.346436 31504 raft_consensus.cc:359] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.347115 31504 raft_consensus.cc:385] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.347370 31504 raft_consensus.cc:740] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.347664 31494 tablet_bootstrap.cc:654] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.348176 31413 leader_election.cc:304] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:00.348075 31504 consensus_queue.cc:260] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.349301 31501 raft_consensus.cc:2804] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:00.349663 31501 raft_consensus.cc:493] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:00.350000 31501 raft_consensus.cc:3060] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:00.350947 31504 ts_tablet_manager.cc:1434] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260203 09:18:00.352018 31504 tablet_bootstrap.cc:492] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:00.351722 31496 raft_consensus.cc:359] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.353380 31496 raft_consensus.cc:385] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.354000 31496 raft_consensus.cc:740] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.355863 31496 consensus_queue.cc:260] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.362174 31504 tablet_bootstrap.cc:654] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.363775 31495 tablet_bootstrap.cc:492] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:00.364344 31495 ts_tablet_manager.cc:1403] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.038s user 0.006s sys 0.005s
I20260203 09:18:00.365968 31501 raft_consensus.cc:515] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.367509 31495 raft_consensus.cc:359] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:00.377125 31495 raft_consensus.cc:385] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.377463 31495 raft_consensus.cc:740] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.378149 31495 consensus_queue.cc:260] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:00.379347 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b062505fb476790c4f06d074d67aa" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:00.379967 31375 raft_consensus.cc:3060] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:00.379870 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b062505fb476790c4f06d074d67aa" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:00.380237 31495 ts_tablet_manager.cc:1434] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.016s user 0.006s sys 0.001s
I20260203 09:18:00.380540 31225 raft_consensus.cc:3060] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:00.381415 31495 tablet_bootstrap.cc:492] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:00.381762 31122 catalog_manager.cc:5654] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 0 to 1, leader changed from <none> to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 1 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:00.371081 31504 tablet_bootstrap.cc:492] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:00.385294 31504 ts_tablet_manager.cc:1403] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.033s user 0.016s sys 0.000s
I20260203 09:18:00.387297 31494 tablet_bootstrap.cc:492] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:00.387694 31495 tablet_bootstrap.cc:654] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.387887 31494 ts_tablet_manager.cc:1403] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.057s user 0.008s sys 0.005s
I20260203 09:18:00.388150 31504 raft_consensus.cc:359] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:00.387967 31375 raft_consensus.cc:2468] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 1.
I20260203 09:18:00.391579 31504 raft_consensus.cc:385] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.391968 31504 raft_consensus.cc:740] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.392738 31504 consensus_queue.cc:260] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:00.395448 31504 ts_tablet_manager.cc:1434] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.010s user 0.007s sys 0.001s
I20260203 09:18:00.396495 31504 tablet_bootstrap.cc:492] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:00.401343 31495 tablet_bootstrap.cc:492] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:00.401919 31495 ts_tablet_manager.cc:1403] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.021s user 0.010s sys 0.000s
I20260203 09:18:00.403240 31504 tablet_bootstrap.cc:654] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.404604 31495 raft_consensus.cc:359] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.405342 31495 raft_consensus.cc:385] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.405613 31495 raft_consensus.cc:740] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.406487 31495 consensus_queue.cc:260] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.408806 31225 raft_consensus.cc:2468] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 1.
I20260203 09:18:00.409166 31495 ts_tablet_manager.cc:1434] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20260203 09:18:00.410491 31495 tablet_bootstrap.cc:492] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:00.410465 31416 leader_election.cc:304] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:00.388036 31501 leader_election.cc:290] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:00.413344 31501 raft_consensus.cc:2804] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:00.413903 31501 raft_consensus.cc:697] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:00.414806 31501 consensus_queue.cc:237] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.417320 31495 tablet_bootstrap.cc:654] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.420192 31504 tablet_bootstrap.cc:492] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:00.420939 31494 raft_consensus.cc:359] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.421720 31494 raft_consensus.cc:385] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.422021 31494 raft_consensus.cc:740] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.422453 31504 ts_tablet_manager.cc:1403] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.026s user 0.013s sys 0.005s
I20260203 09:18:00.422885 31494 consensus_queue.cc:260] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.426105 31504 raft_consensus.cc:359] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.426923 31504 raft_consensus.cc:385] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.427233 31504 raft_consensus.cc:740] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.428160 31504 consensus_queue.cc:260] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.431030 31504 ts_tablet_manager.cc:1434] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260203 09:18:00.432076 31504 tablet_bootstrap.cc:492] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:00.434235 31494 ts_tablet_manager.cc:1434] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.045s user 0.006s sys 0.000s
I20260203 09:18:00.439425 31504 tablet_bootstrap.cc:654] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.442106 31495 tablet_bootstrap.cc:492] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:00.442548 31495 ts_tablet_manager.cc:1403] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.032s user 0.007s sys 0.005s
I20260203 09:18:00.451865 31494 tablet_bootstrap.cc:492] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:00.469386 31495 raft_consensus.cc:359] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:00.470602 31495 raft_consensus.cc:385] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.471908 31495 raft_consensus.cc:740] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.472481 31496 ts_tablet_manager.cc:1434] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.139s user 0.026s sys 0.062s
I20260203 09:18:00.473018 31495 consensus_queue.cc:260] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:00.479239 31496 tablet_bootstrap.cc:492] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:00.480580 31494 tablet_bootstrap.cc:654] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.482365 31495 ts_tablet_manager.cc:1434] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.040s user 0.007s sys 0.002s
I20260203 09:18:00.482491 31504 tablet_bootstrap.cc:492] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:00.483552 31495 tablet_bootstrap.cc:492] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:00.483916 31504 ts_tablet_manager.cc:1403] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.052s user 0.017s sys 0.009s
I20260203 09:18:00.487201 31504 raft_consensus.cc:359] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:00.488178 31504 raft_consensus.cc:385] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.488566 31504 raft_consensus.cc:740] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.488948 31500 raft_consensus.cc:493] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:00.489507 31504 consensus_queue.cc:260] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:00.489540 31500 raft_consensus.cc:515] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.492704 31504 ts_tablet_manager.cc:1434] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.008s user 0.003s sys 0.003s
I20260203 09:18:00.492882 31500 leader_election.cc:290] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:00.494616 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a8fd0dd8dc8d432b8e8bb19f4f3448cc" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
W20260203 09:18:00.496913 31267 leader_election.cc:343] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:00.494592 31504 tablet_bootstrap.cc:492] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:00.499665 31495 tablet_bootstrap.cc:654] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.505136 31494 tablet_bootstrap.cc:492] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:00.505199 31504 tablet_bootstrap.cc:654] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.505822 31494 ts_tablet_manager.cc:1403] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.063s user 0.015s sys 0.016s
I20260203 09:18:00.496451 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a8fd0dd8dc8d432b8e8bb19f4f3448cc" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
W20260203 09:18:00.507596 31264 leader_election.cc:343] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:00.508075 31264 leader_election.cc:304] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:00.509431 31500 raft_consensus.cc:2749] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:00.509177 31494 raft_consensus.cc:359] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.510126 31494 raft_consensus.cc:385] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.510469 31494 raft_consensus.cc:740] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.511332 31494 consensus_queue.cc:260] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.512272 31495 tablet_bootstrap.cc:492] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:00.512840 31495 ts_tablet_manager.cc:1403] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.030s user 0.008s sys 0.007s
I20260203 09:18:00.514326 31494 ts_tablet_manager.cc:1434] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260203 09:18:00.515681 31494 tablet_bootstrap.cc:492] T e57c5a8761da4a818b634fda6687de01 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:00.516049 31495 raft_consensus.cc:359] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:00.516917 31495 raft_consensus.cc:385] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.517231 31495 raft_consensus.cc:740] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.518110 31496 tablet_bootstrap.cc:654] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.520592 31495 consensus_queue.cc:260] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:00.529423 31500 raft_consensus.cc:493] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:00.530272 31500 raft_consensus.cc:515] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:00.594815 31559 raft_consensus.cc:493] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:00.595618 31559 raft_consensus.cc:515] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.596565 31500 leader_election.cc:290] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:00.596755 31495 ts_tablet_manager.cc:1434] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.084s user 0.004s sys 0.003s
I20260203 09:18:00.598152 31495 tablet_bootstrap.cc:492] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:00.598157 31559 leader_election.cc:290] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:00.602550 31504 tablet_bootstrap.cc:492] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:00.603143 31504 ts_tablet_manager.cc:1403] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.109s user 0.006s sys 0.007s
I20260203 09:18:00.604137 31496 tablet_bootstrap.cc:492] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:00.604696 31496 ts_tablet_manager.cc:1403] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.126s user 0.011s sys 0.007s
I20260203 09:18:00.605379 31495 tablet_bootstrap.cc:654] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.606056 31504 raft_consensus.cc:359] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:00.606808 31504 raft_consensus.cc:385] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.607107 31504 raft_consensus.cc:740] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.523306 31494 tablet_bootstrap.cc:654] T e57c5a8761da4a818b634fda6687de01 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.607580 31496 raft_consensus.cc:359] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.608353 31496 raft_consensus.cc:385] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.608852 31496 raft_consensus.cc:740] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.615217 31496 consensus_queue.cc:260] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.618268 31496 ts_tablet_manager.cc:1434] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20260203 09:18:00.619491 31496 tablet_bootstrap.cc:492] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:00.625778 31495 tablet_bootstrap.cc:492] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:00.626464 31495 ts_tablet_manager.cc:1403] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.029s user 0.016s sys 0.001s
I20260203 09:18:00.630681 31496 tablet_bootstrap.cc:654] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.632273 31500 raft_consensus.cc:493] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:00.632812 31500 raft_consensus.cc:515] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.634874 31500 leader_election.cc:290] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:00.631582 31495 raft_consensus.cc:359] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:00.635865 31495 raft_consensus.cc:385] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.636240 31495 raft_consensus.cc:740] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.637053 31495 consensus_queue.cc:260] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:00.640004 31495 ts_tablet_manager.cc:1434] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20260203 09:18:00.641234 31495 tablet_bootstrap.cc:492] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:00.648274 31495 tablet_bootstrap.cc:654] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.667963 31559 raft_consensus.cc:493] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:00.668589 31559 raft_consensus.cc:515] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.670778 31559 leader_election.cc:290] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:00.607753 31504 consensus_queue.cc:260] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:00.843806 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e57c5a8761da4a818b634fda6687de01" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:00.844309 31504 ts_tablet_manager.cc:1434] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.241s user 0.008s sys 0.001s
I20260203 09:18:00.844550 31225 raft_consensus.cc:2468] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 0.
I20260203 09:18:00.845369 31504 tablet_bootstrap.cc:492] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:00.847159 31575 raft_consensus.cc:493] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:00.847683 31575 raft_consensus.cc:515] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:00.849498 31575 leader_election.cc:290] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:00.852023 31504 tablet_bootstrap.cc:654] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.856860 31494 tablet_bootstrap.cc:492] T e57c5a8761da4a818b634fda6687de01 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:00.857547 31504 tablet_bootstrap.cc:492] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:00.857576 31494 ts_tablet_manager.cc:1403] T e57c5a8761da4a818b634fda6687de01 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.342s user 0.033s sys 0.028s
I20260203 09:18:00.858209 31504 ts_tablet_manager.cc:1403] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.008s
I20260203 09:18:00.860983 31504 raft_consensus.cc:359] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:00.861588 31504 raft_consensus.cc:385] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.861263 31494 raft_consensus.cc:359] T e57c5a8761da4a818b634fda6687de01 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.861871 31504 raft_consensus.cc:740] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.862061 31494 raft_consensus.cc:385] T e57c5a8761da4a818b634fda6687de01 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.862413 31494 raft_consensus.cc:740] T e57c5a8761da4a818b634fda6687de01 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.862460 31504 consensus_queue.cc:260] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:00.863247 31494 consensus_queue.cc:260] T e57c5a8761da4a818b634fda6687de01 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.864804 31504 ts_tablet_manager.cc:1434] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260203 09:18:00.865787 31504 tablet_bootstrap.cc:492] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:00.865953 31494 ts_tablet_manager.cc:1434] T e57c5a8761da4a818b634fda6687de01 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260203 09:18:00.866772 31494 tablet_bootstrap.cc:492] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:00.868820 31575 raft_consensus.cc:493] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:00.869374 31575 raft_consensus.cc:515] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:00.871392 31575 leader_election.cc:290] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:00.871906 31504 tablet_bootstrap.cc:654] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.876240 31494 tablet_bootstrap.cc:654] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.876752 31504 tablet_bootstrap.cc:492] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:00.877264 31575 raft_consensus.cc:493] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:00.877869 31575 raft_consensus.cc:515] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:00.879805 31575 leader_election.cc:290] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:00.877267 31504 ts_tablet_manager.cc:1403] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260203 09:18:00.883736 31504 raft_consensus.cc:359] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:00.884145 31494 tablet_bootstrap.cc:492] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:00.884321 31504 raft_consensus.cc:385] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.884735 31494 ts_tablet_manager.cc:1403] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.003s
I20260203 09:18:00.884720 31504 raft_consensus.cc:740] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.885555 31504 consensus_queue.cc:260] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:00.887027 31494 raft_consensus.cc:359] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.887522 31494 raft_consensus.cc:385] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.887723 31494 raft_consensus.cc:740] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.887976 31504 ts_tablet_manager.cc:1434] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260203 09:18:00.888283 31494 consensus_queue.cc:260] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.889084 31504 tablet_bootstrap.cc:492] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:00.893138 31538 raft_consensus.cc:493] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:00.893690 31538 raft_consensus.cc:515] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.895816 31538 leader_election.cc:290] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:00.895965 31504 tablet_bootstrap.cc:654] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.899547 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "afe2065ab01641aa86dc384050ab810a" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:00.900399 31500 raft_consensus.cc:493] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:00.901008 31500 raft_consensus.cc:515] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:00.901314 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc8de34393ac472590f28a52d1bf55ff" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:00.902827 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e57c5a8761da4a818b634fda6687de01" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:00.903489 31375 raft_consensus.cc:2468] T e57c5a8761da4a818b634fda6687de01 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 0.
I20260203 09:18:00.904927 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "55ce9fa640064a68a12f7f2c60a74bfd" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:00.905576 31375 raft_consensus.cc:2468] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 0.
W20260203 09:18:00.906649 31264 leader_election.cc:343] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:18:00.907655 31264 leader_election.cc:343] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:00.911183 31504 tablet_bootstrap.cc:492] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:00.911713 31504 ts_tablet_manager.cc:1403] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.023s user 0.008s sys 0.008s
I20260203 09:18:00.903105 31500 leader_election.cc:290] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:00.896394 31538 raft_consensus.cc:493] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:00.913409 31538 raft_consensus.cc:515] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.914535 31504 raft_consensus.cc:359] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:00.907541 31496 tablet_bootstrap.cc:492] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:00.915416 31575 raft_consensus.cc:493] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:00.923823 31496 ts_tablet_manager.cc:1403] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.305s user 0.022s sys 0.003s
I20260203 09:18:00.923714 31575 raft_consensus.cc:515] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.925817 31575 leader_election.cc:290] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:00.915244 31504 raft_consensus.cc:385] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:00.926468 31504 raft_consensus.cc:740] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.928284 31502 raft_consensus.cc:493] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:00.928828 31502 raft_consensus.cc:515] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:00.930754 31502 leader_election.cc:290] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:00.928283 31504 consensus_queue.cc:260] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:00.931903 31500 consensus_queue.cc:1048] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:00.933437 31504 ts_tablet_manager.cc:1434] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.021s user 0.007s sys 0.001s
I20260203 09:18:00.934413 31504 tablet_bootstrap.cc:492] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:00.936023 31501 raft_consensus.cc:493] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:00.936518 31501 raft_consensus.cc:515] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.938585 31501 leader_election.cc:290] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:00.940534 31504 tablet_bootstrap.cc:654] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:00.941491 31416 leader_election.cc:304] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:00.944406 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc8de34393ac472590f28a52d1bf55ff" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:00.946604 31500 raft_consensus.cc:493] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:00.947225 31500 raft_consensus.cc:515] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:00.948482 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14fd7c3d313847f591177ebba8df09c4" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:00.949184 31500 leader_election.cc:290] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:00.954962 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3abbec594ab143a1ade1030741cf9e7d" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
W20260203 09:18:00.957516 31267 leader_election.cc:343] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:00.957679 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "55ce9fa640064a68a12f7f2c60a74bfd" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:00.958069 31267 leader_election.cc:304] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:00.958495 31299 raft_consensus.cc:2468] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 0.
I20260203 09:18:00.959069 31500 raft_consensus.cc:2749] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:00.959757 31501 raft_consensus.cc:2804] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:00.964517 31224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14fd7c3d313847f591177ebba8df09c4" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:00.966032 31501 raft_consensus.cc:493] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:00.966125 31224 raft_consensus.cc:2468] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
I20260203 09:18:00.965010 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
W20260203 09:18:00.966883 31171 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:18:00.964522 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "730e665d69354cad93df20607e256d58" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:00.967264 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "afe2065ab01641aa86dc384050ab810a" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:00.967916 31225 raft_consensus.cc:2468] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
I20260203 09:18:00.966619 31501 raft_consensus.cc:3060] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:18:00.969339 31188 leader_election.cc:343] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:18:00.970024 31188 leader_election.cc:343] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:00.975658 31501 raft_consensus.cc:515] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:00.977842 31300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "730e665d69354cad93df20607e256d58" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:00.979203 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14fd7c3d313847f591177ebba8df09c4" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:00.979653 31446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:00.979929 31299 raft_consensus.cc:2468] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 0.
I20260203 09:18:00.981326 31297 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:00.981976 31297 raft_consensus.cc:2468] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 0.
I20260203 09:18:00.982357 31501 leader_election.cc:290] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:00.982631 31449 raft_consensus.cc:3060] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:00.983752 31267 leader_election.cc:304] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:00.984814 31267 leader_election.cc:304] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:00.985251 31447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14fd7c3d313847f591177ebba8df09c4" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:00.959636 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3abbec594ab143a1ade1030741cf9e7d" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:00.987121 31298 raft_consensus.cc:2393] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bf9aa3533b14841a52177c8cc3130ec in current term 1: Already voted for candidate d44c40c0ed244c4e962a26f9aebea76a in this term.
I20260203 09:18:00.988098 31301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03943e5b830f4ab4be9fe0b4e0ca4697" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:00.989161 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92861fb258ec44228e1c191bee2fee0b" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:00.989620 31224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:00.990551 31224 raft_consensus.cc:2468] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 0.
I20260203 09:18:00.992200 31224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e57c5a8761da4a818b634fda6687de01" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:00.992805 31224 raft_consensus.cc:3060] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:00.993932 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c17aa1880254f13a38a3c550b0894af" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
W20260203 09:18:00.995986 31191 leader_election.cc:343] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:00.997398 31223 raft_consensus.cc:3060] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:00.998008 31372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:00.998733 31372 raft_consensus.cc:2468] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 0.
I20260203 09:18:01.002063 31504 tablet_bootstrap.cc:492] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:01.002566 31504 ts_tablet_manager.cc:1403] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.068s user 0.027s sys 0.029s
I20260203 09:18:00.992223 31416 leader_election.cc:304] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:01.005683 31416 leader_election.cc:304] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:00.993096 31447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92861fb258ec44228e1c191bee2fee0b" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:01.007877 31524 consensus_queue.cc:1048] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:01.008298 31559 raft_consensus.cc:2804] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:01.008893 31559 raft_consensus.cc:493] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:01.009338 31559 raft_consensus.cc:3060] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.009735 31504 raft_consensus.cc:359] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:01.010555 31504 raft_consensus.cc:385] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.010855 31504 raft_consensus.cc:740] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.008091 31224 raft_consensus.cc:2468] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 1.
I20260203 09:18:01.011044 31445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:01.012404 31446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c17aa1880254f13a38a3c550b0894af" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:01.013574 31416 leader_election.cc:304] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:01.010368 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03943e5b830f4ab4be9fe0b4e0ca4697" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:00.992399 31500 raft_consensus.cc:2804] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:01.014330 31500 raft_consensus.cc:493] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:01.014719 31500 raft_consensus.cc:3060] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.016108 31504 consensus_queue.cc:260] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:01.018254 31504 ts_tablet_manager.cc:1434] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20260203 09:18:01.019197 31504 tablet_bootstrap.cc:492] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
W20260203 09:18:01.020707 31188 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.26.232.126:40067, user_credentials={real_user=slave}} blocked reactor thread for 50102.1us
I20260203 09:18:01.027511 31559 raft_consensus.cc:515] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:01.029084 31524 raft_consensus.cc:493] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:01.029651 31524 raft_consensus.cc:515] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
W20260203 09:18:01.029909 31341 leader_election.cc:343] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:18:01.030998 31341 leader_election.cc:343] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:18:01.031757 31341 leader_election.cc:343] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:01.031854 31524 leader_election.cc:290] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:00.992866 31225 raft_consensus.cc:2468] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
I20260203 09:18:01.034583 31372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e57c5a8761da4a818b634fda6687de01" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:01.035279 31372 raft_consensus.cc:3060] T e57c5a8761da4a818b634fda6687de01 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.036383 31188 leader_election.cc:304] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:01.037849 31586 raft_consensus.cc:2804] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:01.038290 31586 raft_consensus.cc:493] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:01.038676 31586 raft_consensus.cc:3060] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.034885 31524 consensus_queue.cc:1048] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:00.917809 31538 leader_election.cc:290] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:01.041049 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "defda4c9fc6a4d0ba46ec287eb2f08d1" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:00.927842 31496 raft_consensus.cc:359] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:01.044513 31496 raft_consensus.cc:385] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.044885 31496 raft_consensus.cc:740] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:00.990476 31501 consensus_queue.cc:1048] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:01.046803 31501 raft_consensus.cc:2804] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:01.047397 31501 raft_consensus.cc:697] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:01.050284 31501 consensus_queue.cc:237] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:01.048243 31341 leader_election.cc:304] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec
W20260203 09:18:01.048695 31267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:45511, user_credentials={real_user=slave}} blocked reactor thread for 63973.8us
I20260203 09:18:01.051833 31500 raft_consensus.cc:515] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
W20260203 09:18:01.056015 31267 leader_election.cc:343] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:01.049350 31559 leader_election.cc:290] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:01.044190 31372 raft_consensus.cc:2468] T e57c5a8761da4a818b634fda6687de01 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 1.
I20260203 09:18:01.049331 31496 consensus_queue.cc:260] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:01.047930 31587 raft_consensus.cc:2804] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:01.059489 31538 raft_consensus.cc:2804] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:01.059544 31587 raft_consensus.cc:493] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:01.060215 31301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "55ce9fa640064a68a12f7f2c60a74bfd" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:01.059893 31448 raft_consensus.cc:2468] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
I20260203 09:18:01.060601 31587 raft_consensus.cc:3060] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.060983 31301 raft_consensus.cc:3060] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.034605 31504 tablet_bootstrap.cc:654] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
W20260203 09:18:01.056725 31191 leader_election.cc:343] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:01.059934 31538 raft_consensus.cc:493] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:01.052032 31586 raft_consensus.cc:515] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:01.065445 31494 ts_tablet_manager.cc:1434] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.180s user 0.041s sys 0.030s
I20260203 09:18:01.069473 31494 tablet_bootstrap.cc:492] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:01.070060 31594 consensus_queue.cc:1048] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:01.070395 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "defda4c9fc6a4d0ba46ec287eb2f08d1" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:01.071101 31299 raft_consensus.cc:2468] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 0.
I20260203 09:18:01.068087 31538 raft_consensus.cc:3060] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.071971 31267 leader_election.cc:304] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:01.073455 31500 leader_election.cc:290] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:01.077983 31495 tablet_bootstrap.cc:492] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:01.078542 31495 ts_tablet_manager.cc:1403] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.438s user 0.017s sys 0.000s
I20260203 09:18:01.074245 31191 leader_election.cc:304] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:01.080528 31191 leader_election.cc:304] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:01.081684 31191 leader_election.cc:304] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:01.076334 31594 raft_consensus.cc:2804] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260203 09:18:01.083959 31188 leader_election.cc:343] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:01.087021 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14fd7c3d313847f591177ebba8df09c4" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:01.084502 31524 raft_consensus.cc:2804] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:01.083779 31575 raft_consensus.cc:2749] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:01.088332 31594 raft_consensus.cc:493] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:01.092036 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14fd7c3d313847f591177ebba8df09c4" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:01.092074 31594 raft_consensus.cc:3060] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.092257 31575 raft_consensus.cc:2804] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:01.093044 31575 raft_consensus.cc:493] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:01.088070 31524 raft_consensus.cc:493] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:01.093449 31575 raft_consensus.cc:3060] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.093792 31524 raft_consensus.cc:3060] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.091161 31587 raft_consensus.cc:515] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:01.098176 31496 ts_tablet_manager.cc:1434] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.174s user 0.008s sys 0.001s
I20260203 09:18:01.098675 31587 leader_election.cc:290] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:01.099424 31496 tablet_bootstrap.cc:492] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:01.099459 31224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "afe2065ab01641aa86dc384050ab810a" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:01.100409 31224 raft_consensus.cc:3060] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.091156 31301 raft_consensus.cc:2468] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 1.
I20260203 09:18:01.102830 31123 catalog_manager.cc:5654] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 1 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } }
W20260203 09:18:01.084985 31341 leader_election.cc:343] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:01.106237 31495 raft_consensus.cc:359] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:01.107393 31495 raft_consensus.cc:385] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.107614 31495 raft_consensus.cc:740] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.108148 31495 consensus_queue.cc:260] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:01.109133 31341 leader_election.cc:304] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
W20260203 09:18:01.129330 31341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:45511, user_credentials={real_user=slave}} blocked reactor thread for 45914.8us
I20260203 09:18:01.129923 31575 raft_consensus.cc:515] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
W20260203 09:18:01.130637 31341 leader_election.cc:343] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:01.131078 31341 leader_election.cc:304] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:01.124148 31494 tablet_bootstrap.cc:654] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.126868 31586 leader_election.cc:290] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:01.127918 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:01.132558 31495 ts_tablet_manager.cc:1434] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.054s user 0.006s sys 0.000s
I20260203 09:18:01.139039 31495 tablet_bootstrap.cc:492] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:01.136845 31502 consensus_queue.cc:1048] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:01.106580 31594 raft_consensus.cc:515] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
W20260203 09:18:01.144114 31191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:45019, user_credentials={real_user=slave}} blocked reactor thread for 62519.3us
I20260203 09:18:01.144325 31580 raft_consensus.cc:2749] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:01.145221 31580 raft_consensus.cc:2749] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:01.145290 31586 consensus_queue.cc:1048] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:01.145689 31191 leader_election.cc:304] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:01.146679 31586 consensus_queue.cc:1048] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:01.147902 31586 raft_consensus.cc:2804] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:01.148200 31586 raft_consensus.cc:493] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:01.148483 31586 raft_consensus.cc:3060] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.160452 31501 consensus_queue.cc:1048] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:01.169616 31594 leader_election.cc:290] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:01.173305 31588 raft_consensus.cc:2749] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:01.177047 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92861fb258ec44228e1c191bee2fee0b" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:01.177393 31372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:01.177762 31223 raft_consensus.cc:3060] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.180334 31586 raft_consensus.cc:515] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:01.182030 31504 tablet_bootstrap.cc:492] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:01.182546 31504 ts_tablet_manager.cc:1403] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.164s user 0.016s sys 0.022s
I20260203 09:18:01.156327 31575 leader_election.cc:290] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:01.144158 31579 consensus_queue.cc:1048] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260203 09:18:01.195156 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "55ce9fa640064a68a12f7f2c60a74bfd" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:01.197016 31374 raft_consensus.cc:3060] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.198388 31224 raft_consensus.cc:2468] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:01.199303 31524 raft_consensus.cc:515] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:01.200464 31225 raft_consensus.cc:2393] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 79b10fa125f242419f66b577440e66d0 in current term 1: Already voted for candidate d44c40c0ed244c4e962a26f9aebea76a in this term.
I20260203 09:18:01.200202 31538 raft_consensus.cc:515] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:01.202092 31538 leader_election.cc:290] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:01.202046 31524 leader_election.cc:290] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:01.202613 31372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "afe2065ab01641aa86dc384050ab810a" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:01.205926 31375 raft_consensus.cc:2393] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d44c40c0ed244c4e962a26f9aebea76a in current term 1: Already voted for candidate 73bf755165c4487c81c67b5ab44f7104 in this term.
W20260203 09:18:01.206091 31188 leader_election.cc:343] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:01.206918 31372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "defda4c9fc6a4d0ba46ec287eb2f08d1" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:01.207116 31267 leader_election.cc:304] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:01.208105 31267 leader_election.cc:304] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
W20260203 09:18:01.208348 31188 leader_election.cc:343] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:01.158161 31416 leader_election.cc:304] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:01.210196 31587 raft_consensus.cc:2749] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260203 09:18:01.210804 31594 raft_consensus.cc:2804] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:01.211289 31594 raft_consensus.cc:697] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:01.212141 31594 consensus_queue.cc:237] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:01.214609 31223 raft_consensus.cc:2468] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:01.217159 31504 raft_consensus.cc:359] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:01.218009 31504 raft_consensus.cc:385] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.218991 31504 raft_consensus.cc:740] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.220490 31504 consensus_queue.cc:260] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:01.224213 31504 ts_tablet_manager.cc:1434] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.041s user 0.008s sys 0.000s
I20260203 09:18:01.225342 31504 tablet_bootstrap.cc:492] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:01.222597 31267 leader_election.cc:304] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:01.229667 31587 raft_consensus.cc:2804] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:01.230208 31587 raft_consensus.cc:697] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
W20260203 09:18:01.189152 31191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:45019, user_credentials={real_user=slave}} blocked reactor thread for 43562.2us
I20260203 09:18:01.218632 31524 raft_consensus.cc:493] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:01.239523 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:01.239889 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
W20260203 09:18:01.222970 31416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:45019, user_credentials={real_user=slave}} blocked reactor thread for 79687.8us
I20260203 09:18:01.232554 31559 raft_consensus.cc:2804] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:01.234409 31586 leader_election.cc:290] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
W20260203 09:18:01.246210 31264 leader_election.cc:343] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:01.247792 31559 raft_consensus.cc:697] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:01.249313 31495 tablet_bootstrap.cc:654] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.249186 31559 consensus_queue.cc:237] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:01.251827 31504 tablet_bootstrap.cc:654] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.231098 31587 consensus_queue.cc:237] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:01.257157 31496 tablet_bootstrap.cc:654] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.261451 31374 raft_consensus.cc:2468] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 1.
I20260203 09:18:01.241508 31524 raft_consensus.cc:515] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
W20260203 09:18:01.274776 31341 leader_election.cc:343] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:18:01.263896 31191 leader_election.cc:343] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:01.285039 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:01.285817 31299 raft_consensus.cc:3060] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.277299 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14fd7c3d313847f591177ebba8df09c4" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:01.292340 31494 tablet_bootstrap.cc:492] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:01.292994 31494 ts_tablet_manager.cc:1403] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.224s user 0.022s sys 0.030s
I20260203 09:18:01.302058 31450 raft_consensus.cc:3060] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.316471 31494 raft_consensus.cc:359] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:01.317407 31494 raft_consensus.cc:385] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.317685 31494 raft_consensus.cc:740] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.318470 31494 consensus_queue.cc:260] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:01.324275 31494 ts_tablet_manager.cc:1434] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.031s user 0.006s sys 0.001s
I20260203 09:18:01.287304 31191 leader_election.cc:304] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:01.333324 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92861fb258ec44228e1c191bee2fee0b" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:01.335090 31502 raft_consensus.cc:493] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:01.339179 31494 tablet_bootstrap.cc:492] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:01.337981 31300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14fd7c3d313847f591177ebba8df09c4" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:01.349244 31602 raft_consensus.cc:2749] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260203 09:18:01.349650 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "defda4c9fc6a4d0ba46ec287eb2f08d1" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:01.350838 31300 raft_consensus.cc:2393] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d44c40c0ed244c4e962a26f9aebea76a in current term 1: Already voted for candidate 79b10fa125f242419f66b577440e66d0 in this term.
I20260203 09:18:01.338776 31524 leader_election.cc:290] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:01.351092 31296 raft_consensus.cc:3060] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.352698 31496 tablet_bootstrap.cc:492] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:01.353322 31496 ts_tablet_manager.cc:1403] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.254s user 0.027s sys 0.009s
I20260203 09:18:01.356042 31496 raft_consensus.cc:359] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:01.343041 31502 raft_consensus.cc:515] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
W20260203 09:18:01.361228 31608 log.cc:927] Time spent T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0: Append to log took a long time: real 0.059s user 0.001s sys 0.000s
I20260203 09:18:01.364835 31496 raft_consensus.cc:385] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260203 09:18:01.338294 31191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:42099, user_credentials={real_user=slave}} blocked reactor thread for 83108.5us
I20260203 09:18:01.369886 31496 raft_consensus.cc:740] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.370867 31496 consensus_queue.cc:260] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:01.374833 31502 leader_election.cc:290] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
W20260203 09:18:01.376926 31267 leader_election.cc:343] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:01.377115 31300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "afe2065ab01641aa86dc384050ab810a" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:01.386555 31496 ts_tablet_manager.cc:1434] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.033s user 0.006s sys 0.001s
I20260203 09:18:01.388012 31496 tablet_bootstrap.cc:492] T 92861fb258ec44228e1c191bee2fee0b P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:01.396034 31504 tablet_bootstrap.cc:492] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:01.396585 31504 ts_tablet_manager.cc:1403] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.171s user 0.013s sys 0.007s
I20260203 09:18:01.402882 31504 raft_consensus.cc:359] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:01.403649 31504 raft_consensus.cc:385] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.403931 31504 raft_consensus.cc:740] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.404592 31504 consensus_queue.cc:260] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:01.410204 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:01.411049 31225 raft_consensus.cc:2393] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 73bf755165c4487c81c67b5ab44f7104 in current term 1: Already voted for candidate d44c40c0ed244c4e962a26f9aebea76a in this term.
I20260203 09:18:01.411391 31222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "afe2065ab01641aa86dc384050ab810a" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:01.411895 31297 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c2f90aaa7514d27a5a15b4fd6f90669" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:01.412545 31297 raft_consensus.cc:2468] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 0.
I20260203 09:18:01.412231 31222 raft_consensus.cc:2393] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73bf755165c4487c81c67b5ab44f7104 in current term 1: Already voted for candidate 79b10fa125f242419f66b577440e66d0 in this term.
I20260203 09:18:01.415356 31123 catalog_manager.cc:5654] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 1 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:01.416874 31504 ts_tablet_manager.cc:1434] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.020s user 0.005s sys 0.002s
W20260203 09:18:01.418121 31611 log.cc:927] Time spent T 2975d753fec1406eadec135c189d3ec3 P 79b10fa125f242419f66b577440e66d0: Append to log took a long time: real 0.082s user 0.001s sys 0.000s
I20260203 09:18:01.418463 31495 tablet_bootstrap.cc:492] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:01.418936 31495 ts_tablet_manager.cc:1403] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.280s user 0.015s sys 0.006s
I20260203 09:18:01.422953 31504 tablet_bootstrap.cc:492] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:01.427359 31495 raft_consensus.cc:359] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:01.412724 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c2f90aaa7514d27a5a15b4fd6f90669" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:01.429610 31191 leader_election.cc:304] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:01.430884 31341 leader_election.cc:304] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:01.435423 31299 raft_consensus.cc:2468] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:01.439352 31495 raft_consensus.cc:385] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.437072 31504 tablet_bootstrap.cc:654] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.434433 31123 catalog_manager.cc:5654] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 1 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:01.416301 31450 raft_consensus.cc:2468] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:01.439725 31495 raft_consensus.cc:740] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.446792 31495 consensus_queue.cc:260] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:01.448419 31494 tablet_bootstrap.cc:654] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.455585 31586 raft_consensus.cc:2804] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:01.456053 31586 raft_consensus.cc:493] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:01.456400 31586 raft_consensus.cc:3060] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.457039 31587 raft_consensus.cc:493] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:01.457536 31587 raft_consensus.cc:515] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:01.459502 31587 leader_election.cc:290] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:01.469952 31495 ts_tablet_manager.cc:1434] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.051s user 0.005s sys 0.003s
I20260203 09:18:01.471374 31495 tablet_bootstrap.cc:492] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:01.482906 31559 raft_consensus.cc:493] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:01.452988 31579 raft_consensus.cc:2749] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260203 09:18:01.483503 31559 raft_consensus.cc:515] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:01.485656 31559 leader_election.cc:290] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:01.486164 31341 leader_election.cc:304] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:01.486315 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03943e5b830f4ab4be9fe0b4e0ca4697" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:01.487197 31579 raft_consensus.cc:3060] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:18:01.491044 31267 leader_election.cc:343] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:18:01.493388 31622 log.cc:927] Time spent T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
I20260203 09:18:01.504078 31496 tablet_bootstrap.cc:654] T 92861fb258ec44228e1c191bee2fee0b P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.512243 31372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc8de34393ac472590f28a52d1bf55ff" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:01.513861 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc8de34393ac472590f28a52d1bf55ff" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:01.514038 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03943e5b830f4ab4be9fe0b4e0ca4697" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
W20260203 09:18:01.514904 31413 leader_election.cc:343] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:01.440104 31296 raft_consensus.cc:2468] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:01.513043 31120 catalog_manager.cc:5654] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 1 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } }
W20260203 09:18:01.521968 31191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.68:42099, user_credentials={real_user=slave}} blocked reactor thread for 58836us
I20260203 09:18:01.519282 31374 raft_consensus.cc:2468] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
W20260203 09:18:01.545172 31191 leader_election.cc:343] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:01.519274 31299 raft_consensus.cc:2468] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 0.
I20260203 09:18:01.546308 31191 leader_election.cc:304] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters: 79b10fa125f242419f66b577440e66d0
I20260203 09:18:01.546607 31416 leader_election.cc:304] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:01.547223 31524 raft_consensus.cc:2804] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:01.547695 31524 raft_consensus.cc:697] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:01.547845 31588 raft_consensus.cc:2804] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:01.548365 31588 raft_consensus.cc:493] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:01.548770 31588 raft_consensus.cc:3060] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.549012 31524 consensus_queue.cc:237] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:01.551748 31579 raft_consensus.cc:2749] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:01.554559 31494 tablet_bootstrap.cc:492] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:01.554966 31494 ts_tablet_manager.cc:1403] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.216s user 0.010s sys 0.015s
I20260203 09:18:01.558923 31589 consensus_queue.cc:1048] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260203 09:18:01.574934 31264 leader_election.cc:304] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:01.553071 31586 raft_consensus.cc:515] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:01.576889 31587 raft_consensus.cc:2804] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:01.577294 31587 raft_consensus.cc:493] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:01.577607 31587 raft_consensus.cc:3060] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.577800 31586 leader_election.cc:290] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:01.559082 31120 catalog_manager.cc:5654] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 1 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:01.547876 31191 leader_election.cc:304] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:01.583097 31494 raft_consensus.cc:359] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:01.584529 31494 raft_consensus.cc:385] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.584895 31494 raft_consensus.cc:740] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.585544 31494 consensus_queue.cc:260] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:01.591274 31496 tablet_bootstrap.cc:492] T 92861fb258ec44228e1c191bee2fee0b P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:01.591830 31496 ts_tablet_manager.cc:1403] T 92861fb258ec44228e1c191bee2fee0b P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.204s user 0.035s sys 0.010s
I20260203 09:18:01.594537 31496 raft_consensus.cc:359] T 92861fb258ec44228e1c191bee2fee0b P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:01.595278 31496 raft_consensus.cc:385] T 92861fb258ec44228e1c191bee2fee0b P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.595563 31496 raft_consensus.cc:740] T 92861fb258ec44228e1c191bee2fee0b P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.596293 31496 consensus_queue.cc:260] T 92861fb258ec44228e1c191bee2fee0b P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:01.598716 31496 ts_tablet_manager.cc:1434] T 92861fb258ec44228e1c191bee2fee0b P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260203 09:18:01.599649 31496 tablet_bootstrap.cc:492] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:01.599834 31495 tablet_bootstrap.cc:654] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.601300 31628 raft_consensus.cc:2804] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:01.601863 31628 raft_consensus.cc:697] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:01.603214 31504 tablet_bootstrap.cc:492] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:01.603780 31504 ts_tablet_manager.cc:1403] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.181s user 0.016s sys 0.021s
I20260203 09:18:01.605261 31496 tablet_bootstrap.cc:654] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.607465 31587 raft_consensus.cc:515] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:01.609620 31587 leader_election.cc:290] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:01.610368 31372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03943e5b830f4ab4be9fe0b4e0ca4697" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:01.607491 31504 raft_consensus.cc:359] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:01.610657 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03943e5b830f4ab4be9fe0b4e0ca4697" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:01.611101 31372 raft_consensus.cc:3060] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.610337 31191 leader_election.cc:304] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:01.612094 31524 raft_consensus.cc:2804] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election won for term 1
W20260203 09:18:01.612197 31267 leader_election.cc:343] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:01.611020 31494 ts_tablet_manager.cc:1434] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.054s user 0.007s sys 0.002s
I20260203 09:18:01.613102 31504 raft_consensus.cc:385] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.615002 31504 raft_consensus.cc:740] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.616714 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c2f90aaa7514d27a5a15b4fd6f90669" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:01.616931 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c2f90aaa7514d27a5a15b4fd6f90669" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:01.617535 31298 raft_consensus.cc:3060] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.618798 31372 raft_consensus.cc:2468] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:01.615911 31504 consensus_queue.cc:260] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:01.620859 31494 tablet_bootstrap.cc:492] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:01.602708 31628 consensus_queue.cc:237] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:01.611070 31588 raft_consensus.cc:515] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:01.624817 31524 raft_consensus.cc:697] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
W20260203 09:18:01.631458 31191 leader_election.cc:343] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:01.640990 31524 consensus_queue.cc:237] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:01.639258 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc8de34393ac472590f28a52d1bf55ff" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:01.644382 31299 raft_consensus.cc:3060] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.644760 31494 tablet_bootstrap.cc:654] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.621042 31504 ts_tablet_manager.cc:1434] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.017s user 0.006s sys 0.001s
I20260203 09:18:01.621549 31264 leader_election.cc:304] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:01.653376 31594 raft_consensus.cc:2804] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:01.647609 31588 leader_election.cc:290] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:01.639631 31120 catalog_manager.cc:5654] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 0 to 1, leader changed from <none> to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 1 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:01.653893 31594 raft_consensus.cc:697] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:01.654376 31504 tablet_bootstrap.cc:492] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:01.654778 31594 consensus_queue.cc:237] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:01.652051 31496 tablet_bootstrap.cc:492] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:01.625317 31298 raft_consensus.cc:2468] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:01.656024 31496 ts_tablet_manager.cc:1403] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.057s user 0.026s sys 0.009s
I20260203 09:18:01.659013 31500 consensus_queue.cc:1048] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:01.659452 31496 raft_consensus.cc:359] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:01.660506 31496 raft_consensus.cc:385] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.660851 31496 raft_consensus.cc:740] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.661316 31504 tablet_bootstrap.cc:654] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.661603 31496 consensus_queue.cc:260] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:01.663807 31496 ts_tablet_manager.cc:1434] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260203 09:18:01.664736 31496 tablet_bootstrap.cc:492] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:01.664830 31501 consensus_queue.cc:1048] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:01.671136 31496 tablet_bootstrap.cc:654] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.686569 31501 consensus_queue.cc:1048] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:01.689309 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc8de34393ac472590f28a52d1bf55ff" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:01.689481 31628 raft_consensus.cc:493] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:01.690649 31628 raft_consensus.cc:515] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:01.693920 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9e9201a8d64c4b45982d775e4406a3fd" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
W20260203 09:18:01.695269 31188 leader_election.cc:343] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:01.701148 31191 leader_election.cc:304] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:01.702231 31524 raft_consensus.cc:2804] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:01.702780 31524 raft_consensus.cc:697] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:01.703692 31524 consensus_queue.cc:237] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:01.704551 31494 tablet_bootstrap.cc:492] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:01.705214 31494 ts_tablet_manager.cc:1403] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.085s user 0.012s sys 0.001s
I20260203 09:18:01.709448 31628 leader_election.cc:290] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:01.710841 31592 consensus_queue.cc:1048] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:01.725834 31494 raft_consensus.cc:359] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:01.726724 31494 raft_consensus.cc:385] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.727026 31494 raft_consensus.cc:740] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.727761 31494 consensus_queue.cc:260] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:01.730988 31119 catalog_manager.cc:5654] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 0 to 1, leader changed from <none> to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 1 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } }
W20260203 09:18:01.734153 31413 leader_election.cc:343] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:01.736053 31496 tablet_bootstrap.cc:492] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:01.736616 31496 ts_tablet_manager.cc:1403] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.072s user 0.029s sys 0.033s
I20260203 09:18:01.736796 31504 tablet_bootstrap.cc:492] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:01.737421 31504 ts_tablet_manager.cc:1403] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.083s user 0.026s sys 0.023s
I20260203 09:18:01.739497 31496 raft_consensus.cc:359] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:01.742766 31496 raft_consensus.cc:385] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.743144 31496 raft_consensus.cc:740] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.743630 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9e9201a8d64c4b45982d775e4406a3fd" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:01.743924 31496 consensus_queue.cc:260] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:01.745419 31587 consensus_queue.cc:1048] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260203 09:18:01.746193 31191 leader_election.cc:343] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:01.746775 31496 ts_tablet_manager.cc:1434] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.010s user 0.000s sys 0.006s
I20260203 09:18:01.740924 31500 consensus_queue.cc:1048] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:01.747890 31496 tablet_bootstrap.cc:492] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:01.748391 31494 ts_tablet_manager.cc:1434] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.043s user 0.004s sys 0.003s
I20260203 09:18:01.749390 31494 tablet_bootstrap.cc:492] T 730e665d69354cad93df20607e256d58 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:01.746685 31191 leader_election.cc:304] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:01.754223 31628 raft_consensus.cc:493] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:01.754284 31524 raft_consensus.cc:2749] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:01.755618 31496 tablet_bootstrap.cc:654] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.755756 31119 catalog_manager.cc:5654] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 0 to 1, leader changed from <none> to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 1 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:01.740172 31504 raft_consensus.cc:359] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:01.758613 31504 raft_consensus.cc:385] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.758944 31504 raft_consensus.cc:740] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.759591 31504 consensus_queue.cc:260] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:01.764031 31504 ts_tablet_manager.cc:1434] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.026s user 0.006s sys 0.000s
I20260203 09:18:01.765040 31504 tablet_bootstrap.cc:492] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:01.754830 31628 raft_consensus.cc:515] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:01.770002 31628 leader_election.cc:290] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:01.769728 31120 catalog_manager.cc:5654] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 1 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:01.772048 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c17aa1880254f13a38a3c550b0894af" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:01.772764 31375 raft_consensus.cc:2468] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 0.
I20260203 09:18:01.773686 31496 tablet_bootstrap.cc:492] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:01.773914 31444 raft_consensus.cc:3060] T 92861fb258ec44228e1c191bee2fee0b P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.774428 31496 ts_tablet_manager.cc:1403] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.027s user 0.014s sys 0.004s
I20260203 09:18:01.775347 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c17aa1880254f13a38a3c550b0894af" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:01.776049 31450 raft_consensus.cc:2468] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 0.
I20260203 09:18:01.779866 31188 leader_election.cc:304] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:01.782071 31495 tablet_bootstrap.cc:492] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:01.782648 31495 ts_tablet_manager.cc:1403] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.312s user 0.003s sys 0.018s
I20260203 09:18:01.783286 31299 raft_consensus.cc:2468] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 1.
I20260203 09:18:01.784484 31416 leader_election.cc:304] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:01.785320 31588 raft_consensus.cc:2804] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:01.785550 31496 raft_consensus.cc:359] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:01.786041 31588 raft_consensus.cc:697] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:01.786563 31496 raft_consensus.cc:385] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.786937 31496 raft_consensus.cc:740] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.787065 31588 consensus_queue.cc:237] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:01.788057 31524 raft_consensus.cc:2804] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:01.788465 31524 raft_consensus.cc:493] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:01.788831 31524 raft_consensus.cc:3060] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.789389 31495 raft_consensus.cc:359] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:01.790145 31495 raft_consensus.cc:385] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.790448 31495 raft_consensus.cc:740] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.791004 31504 tablet_bootstrap.cc:654] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.791301 31495 consensus_queue.cc:260] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:01.793936 31495 ts_tablet_manager.cc:1434] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260203 09:18:01.795003 31495 tablet_bootstrap.cc:492] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
W20260203 09:18:01.798643 31154 debug-util.cc:398] Leaking SignalData structure 0x7b080005ee00 after lost signal to thread 27556
W20260203 09:18:01.799867 31154 debug-util.cc:398] Leaking SignalData structure 0x7b080004f7c0 after lost signal to thread 31157
W20260203 09:18:01.801173 31154 debug-util.cc:398] Leaking SignalData structure 0x7b0800259560 after lost signal to thread 31250
I20260203 09:18:01.801365 31504 tablet_bootstrap.cc:492] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:01.802022 31504 ts_tablet_manager.cc:1403] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.037s user 0.015s sys 0.000s
W20260203 09:18:01.802345 31154 debug-util.cc:398] Leaking SignalData structure 0x7b08002a4840 after lost signal to thread 31325
W20260203 09:18:01.803514 31154 debug-util.cc:398] Leaking SignalData structure 0x7b080039b2a0 after lost signal to thread 31400
W20260203 09:18:01.807447 31154 debug-util.cc:398] Leaking SignalData structure 0x7b08001ca900 after lost signal to thread 31474
I20260203 09:18:01.787674 31496 consensus_queue.cc:260] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:01.810182 31496 ts_tablet_manager.cc:1434] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.035s user 0.007s sys 0.000s
I20260203 09:18:01.811157 31496 tablet_bootstrap.cc:492] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:01.805191 31495 tablet_bootstrap.cc:654] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.823952 31118 catalog_manager.cc:5654] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 1 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:01.823400 31494 tablet_bootstrap.cc:654] T 730e665d69354cad93df20607e256d58 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.818020 31594 consensus_queue.cc:1048] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260203 09:18:01.804603 31504 raft_consensus.cc:359] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:01.829326 31504 raft_consensus.cc:385] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.829625 31504 raft_consensus.cc:740] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.830395 31504 consensus_queue.cc:260] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:01.824303 31524 raft_consensus.cc:515] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:01.832916 31504 ts_tablet_manager.cc:1434] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.031s user 0.005s sys 0.001s
I20260203 09:18:01.833932 31504 tablet_bootstrap.cc:492] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:01.834085 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c17aa1880254f13a38a3c550b0894af" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:01.834764 31374 raft_consensus.cc:3060] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.839854 31504 tablet_bootstrap.cc:654] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.851352 31494 tablet_bootstrap.cc:492] T 730e665d69354cad93df20607e256d58 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:01.854262 31494 ts_tablet_manager.cc:1403] T 730e665d69354cad93df20607e256d58 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.105s user 0.014s sys 0.000s
I20260203 09:18:01.854875 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c17aa1880254f13a38a3c550b0894af" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:01.855623 31450 raft_consensus.cc:3060] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:01.855675 31374 raft_consensus.cc:2468] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:01.857267 31188 leader_election.cc:304] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:01.858258 31628 raft_consensus.cc:2804] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:01.858771 31628 raft_consensus.cc:697] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:01.859633 31628 consensus_queue.cc:237] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:01.863739 31450 raft_consensus.cc:2468] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:01.851779 31121 catalog_manager.cc:5654] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 0 to 1, leader changed from <none> to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 1 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:01.853250 31524 leader_election.cc:290] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:01.866242 31494 raft_consensus.cc:359] T 730e665d69354cad93df20607e256d58 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:01.868464 31504 tablet_bootstrap.cc:492] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:01.868858 31494 raft_consensus.cc:385] T 730e665d69354cad93df20607e256d58 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.869084 31504 ts_tablet_manager.cc:1403] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.035s user 0.011s sys 0.000s
I20260203 09:18:01.868456 31495 tablet_bootstrap.cc:492] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:01.869741 31495 ts_tablet_manager.cc:1403] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.075s user 0.013s sys 0.000s
I20260203 09:18:01.830950 31496 tablet_bootstrap.cc:654] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.871773 31504 raft_consensus.cc:359] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:01.872504 31504 raft_consensus.cc:385] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.869248 31494 raft_consensus.cc:740] T 730e665d69354cad93df20607e256d58 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.874138 31494 consensus_queue.cc:260] T 730e665d69354cad93df20607e256d58 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:01.876248 31494 ts_tablet_manager.cc:1434] T 730e665d69354cad93df20607e256d58 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.021s user 0.004s sys 0.000s
I20260203 09:18:01.872319 31495 raft_consensus.cc:359] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:01.876904 31495 raft_consensus.cc:385] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.877182 31495 raft_consensus.cc:740] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.877827 31495 consensus_queue.cc:260] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:01.879299 31504 raft_consensus.cc:740] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.880185 31494 tablet_bootstrap.cc:492] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:01.879987 31504 consensus_queue.cc:260] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:01.882526 31504 ts_tablet_manager.cc:1434] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20260203 09:18:01.883735 31504 tablet_bootstrap.cc:492] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:01.893319 31594 raft_consensus.cc:493] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:01.893905 31594 raft_consensus.cc:515] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:01.895956 31594 leader_election.cc:290] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:01.899942 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "707a391491654853bba7daefe8451eca" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
W20260203 09:18:01.901614 31267 leader_election.cc:343] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:01.901997 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "707a391491654853bba7daefe8451eca" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:01.903287 31495 ts_tablet_manager.cc:1434] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.027s user 0.006s sys 0.000s
W20260203 09:18:01.903894 31264 leader_election.cc:343] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:01.903242 31120 catalog_manager.cc:5654] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 0 to 1, leader changed from <none> to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 1 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:01.904385 31264 leader_election.cc:304] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:01.905184 31594 raft_consensus.cc:2749] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:01.906133 31495 tablet_bootstrap.cc:492] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:01.907611 31504 tablet_bootstrap.cc:654] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.911489 31496 tablet_bootstrap.cc:492] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:01.911856 31495 tablet_bootstrap.cc:654] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.912037 31496 ts_tablet_manager.cc:1403] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.101s user 0.014s sys 0.003s
I20260203 09:18:01.916118 31524 raft_consensus.cc:493] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:01.916615 31524 raft_consensus.cc:515] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:01.918507 31524 leader_election.cc:290] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:01.918979 31494 tablet_bootstrap.cc:654] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.920105 31372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "374ce202ecd540008cded117a37bfeba" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:01.921465 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "374ce202ecd540008cded117a37bfeba" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:01.914930 31496 raft_consensus.cc:359] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:01.922120 31496 raft_consensus.cc:385] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.922473 31496 raft_consensus.cc:740] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
W20260203 09:18:01.923125 31191 leader_election.cc:343] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:01.923342 31496 consensus_queue.cc:260] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
W20260203 09:18:01.924352 31188 leader_election.cc:343] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:01.924918 31188 leader_election.cc:304] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:01.927950 31524 raft_consensus.cc:2749] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:01.929977 31496 ts_tablet_manager.cc:1434] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.018s user 0.003s sys 0.005s
I20260203 09:18:01.931161 31496 tablet_bootstrap.cc:492] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:01.933849 31504 tablet_bootstrap.cc:492] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:01.934394 31504 ts_tablet_manager.cc:1403] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.051s user 0.018s sys 0.011s
I20260203 09:18:01.935730 31495 tablet_bootstrap.cc:492] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:01.936183 31495 ts_tablet_manager.cc:1403] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.030s user 0.009s sys 0.003s
I20260203 09:18:01.937593 31504 raft_consensus.cc:359] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:01.938354 31504 raft_consensus.cc:385] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.938618 31504 raft_consensus.cc:740] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.938699 31495 raft_consensus.cc:359] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:01.939417 31495 raft_consensus.cc:385] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.939317 31504 consensus_queue.cc:260] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:01.939749 31495 raft_consensus.cc:740] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.940691 31495 consensus_queue.cc:260] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:01.942672 31494 tablet_bootstrap.cc:492] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:01.943182 31504 ts_tablet_manager.cc:1434] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260203 09:18:01.943475 31496 tablet_bootstrap.cc:654] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.943188 31494 ts_tablet_manager.cc:1403] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.063s user 0.009s sys 0.000s
I20260203 09:18:01.948828 31495 ts_tablet_manager.cc:1434] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.012s user 0.004s sys 0.004s
I20260203 09:18:01.949873 31495 tablet_bootstrap.cc:492] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:01.954865 31495 tablet_bootstrap.cc:654] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.956261 31494 raft_consensus.cc:359] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:01.957135 31494 raft_consensus.cc:385] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.957387 31504 tablet_bootstrap.cc:492] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:01.958250 31496 tablet_bootstrap.cc:492] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:01.958738 31496 ts_tablet_manager.cc:1403] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.002s
I20260203 09:18:01.962616 31496 raft_consensus.cc:359] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:01.963310 31496 raft_consensus.cc:385] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.963558 31496 raft_consensus.cc:740] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.964167 31496 consensus_queue.cc:260] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:01.957396 31494 raft_consensus.cc:740] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.965303 31504 tablet_bootstrap.cc:654] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.965528 31494 consensus_queue.cc:260] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:01.973189 31504 tablet_bootstrap.cc:492] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:01.973793 31504 ts_tablet_manager.cc:1403] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.002s
I20260203 09:18:01.976336 31504 raft_consensus.cc:359] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:01.977133 31504 raft_consensus.cc:385] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:01.977428 31494 ts_tablet_manager.cc:1434] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.031s user 0.006s sys 0.000s
I20260203 09:18:01.977437 31504 raft_consensus.cc:740] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:01.981581 31496 ts_tablet_manager.cc:1434] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.023s user 0.008s sys 0.000s
I20260203 09:18:01.982688 31496 tablet_bootstrap.cc:492] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:01.988670 31494 tablet_bootstrap.cc:492] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
W20260203 09:18:01.988895 31171 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:18:01.989260 31504 consensus_queue.cc:260] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:01.990666 31496 tablet_bootstrap.cc:654] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:01.991708 31504 ts_tablet_manager.cc:1434] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.018s user 0.005s sys 0.000s
I20260203 09:18:01.992681 31504 tablet_bootstrap.cc:492] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:02.000293 31524 consensus_queue.cc:1048] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:02.012156 31494 tablet_bootstrap.cc:654] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:02.025699 31496 tablet_bootstrap.cc:492] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:02.025710 31495 tablet_bootstrap.cc:492] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:02.026746 31496 ts_tablet_manager.cc:1403] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.044s user 0.012s sys 0.016s
I20260203 09:18:02.026746 31495 ts_tablet_manager.cc:1403] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.077s user 0.015s sys 0.026s
I20260203 09:18:02.027868 31504 tablet_bootstrap.cc:654] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:02.033870 31602 raft_consensus.cc:493] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:02.034480 31602 raft_consensus.cc:515] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:02.036967 31597 consensus_queue.cc:1048] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:02.037526 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70796ace22d548219e05b0c9a86346e7" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
W20260203 09:18:02.039569 31188 leader_election.cc:343] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:02.039419 31495 raft_consensus.cc:359] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:02.040148 31495 raft_consensus.cc:385] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:02.040436 31495 raft_consensus.cc:740] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:02.042304 31602 leader_election.cc:290] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:02.043210 31496 raft_consensus.cc:359] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:02.043898 31496 raft_consensus.cc:385] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:02.043998 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70796ace22d548219e05b0c9a86346e7" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:02.044661 31496 raft_consensus.cc:740] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
W20260203 09:18:02.045460 31191 leader_election.cc:343] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:02.045358 31496 consensus_queue.cc:260] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:02.045948 31191 leader_election.cc:304] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:02.046308 31495 consensus_queue.cc:260] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:02.048503 31495 ts_tablet_manager.cc:1434] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20260203 09:18:02.049397 31495 tablet_bootstrap.cc:492] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:02.052088 31504 tablet_bootstrap.cc:492] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:02.052594 31504 ts_tablet_manager.cc:1403] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.060s user 0.010s sys 0.000s
I20260203 09:18:02.050552 31496 ts_tablet_manager.cc:1434] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20260203 09:18:02.055490 31496 tablet_bootstrap.cc:492] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:02.048630 31597 raft_consensus.cc:2749] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:02.058797 31374 raft_consensus.cc:3060] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.059283 31504 raft_consensus.cc:359] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:02.060076 31504 raft_consensus.cc:385] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:02.060334 31504 raft_consensus.cc:740] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:02.062237 31504 consensus_queue.cc:260] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:02.067656 31504 ts_tablet_manager.cc:1434] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20260203 09:18:02.068060 31602 consensus_queue.cc:1048] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:02.069365 31504 tablet_bootstrap.cc:492] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:02.069795 31588 raft_consensus.cc:493] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:02.070365 31588 raft_consensus.cc:515] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:02.070919 31594 raft_consensus.cc:493] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:02.071430 31502 raft_consensus.cc:493] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:02.071938 31502 raft_consensus.cc:515] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:02.072451 31496 tablet_bootstrap.cc:654] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:02.071429 31594 raft_consensus.cc:515] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:02.075002 31594 leader_election.cc:290] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:02.075731 31495 tablet_bootstrap.cc:654] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:02.084195 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "730e665d69354cad93df20607e256d58" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:02.084394 31372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "730e665d69354cad93df20607e256d58" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:02.084991 31223 raft_consensus.cc:2468] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
I20260203 09:18:02.085136 31372 raft_consensus.cc:2468] T 730e665d69354cad93df20607e256d58 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
I20260203 09:18:02.085624 31504 tablet_bootstrap.cc:654] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:02.086018 31589 raft_consensus.cc:493] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:02.086493 31589 raft_consensus.cc:515] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:02.086767 31267 leader_election.cc:304] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:02.088233 31587 raft_consensus.cc:2804] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:02.088609 31587 raft_consensus.cc:493] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:02.089152 31587 raft_consensus.cc:3060] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.089766 31502 leader_election.cc:290] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:02.088630 31592 raft_consensus.cc:493] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:02.091040 31592 raft_consensus.cc:515] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:02.092245 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:02.092533 31450 raft_consensus.cc:3060] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.092960 31299 raft_consensus.cc:2468] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 1.
I20260203 09:18:02.093118 31592 leader_election.cc:290] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:02.093498 31588 leader_election.cc:290] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:02.094595 31341 leader_election.cc:304] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:02.095616 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:02.096866 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a8fd0dd8dc8d432b8e8bb19f4f3448cc" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:02.099486 31298 raft_consensus.cc:2468] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 0.
I20260203 09:18:02.100775 31416 leader_election.cc:304] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:02.101759 31501 raft_consensus.cc:2804] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:02.102116 31501 raft_consensus.cc:493] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:02.102433 31501 raft_consensus.cc:3060] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.105369 31589 leader_election.cc:290] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:02.107640 31495 tablet_bootstrap.cc:492] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:02.111299 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c2f90aaa7514d27a5a15b4fd6f90669" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:02.111740 31594 consensus_queue.cc:1048] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:02.112174 31298 raft_consensus.cc:2393] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bf9aa3533b14841a52177c8cc3130ec in current term 1: Already voted for candidate d44c40c0ed244c4e962a26f9aebea76a in this term.
I20260203 09:18:02.097189 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03943e5b830f4ab4be9fe0b4e0ca4697" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:02.097522 31372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03943e5b830f4ab4be9fe0b4e0ca4697" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:02.114641 31372 raft_consensus.cc:2393] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bf9aa3533b14841a52177c8cc3130ec in current term 1: Already voted for candidate 79b10fa125f242419f66b577440e66d0 in this term.
I20260203 09:18:02.098073 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a8fd0dd8dc8d432b8e8bb19f4f3448cc" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:02.098181 31597 raft_consensus.cc:493] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:02.116551 31597 raft_consensus.cc:515] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:02.118578 31597 leader_election.cc:290] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:02.097692 31502 raft_consensus.cc:2804] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:02.120034 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5ccddc8d332443c97a92e59957dfa69" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:02.120609 31413 leader_election.cc:304] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
W20260203 09:18:02.121589 31188 leader_election.cc:343] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:18:02.122092 31413 leader_election.cc:343] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:02.121001 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c2f90aaa7514d27a5a15b4fd6f90669" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:02.123158 31495 ts_tablet_manager.cc:1403] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.074s user 0.012s sys 0.000s
I20260203 09:18:02.123759 31416 leader_election.cc:304] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:02.125538 31501 raft_consensus.cc:515] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:02.126946 31559 raft_consensus.cc:3060] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.128362 31589 raft_consensus.cc:2749] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:02.129117 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a8fd0dd8dc8d432b8e8bb19f4f3448cc" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:02.133235 31494 tablet_bootstrap.cc:492] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:02.133764 31494 ts_tablet_manager.cc:1403] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.145s user 0.022s sys 0.009s
W20260203 09:18:02.134852 31188 consensus_peers.cc:597] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a -> Peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Couldn't send request to peer 73bf755165c4487c81c67b5ab44f7104. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:02.105428 31587 raft_consensus.cc:515] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
W20260203 09:18:02.137004 31413 leader_election.cc:343] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:02.123113 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5ccddc8d332443c97a92e59957dfa69" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:02.137758 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a8fd0dd8dc8d432b8e8bb19f4f3448cc" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
W20260203 09:18:02.138695 31191 leader_election.cc:343] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:02.138346 31594 consensus_queue.cc:1048] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:02.139237 31191 leader_election.cc:304] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:02.141438 31602 raft_consensus.cc:2749] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:02.138331 31298 raft_consensus.cc:3060] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.143237 31504 tablet_bootstrap.cc:492] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:02.143740 31504 ts_tablet_manager.cc:1403] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.075s user 0.010s sys 0.006s
I20260203 09:18:02.145844 31559 raft_consensus.cc:2749] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:02.149180 31495 raft_consensus.cc:359] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:02.149827 31298 raft_consensus.cc:2468] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 1.
I20260203 09:18:02.150254 31504 raft_consensus.cc:359] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:02.151005 31504 raft_consensus.cc:385] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:02.149889 31495 raft_consensus.cc:385] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:02.151269 31504 raft_consensus.cc:740] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:02.151612 31495 raft_consensus.cc:740] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:02.152320 31495 consensus_queue.cc:260] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:02.152894 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "730e665d69354cad93df20607e256d58" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:02.153630 31496 tablet_bootstrap.cc:492] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:02.153875 31602 raft_consensus.cc:493] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:02.154161 31496 ts_tablet_manager.cc:1403] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.099s user 0.004s sys 0.018s
I20260203 09:18:02.154400 31602 raft_consensus.cc:515] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:02.155820 31495 ts_tablet_manager.cc:1434] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260203 09:18:02.156720 31538 raft_consensus.cc:493] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:02.156877 31496 raft_consensus.cc:359] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:02.157289 31538 raft_consensus.cc:515] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:02.157420 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93cc0a94606149e18c8764e851f4b826" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:02.157639 31496 raft_consensus.cc:385] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:02.158217 31299 raft_consensus.cc:2468] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 0.
I20260203 09:18:02.158308 31372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93cc0a94606149e18c8764e851f4b826" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:02.158337 31504 consensus_queue.cc:260] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:02.159258 31538 leader_election.cc:290] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:02.153508 31223 raft_consensus.cc:3060] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.160979 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc8de34393ac472590f28a52d1bf55ff" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:02.158452 31496 raft_consensus.cc:740] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:02.161803 31299 raft_consensus.cc:2393] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73bf755165c4487c81c67b5ab44f7104 in current term 1: Already voted for candidate 2bf9aa3533b14841a52177c8cc3130ec in this term.
I20260203 09:18:02.162062 31496 consensus_queue.cc:260] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:02.163460 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc8de34393ac472590f28a52d1bf55ff" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:02.156592 31602 leader_election.cc:290] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:02.137148 31501 leader_election.cc:290] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:02.161082 31504 ts_tablet_manager.cc:1434] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.017s user 0.007s sys 0.001s
I20260203 09:18:02.165005 31191 leader_election.cc:304] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters:
W20260203 09:18:02.166106 31188 leader_election.cc:343] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:02.166376 31504 tablet_bootstrap.cc:492] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:02.166625 31602 raft_consensus.cc:2804] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:02.167886 31587 leader_election.cc:290] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:02.169083 31372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "730e665d69354cad93df20607e256d58" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:02.169672 31372 raft_consensus.cc:3060] T 730e665d69354cad93df20607e256d58 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.170881 31501 raft_consensus.cc:493] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:02.171481 31501 raft_consensus.cc:515] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:02.172307 31504 tablet_bootstrap.cc:654] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:02.174238 31224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1d1f5b1c3b64ebaa2824e9136285fbe" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
W20260203 09:18:02.175675 31416 leader_election.cc:343] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:02.166923 31496 ts_tablet_manager.cc:1434] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.012s user 0.007s sys 0.000s
I20260203 09:18:02.180739 31297 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1d1f5b1c3b64ebaa2824e9136285fbe" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:02.181425 31297 raft_consensus.cc:2468] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 0.
I20260203 09:18:02.182230 31597 consensus_queue.cc:1048] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:02.182521 31628 consensus_queue.cc:1048] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:02.183910 31494 raft_consensus.cc:359] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:02.184592 31494 raft_consensus.cc:385] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:02.184900 31494 raft_consensus.cc:740] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:02.166997 31602 raft_consensus.cc:493] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:02.186632 31602 raft_consensus.cc:3060] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.178865 31372 raft_consensus.cc:2468] T 730e665d69354cad93df20607e256d58 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:02.192299 31559 raft_consensus.cc:493] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:02.206878 31559 raft_consensus.cc:515] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:02.192636 31496 tablet_bootstrap.cc:492] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:02.209724 31559 leader_election.cc:290] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:02.192942 31501 leader_election.cc:290] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:02.195168 31494 consensus_queue.cc:260] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:02.197249 31416 leader_election.cc:304] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:02.212795 31559 raft_consensus.cc:2804] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:02.213253 31416 leader_election.cc:304] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:02.213544 31559 raft_consensus.cc:697] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:02.214617 31559 consensus_queue.cc:237] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:02.215416 31224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:02.215958 31501 raft_consensus.cc:2804] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:02.216336 31501 raft_consensus.cc:493] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:02.216264 31224 raft_consensus.cc:2393] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bf9aa3533b14841a52177c8cc3130ec in current term 1: Already voted for candidate d44c40c0ed244c4e962a26f9aebea76a in this term.
I20260203 09:18:02.199275 31341 leader_election.cc:304] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:02.215253 31496 tablet_bootstrap.cc:654] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:02.178922 31223 raft_consensus.cc:2468] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:02.216740 31501 raft_consensus.cc:3060] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.221801 31267 leader_election.cc:304] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:02.222704 31587 raft_consensus.cc:2804] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:02.223420 31587 raft_consensus.cc:697] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:02.220268 31495 tablet_bootstrap.cc:492] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:02.226883 31494 ts_tablet_manager.cc:1434] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.093s user 0.007s sys 0.000s
I20260203 09:18:02.228193 31494 tablet_bootstrap.cc:492] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:02.228847 31538 raft_consensus.cc:3060] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.224318 31587 consensus_queue.cc:237] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:02.234921 31494 tablet_bootstrap.cc:654] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:02.253587 31502 raft_consensus.cc:493] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:02.254281 31502 raft_consensus.cc:3060] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:02.260528 31594 raft_consensus.cc:493] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:02.265019 31372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:02.283392 31502 raft_consensus.cc:515] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:02.276167 31559 raft_consensus.cc:493] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:02.293745 31538 raft_consensus.cc:2749] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:02.295285 31372 raft_consensus.cc:2393] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bf9aa3533b14841a52177c8cc3130ec in current term 1: Already voted for candidate 73bf755165c4487c81c67b5ab44f7104 in this term.
I20260203 09:18:02.295490 31538 raft_consensus.cc:493] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:02.296008 31538 raft_consensus.cc:515] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:02.264340 31602 raft_consensus.cc:515] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:02.305152 31538 leader_election.cc:290] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:02.302166 31524 raft_consensus.cc:493] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:02.311980 31524 raft_consensus.cc:515] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:02.313378 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "374ce202ecd540008cded117a37bfeba" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:02.313954 31524 leader_election.cc:290] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:02.296547 31597 consensus_queue.cc:1048] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260203 09:18:02.326349 31413 leader_election.cc:304] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:02.327445 31589 raft_consensus.cc:3060] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:18:02.328689 31341 leader_election.cc:343] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:02.289626 31594 raft_consensus.cc:515] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:02.331935 31504 tablet_bootstrap.cc:492] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:02.332530 31504 ts_tablet_manager.cc:1403] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.166s user 0.058s sys 0.040s
I20260203 09:18:02.300387 31559 raft_consensus.cc:515] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:02.336805 31628 raft_consensus.cc:493] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:02.337343 31628 raft_consensus.cc:515] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:02.339274 31628 leader_election.cc:290] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:02.339758 31628 raft_consensus.cc:493] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:02.340134 31628 raft_consensus.cc:515] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:02.306092 31501 raft_consensus.cc:515] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:02.345399 31589 raft_consensus.cc:2749] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:02.352205 31592 consensus_queue.cc:1048] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:02.365373 31495 tablet_bootstrap.cc:654] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:02.352459 31504 raft_consensus.cc:359] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:02.354012 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4d4fa5c03a74205a7c5fdda5e37cfe4" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:02.355505 31301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4d4fa5c03a74205a7c5fdda5e37cfe4" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:02.357652 31594 leader_election.cc:290] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:02.357270 31685 consensus_queue.cc:1048] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:02.358677 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4d4fa5c03a74205a7c5fdda5e37cfe4" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:02.359055 31501 leader_election.cc:290] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:02.360318 31559 leader_election.cc:290] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:02.360508 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "374ce202ecd540008cded117a37bfeba" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:02.361579 31224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:02.363127 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1d1f5b1c3b64ebaa2824e9136285fbe" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:02.363065 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "707a391491654853bba7daefe8451eca" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:02.378504 31628 leader_election.cc:290] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:02.378742 31298 raft_consensus.cc:2468] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 0.
I20260203 09:18:02.366940 31504 raft_consensus.cc:385] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:02.371542 31494 tablet_bootstrap.cc:492] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:02.379487 31504 raft_consensus.cc:740] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:02.373746 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "707a391491654853bba7daefe8451eca" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:02.380046 31494 ts_tablet_manager.cc:1403] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.152s user 0.013s sys 0.008s
I20260203 09:18:02.381916 31496 tablet_bootstrap.cc:492] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:02.382416 31496 ts_tablet_manager.cc:1403] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.196s user 0.013s sys 0.004s
I20260203 09:18:02.378602 31296 raft_consensus.cc:3060] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.384847 31297 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8301405e2ead406caa7440c0337df77d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
W20260203 09:18:02.385120 31680 log.cc:927] Time spent T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0: Append to log took a long time: real 0.050s user 0.000s sys 0.000s
I20260203 09:18:02.385838 31223 raft_consensus.cc:2468] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 0.
I20260203 09:18:02.388881 31602 leader_election.cc:290] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:02.372255 31301 raft_consensus.cc:2468] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 0.
I20260203 09:18:02.379550 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8301405e2ead406caa7440c0337df77d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:02.392897 31416 leader_election.cc:304] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:02.393188 31496 raft_consensus.cc:359] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:02.394106 31496 raft_consensus.cc:385] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:02.394568 31496 raft_consensus.cc:740] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:02.395325 31496 consensus_queue.cc:260] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:02.395835 31559 raft_consensus.cc:2804] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:02.396220 31559 raft_consensus.cc:493] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:02.396824 31589 raft_consensus.cc:493] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:02.397279 31589 raft_consensus.cc:515] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:02.397985 31496 ts_tablet_manager.cc:1434] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.015s user 0.007s sys 0.001s
I20260203 09:18:02.396546 31559 raft_consensus.cc:3060] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.400323 31589 leader_election.cc:290] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:02.376297 31502 leader_election.cc:290] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
W20260203 09:18:02.402271 31267 leader_election.cc:343] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:02.403291 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4d4fa5c03a74205a7c5fdda5e37cfe4" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:02.403985 31223 raft_consensus.cc:2468] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
I20260203 09:18:02.405107 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:02.380277 31504 consensus_queue.cc:260] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:02.409042 31496 tablet_bootstrap.cc:492] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:02.394048 31120 catalog_manager.cc:5654] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 1 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } }
W20260203 09:18:02.406481 31413 leader_election.cc:343] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:02.407969 31267 leader_election.cc:304] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:02.417616 31594 raft_consensus.cc:2804] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:02.408216 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93cc0a94606149e18c8764e851f4b826" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:02.418017 31594 raft_consensus.cc:493] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:02.418404 31594 raft_consensus.cc:3060] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.419075 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbf01f6b7a2f4b7db0978441f72e138d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:02.419620 31494 raft_consensus.cc:359] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:02.420301 31494 raft_consensus.cc:385] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:02.420547 31494 raft_consensus.cc:740] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:02.421352 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93cc0a94606149e18c8764e851f4b826" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:02.421965 31299 raft_consensus.cc:3060] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.425998 31372 raft_consensus.cc:1240] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Rejecting Update request from peer d44c40c0ed244c4e962a26f9aebea76a for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:02.425810 31594 raft_consensus.cc:515] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:02.421167 31494 consensus_queue.cc:260] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:02.427610 31504 ts_tablet_manager.cc:1434] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.095s user 0.007s sys 0.000s
I20260203 09:18:02.406396 31559 raft_consensus.cc:515] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:02.411727 31628 raft_consensus.cc:493] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:02.434078 31494 ts_tablet_manager.cc:1434] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.053s user 0.005s sys 0.000s
I20260203 09:18:02.435603 31494 tablet_bootstrap.cc:492] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
W20260203 09:18:02.435395 31188 leader_election.cc:343] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:02.434078 31341 leader_election.cc:304] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
W20260203 09:18:02.452839 31188 leader_election.cc:343] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:02.454020 31689 consensus_queue.cc:1059] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:02.454895 31689 raft_consensus.cc:3055] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:02.455206 31689 raft_consensus.cc:740] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:02.455900 31494 tablet_bootstrap.cc:654] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:02.456018 31689 consensus_queue.cc:260] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:02.460166 31594 leader_election.cc:290] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:02.439942 31628 raft_consensus.cc:515] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:02.451880 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1d1f5b1c3b64ebaa2824e9136285fbe" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:02.458058 31502 raft_consensus.cc:2749] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:18:02.465792 31296 raft_consensus.cc:2468] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 1.
W20260203 09:18:02.469061 31191 leader_election.cc:343] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:02.469548 31501 consensus_queue.cc:1048] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:02.470077 31191 leader_election.cc:304] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:02.471442 31495 tablet_bootstrap.cc:492] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
W20260203 09:18:02.471580 31191 leader_election.cc:343] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:02.472060 31495 ts_tablet_manager.cc:1403] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.252s user 0.023s sys 0.020s
I20260203 09:18:02.467355 31224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9e9201a8d64c4b45982d775e4406a3fd" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:02.458601 31301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbf01f6b7a2f4b7db0978441f72e138d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
W20260203 09:18:02.472504 31191 leader_election.cc:343] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:02.472610 31224 raft_consensus.cc:2468] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 0.
I20260203 09:18:02.478088 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4d4fa5c03a74205a7c5fdda5e37cfe4" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:02.472867 31602 consensus_queue.cc:1048] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260203 09:18:02.474612 31685 raft_consensus.cc:2804] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:02.480625 31685 raft_consensus.cc:493] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:02.480995 31685 raft_consensus.cc:3060] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.471792 31416 leader_election.cc:304] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:02.482460 31589 raft_consensus.cc:2804] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:02.453917 31341 leader_election.cc:304] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:02.482920 31589 raft_consensus.cc:697] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:02.483892 31589 consensus_queue.cc:237] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:02.485087 31504 tablet_bootstrap.cc:492] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:02.486050 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9e9201a8d64c4b45982d775e4406a3fd" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:02.483904 31681 raft_consensus.cc:2804] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:02.487334 31681 raft_consensus.cc:493] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:02.487656 31681 raft_consensus.cc:3060] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.494000 31685 raft_consensus.cc:515] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:02.496078 31685 leader_election.cc:290] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
W20260203 09:18:02.497570 31413 leader_election.cc:343] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:18:02.501363 31267 leader_election.cc:343] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:02.474023 31689 raft_consensus.cc:3060] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:02.512336 31628 leader_election.cc:290] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:02.513269 31504 tablet_bootstrap.cc:654] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:02.517573 31299 raft_consensus.cc:2468] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:02.530077 31496 tablet_bootstrap.cc:654] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:02.524296 31681 raft_consensus.cc:515] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:02.534042 31681 leader_election.cc:290] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:02.428303 31119 catalog_manager.cc:5654] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 1 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:02.582471 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4d4fa5c03a74205a7c5fdda5e37cfe4" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:02.584527 31223 raft_consensus.cc:2393] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 79b10fa125f242419f66b577440e66d0 in current term 1: Already voted for candidate d44c40c0ed244c4e962a26f9aebea76a in this term.
I20260203 09:18:02.591544 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "707a391491654853bba7daefe8451eca" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:02.592090 31267 leader_election.cc:304] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:02.592676 31299 raft_consensus.cc:3060] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.596913 31594 raft_consensus.cc:2749] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260203 09:18:02.530804 31559 leader_election.cc:290] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:02.616286 31682 raft_consensus.cc:493] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:02.617400 31682 raft_consensus.cc:515] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:02.618986 31504 tablet_bootstrap.cc:492] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:02.620066 31504 ts_tablet_manager.cc:1403] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.135s user 0.013s sys 0.003s
I20260203 09:18:02.620630 31682 leader_election.cc:290] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:02.473008 31191 leader_election.cc:304] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:02.621737 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b4a1f3d804ae39a009a23ea4e90f3" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:02.622452 31689 raft_consensus.cc:2749] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260203 09:18:02.625386 31191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:42099, user_credentials={real_user=slave}} blocked reactor thread for 152720us
W20260203 09:18:02.628472 31188 leader_election.cc:343] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:02.630546 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4d4fa5c03a74205a7c5fdda5e37cfe4" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:02.631772 31298 raft_consensus.cc:2393] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d44c40c0ed244c4e962a26f9aebea76a in current term 1: Already voted for candidate 79b10fa125f242419f66b577440e66d0 in this term.
I20260203 09:18:02.635594 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4d4fa5c03a74205a7c5fdda5e37cfe4" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:02.637481 31494 tablet_bootstrap.cc:492] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:02.637707 31495 raft_consensus.cc:359] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:02.638435 31494 ts_tablet_manager.cc:1403] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.203s user 0.008s sys 0.008s
I20260203 09:18:02.638712 31495 raft_consensus.cc:385] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:02.639034 31495 raft_consensus.cc:740] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:02.643479 31416 leader_election.cc:304] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:02.646312 31559 raft_consensus.cc:2804] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:02.646808 31559 raft_consensus.cc:493] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:02.647169 31559 raft_consensus.cc:3060] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.647929 31495 consensus_queue.cc:260] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:02.657711 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "374ce202ecd540008cded117a37bfeba" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
W20260203 09:18:02.658643 31416 leader_election.cc:343] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:02.659929 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "defda4c9fc6a4d0ba46ec287eb2f08d1" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:02.654829 31689 raft_consensus.cc:493] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:02.658468 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b4a1f3d804ae39a009a23ea4e90f3" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:02.663044 31689 raft_consensus.cc:515] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:02.664214 31298 raft_consensus.cc:2468] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 0.
I20260203 09:18:02.663707 31681 raft_consensus.cc:493] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:02.665905 31681 raft_consensus.cc:515] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:02.667923 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a5ca73a494b4d7389eec90025653337" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
W20260203 09:18:02.670336 31188 leader_election.cc:343] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:02.672271 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "707a391491654853bba7daefe8451eca" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:02.673234 31504 raft_consensus.cc:359] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
W20260203 09:18:02.677732 31341 leader_election.cc:343] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:18:02.677608 31413 leader_election.cc:343] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:02.678215 31559 raft_consensus.cc:515] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:02.668375 31681 leader_election.cc:290] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:02.666407 31689 leader_election.cc:290] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:02.678537 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a8fd0dd8dc8d432b8e8bb19f4f3448cc" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:02.678378 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a8fd0dd8dc8d432b8e8bb19f4f3448cc" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:02.684096 31494 raft_consensus.cc:359] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:02.685434 31504 raft_consensus.cc:385] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:02.692741 31504 raft_consensus.cc:740] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:02.691691 31594 consensus_queue.cc:1048] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:02.695036 31224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "374ce202ecd540008cded117a37bfeba" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:02.694779 31504 consensus_queue.cc:260] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:02.692807 31298 raft_consensus.cc:2393] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73bf755165c4487c81c67b5ab44f7104 in current term 1: Already voted for candidate 2bf9aa3533b14841a52177c8cc3130ec in this term.
I20260203 09:18:02.696674 31495 ts_tablet_manager.cc:1434] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.223s user 0.009s sys 0.003s
I20260203 09:18:02.696098 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "defda4c9fc6a4d0ba46ec287eb2f08d1" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:02.698040 31224 raft_consensus.cc:3060] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.698603 31495 tablet_bootstrap.cc:492] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:02.702298 31504 ts_tablet_manager.cc:1434] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.082s user 0.008s sys 0.004s
I20260203 09:18:02.704021 31504 tablet_bootstrap.cc:492] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:02.696036 31494 raft_consensus.cc:385] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260203 09:18:02.695293 31191 leader_election.cc:343] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:02.704937 31494 raft_consensus.cc:740] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:02.705289 31191 leader_election.cc:304] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:02.706352 31689 raft_consensus.cc:2749] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:02.705729 31494 consensus_queue.cc:260] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:02.709923 31191 leader_election.cc:304] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:02.711445 31588 consensus_queue.cc:1048] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:02.713373 31494 ts_tablet_manager.cc:1434] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.075s user 0.003s sys 0.009s
I20260203 09:18:02.714066 31689 raft_consensus.cc:2804] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:02.715015 31689 raft_consensus.cc:697] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:02.716306 31689 consensus_queue.cc:237] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:02.719100 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9e9201a8d64c4b45982d775e4406a3fd" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:02.719885 31223 raft_consensus.cc:3060] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.711728 31559 leader_election.cc:290] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:02.721719 31494 tablet_bootstrap.cc:492] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:02.710273 31341 leader_election.cc:304] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:02.742296 31681 raft_consensus.cc:3060] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.748324 31224 raft_consensus.cc:2468] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 1.
I20260203 09:18:02.752506 31299 raft_consensus.cc:2468] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 1.
I20260203 09:18:02.753376 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9e9201a8d64c4b45982d775e4406a3fd" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:02.753744 31191 leader_election.cc:304] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:02.754621 31416 leader_election.cc:304] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:02.755645 31495 tablet_bootstrap.cc:654] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:02.755627 31628 raft_consensus.cc:2804] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:02.756294 31628 raft_consensus.cc:493] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:02.756729 31628 raft_consensus.cc:3060] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.756686 31501 raft_consensus.cc:2804] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:02.783456 31682 raft_consensus.cc:493] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:02.784042 31682 raft_consensus.cc:515] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:02.786233 31682 leader_election.cc:290] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
W20260203 09:18:02.778887 31413 leader_election.cc:343] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:02.780117 31501 raft_consensus.cc:697] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:02.789393 31501 consensus_queue.cc:237] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:02.795130 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93cc0a94606149e18c8764e851f4b826" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:02.796372 31296 raft_consensus.cc:2393] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73bf755165c4487c81c67b5ab44f7104 in current term 1: Already voted for candidate d44c40c0ed244c4e962a26f9aebea76a in this term.
I20260203 09:18:02.816733 31223 raft_consensus.cc:2468] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 1.
I20260203 09:18:02.825186 31496 tablet_bootstrap.cc:492] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:02.825914 31496 ts_tablet_manager.cc:1403] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.427s user 0.020s sys 0.007s
I20260203 09:18:02.826565 31500 consensus_queue.cc:1048] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:02.842046 31494 tablet_bootstrap.cc:654] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:02.833653 31689 consensus_queue.cc:1048] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260203 09:18:02.841198 31496 raft_consensus.cc:359] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:02.851805 31496 raft_consensus.cc:385] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:02.852128 31496 raft_consensus.cc:740] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:02.847980 31628 raft_consensus.cc:515] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:02.865247 31504 tablet_bootstrap.cc:654] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:02.864794 31496 consensus_queue.cc:260] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:02.874665 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b4a1f3d804ae39a009a23ea4e90f3" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
W20260203 09:18:02.871455 31191 leader_election.cc:343] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:18:02.881572 31188 leader_election.cc:343] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:02.869457 31681 raft_consensus.cc:2749] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:02.882359 31628 leader_election.cc:290] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:02.869632 31416 leader_election.cc:304] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:02.881223 31191 leader_election.cc:304] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:02.896145 31341 leader_election.cc:304] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:02.897576 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a5ca73a494b4d7389eec90025653337" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:02.897784 31341 leader_election.cc:304] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:02.899034 31682 raft_consensus.cc:2749] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:02.899084 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b4a1f3d804ae39a009a23ea4e90f3" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:02.899765 31299 raft_consensus.cc:3060] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.899902 31682 raft_consensus.cc:2804] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:02.901603 31682 raft_consensus.cc:697] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Becoming Leader. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:02.902134 31222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93cc0a94606149e18c8764e851f4b826" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:02.902671 31682 consensus_queue.cc:237] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:02.908362 31501 consensus_queue.cc:1048] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:02.900022 31686 raft_consensus.cc:2749] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260203 09:18:02.916961 31299 raft_consensus.cc:2468] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
W20260203 09:18:02.927956 31416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:45511, user_credentials={real_user=slave}} blocked reactor thread for 72399.4us
W20260203 09:18:02.932749 31191 leader_election.cc:343] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:02.933328 31191 leader_election.cc:304] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:02.926451 31341 leader_election.cc:304] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:02.926324 31708 raft_consensus.cc:2804] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:02.936265 31495 tablet_bootstrap.cc:492] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:02.937243 31495 ts_tablet_manager.cc:1403] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.239s user 0.027s sys 0.006s
I20260203 09:18:02.938453 31628 raft_consensus.cc:2749] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:02.942487 31496 ts_tablet_manager.cc:1434] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.116s user 0.009s sys 0.000s
I20260203 09:18:02.944454 31504 tablet_bootstrap.cc:492] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:02.944981 31504 ts_tablet_manager.cc:1403] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.241s user 0.010s sys 0.008s
I20260203 09:18:02.951978 31496 tablet_bootstrap.cc:492] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:02.940208 31708 raft_consensus.cc:697] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:02.954970 31708 consensus_queue.cc:237] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:02.959762 31496 tablet_bootstrap.cc:654] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:02.939327 31682 raft_consensus.cc:3060] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:02.980217 31504 raft_consensus.cc:359] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:02.981730 31504 raft_consensus.cc:385] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:02.982162 31504 raft_consensus.cc:740] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:02.983243 31191 leader_election.cc:304] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:02.984166 31628 raft_consensus.cc:2804] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:02.984705 31628 raft_consensus.cc:697] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:02.985688 31628 consensus_queue.cc:237] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:02.989965 31501 raft_consensus.cc:493] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:02.990516 31501 raft_consensus.cc:515] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:02.995719 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "374ce202ecd540008cded117a37bfeba" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:02.998857 31501 leader_election.cc:290] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:03.000002 31121 catalog_manager.cc:5654] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 1 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:03.002146 31222 raft_consensus.cc:3060] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:03.003189 31504 consensus_queue.cc:260] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:03.006350 31224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "374ce202ecd540008cded117a37bfeba" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:03.007267 31224 raft_consensus.cc:2393] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bf9aa3533b14841a52177c8cc3130ec in current term 1: Already voted for candidate 73bf755165c4487c81c67b5ab44f7104 in this term.
I20260203 09:18:03.008857 31416 leader_election.cc:304] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:03.013002 31504 ts_tablet_manager.cc:1434] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.067s user 0.007s sys 0.000s
I20260203 09:18:03.013936 31501 raft_consensus.cc:3060] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:03.017832 31374 raft_consensus.cc:3060] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:03.026062 31494 tablet_bootstrap.cc:492] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:03.026646 31494 ts_tablet_manager.cc:1403] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.312s user 0.021s sys 0.017s
I20260203 09:18:03.026062 31496 tablet_bootstrap.cc:492] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:03.029211 31496 ts_tablet_manager.cc:1403] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.077s user 0.012s sys 0.034s
I20260203 09:18:03.028541 31495 raft_consensus.cc:359] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:03.035359 31495 raft_consensus.cc:385] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:03.034108 31494 raft_consensus.cc:359] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:03.036170 31494 raft_consensus.cc:385] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:03.036396 31494 raft_consensus.cc:740] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:03.037029 31504 tablet_bootstrap.cc:492] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:03.039676 31682 raft_consensus.cc:2749] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:03.035604 31495 raft_consensus.cc:740] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:03.042886 31495 consensus_queue.cc:260] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:03.001951 31121 catalog_manager.cc:5654] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 1 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:03.045192 31495 ts_tablet_manager.cc:1434] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.107s user 0.007s sys 0.000s
I20260203 09:18:03.045615 31708 consensus_queue.cc:1048] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:03.046557 31496 raft_consensus.cc:359] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:03.047243 31496 raft_consensus.cc:385] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:03.047510 31496 raft_consensus.cc:740] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:03.044286 31504 tablet_bootstrap.cc:654] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
W20260203 09:18:03.046037 31171 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:18:03.060735 31495 tablet_bootstrap.cc:492] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:03.063583 31494 consensus_queue.cc:260] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:03.060230 31496 consensus_queue.cc:260] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:03.066977 31494 ts_tablet_manager.cc:1434] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.040s user 0.006s sys 0.000s
I20260203 09:18:03.069836 31494 tablet_bootstrap.cc:492] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:03.065037 31501 raft_consensus.cc:2749] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:03.083931 31496 ts_tablet_manager.cc:1434] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.054s user 0.004s sys 0.003s
I20260203 09:18:03.085250 31496 tablet_bootstrap.cc:492] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:03.086310 31494 tablet_bootstrap.cc:654] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:03.088806 31495 tablet_bootstrap.cc:654] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:03.096634 31708 consensus_queue.cc:1048] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260203 09:18:03.100864 31496 tablet_bootstrap.cc:654] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:03.110164 31504 tablet_bootstrap.cc:492] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:03.110724 31504 ts_tablet_manager.cc:1403] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.079s user 0.017s sys 0.015s
I20260203 09:18:03.112474 31686 consensus_queue.cc:1048] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:03.128233 31504 raft_consensus.cc:359] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:03.129422 31504 raft_consensus.cc:385] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:03.129642 31504 raft_consensus.cc:740] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:03.132946 31504 consensus_queue.cc:260] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:03.135429 31495 tablet_bootstrap.cc:492] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:03.136715 31495 ts_tablet_manager.cc:1403] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.091s user 0.011s sys 0.009s
I20260203 09:18:03.135808 31120 catalog_manager.cc:5654] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67). New cstate: current_term: 1 leader_uuid: "73bf755165c4487c81c67b5ab44f7104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:03.139915 31495 raft_consensus.cc:359] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:03.140668 31495 raft_consensus.cc:385] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:03.140931 31495 raft_consensus.cc:740] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:03.141655 31495 consensus_queue.cc:260] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:03.143229 31628 raft_consensus.cc:493] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:03.143622 31504 ts_tablet_manager.cc:1434] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.033s user 0.006s sys 0.000s
I20260203 09:18:03.143836 31628 raft_consensus.cc:515] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.145123 31594 raft_consensus.cc:493] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:03.145864 31504 tablet_bootstrap.cc:492] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:03.145642 31594 raft_consensus.cc:515] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:03.147394 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:03.147759 31594 leader_election.cc:290] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:03.149302 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3eab34196fcb483abc69a625b7ca6300" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:03.149506 31372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:03.150228 31372 raft_consensus.cc:2468] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:03.151819 31188 leader_election.cc:304] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:03.159228 31448 raft_consensus.cc:2468] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:03.152765 31628 leader_election.cc:290] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:03.160312 31628 raft_consensus.cc:2804] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260203 09:18:03.157513 31267 leader_election.cc:343] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:03.160991 31222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3eab34196fcb483abc69a625b7ca6300" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:03.161085 31628 raft_consensus.cc:493] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:03.171574 31686 raft_consensus.cc:493] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:03.171715 31628 raft_consensus.cc:3060] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:03.172168 31686 raft_consensus.cc:515] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
W20260203 09:18:03.163234 31267 leader_election.cc:343] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:03.173390 31267 leader_election.cc:304] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:03.174255 31686 leader_election.cc:290] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:03.176362 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20dfe4990e0a46ef9b0cf1cdf3dfdb09" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:03.174525 31594 raft_consensus.cc:2749] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260203 09:18:03.178189 31191 leader_election.cc:343] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:03.180023 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20dfe4990e0a46ef9b0cf1cdf3dfdb09" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
W20260203 09:18:03.184938 31191 leader_election.cc:343] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:03.186383 31191 leader_election.cc:304] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:03.168442 31118 catalog_manager.cc:5654] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 0 to 1, leader changed from <none> to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 1 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:03.188550 31682 raft_consensus.cc:493] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:03.187338 31495 ts_tablet_manager.cc:1434] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.050s user 0.007s sys 0.000s
I20260203 09:18:03.192509 31602 raft_consensus.cc:2749] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:03.190249 31682 raft_consensus.cc:515] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:03.194442 31494 tablet_bootstrap.cc:492] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:03.194953 31494 ts_tablet_manager.cc:1403] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.125s user 0.016s sys 0.002s
I20260203 09:18:03.195026 31682 leader_election.cc:290] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:03.196623 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8dbd55217e2546b5b3361ddf019f01d6" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:03.196745 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8dbd55217e2546b5b3361ddf019f01d6" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:03.197659 31494 raft_consensus.cc:359] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.197944 31448 raft_consensus.cc:2468] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 0.
I20260203 09:18:03.198328 31494 raft_consensus.cc:385] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:03.198611 31494 raft_consensus.cc:740] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:03.199043 31341 leader_election.cc:304] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters:
I20260203 09:18:03.199818 31682 raft_consensus.cc:2804] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:03.199283 31494 consensus_queue.cc:260] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
W20260203 09:18:03.199960 31341 leader_election.cc:343] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:03.200213 31682 raft_consensus.cc:493] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:03.200678 31682 raft_consensus.cc:3060] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:03.202139 31494 ts_tablet_manager.cc:1434] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260203 09:18:03.203325 31494 tablet_bootstrap.cc:492] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:03.209839 31118 catalog_manager.cc:5654] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 0 to 1, leader changed from <none> to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 1 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:03.209543 31682 raft_consensus.cc:515] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:03.213219 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8dbd55217e2546b5b3361ddf019f01d6" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:03.214027 31685 consensus_queue.cc:1048] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260203 09:18:03.214644 31341 leader_election.cc:343] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:03.216634 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8dbd55217e2546b5b3361ddf019f01d6" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:03.217226 31448 raft_consensus.cc:3060] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:03.221343 31494 tablet_bootstrap.cc:654] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:03.224013 31496 tablet_bootstrap.cc:492] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:03.224519 31496 ts_tablet_manager.cc:1403] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.140s user 0.008s sys 0.005s
I20260203 09:18:03.227478 31682 leader_election.cc:290] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:03.227283 31496 raft_consensus.cc:359] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.227946 31496 raft_consensus.cc:385] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:03.223930 31495 tablet_bootstrap.cc:492] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:03.228396 31496 raft_consensus.cc:740] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:03.224622 31628 raft_consensus.cc:515] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
W20260203 09:18:03.234392 31413 consensus_peers.cc:597] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec -> Peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Couldn't send request to peer 73bf755165c4487c81c67b5ab44f7104. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:03.235351 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:03.237017 31373 raft_consensus.cc:3060] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:03.229162 31496 consensus_queue.cc:260] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.241215 31628 leader_election.cc:290] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:03.243039 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:03.256194 31450 raft_consensus.cc:3060] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:03.257516 31496 ts_tablet_manager.cc:1434] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.033s user 0.007s sys 0.000s
I20260203 09:18:03.258730 31496 tablet_bootstrap.cc:492] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:03.247977 31504 tablet_bootstrap.cc:654] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:03.251148 31708 consensus_queue.cc:1048] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:03.252147 31685 raft_consensus.cc:493] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:03.262176 31120 catalog_manager.cc:5654] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 1 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:03.252848 31448 raft_consensus.cc:2468] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 1.
I20260203 09:18:03.263185 31685 raft_consensus.cc:515] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:03.267753 31341 leader_election.cc:304] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters: 79b10fa125f242419f66b577440e66d0
I20260203 09:18:03.268865 31682 raft_consensus.cc:2804] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:03.269245 31685 leader_election.cc:290] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:03.269347 31682 raft_consensus.cc:697] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Becoming Leader. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:03.270483 31682 consensus_queue.cc:237] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:03.271915 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9884e996f0443f2ae2ab5606633ce3c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:03.273396 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9884e996f0443f2ae2ab5606633ce3c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
W20260203 09:18:03.275727 31188 leader_election.cc:343] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:18:03.276634 31191 leader_election.cc:343] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:03.277141 31191 leader_election.cc:304] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:03.280846 31628 raft_consensus.cc:2749] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:03.280992 31450 raft_consensus.cc:2468] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 2.
I20260203 09:18:03.283596 31191 leader_election.cc:304] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:03.284515 31685 raft_consensus.cc:2804] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:03.285056 31685 raft_consensus.cc:697] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 2 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:03.285961 31685 consensus_queue.cc:237] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.291057 31496 tablet_bootstrap.cc:654] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:03.291989 31494 tablet_bootstrap.cc:492] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:03.292526 31494 ts_tablet_manager.cc:1403] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.090s user 0.019s sys 0.007s
I20260203 09:18:03.295341 31494 raft_consensus.cc:359] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.296576 31495 tablet_bootstrap.cc:654] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:03.296264 31494 raft_consensus.cc:385] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:03.297012 31494 raft_consensus.cc:740] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:03.297811 31494 consensus_queue.cc:260] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.310218 31373 raft_consensus.cc:2468] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 2.
I20260203 09:18:03.317505 31494 ts_tablet_manager.cc:1434] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.025s user 0.005s sys 0.001s
I20260203 09:18:03.337563 31496 tablet_bootstrap.cc:492] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:03.338498 31496 ts_tablet_manager.cc:1403] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.080s user 0.013s sys 0.002s
I20260203 09:18:03.330655 31682 raft_consensus.cc:493] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:03.343631 31496 raft_consensus.cc:359] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.344324 31496 raft_consensus.cc:385] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:03.344573 31496 raft_consensus.cc:740] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:03.344965 31682 raft_consensus.cc:515] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.345211 31496 consensus_queue.cc:260] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.347402 31682 leader_election.cc:290] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:03.347905 31682 consensus_queue.cc:1048] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:03.348490 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03e1544e85d94310a17e919716a0e5b9" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:03.350457 31450 raft_consensus.cc:2468] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 0.
I20260203 09:18:03.351449 31341 leader_election.cc:304] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters:
I20260203 09:18:03.348448 31496 ts_tablet_manager.cc:1434] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260203 09:18:03.353183 31121 catalog_manager.cc:5654] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67). New cstate: current_term: 1 leader_uuid: "73bf755165c4487c81c67b5ab44f7104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:03.356853 31681 raft_consensus.cc:2804] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:03.357331 31681 raft_consensus.cc:493] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:03.356923 31224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03e1544e85d94310a17e919716a0e5b9" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:03.357749 31681 raft_consensus.cc:3060] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:03.368234 31496 tablet_bootstrap.cc:492] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:03.368561 31504 tablet_bootstrap.cc:492] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:03.371588 31504 ts_tablet_manager.cc:1403] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.226s user 0.017s sys 0.013s
I20260203 09:18:03.374331 31494 tablet_bootstrap.cc:492] T 9e9201a8d64c4b45982d775e4406a3fd P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:03.375808 31495 tablet_bootstrap.cc:492] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:03.376264 31495 ts_tablet_manager.cc:1403] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.153s user 0.011s sys 0.008s
I20260203 09:18:03.379549 31504 raft_consensus.cc:359] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.386758 31504 raft_consensus.cc:385] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:03.387181 31504 raft_consensus.cc:740] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:03.383101 31119 catalog_manager.cc:5654] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 0 to 2, leader changed from <none> to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 2 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:03.383116 31495 raft_consensus.cc:359] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:03.390355 31495 raft_consensus.cc:385] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:03.390762 31495 raft_consensus.cc:740] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:03.391765 31495 consensus_queue.cc:260] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:03.395424 31495 ts_tablet_manager.cc:1434] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.019s user 0.004s sys 0.002s
I20260203 09:18:03.399717 31495 tablet_bootstrap.cc:492] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:03.392831 31504 consensus_queue.cc:260] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.398204 31494 tablet_bootstrap.cc:654] T 9e9201a8d64c4b45982d775e4406a3fd P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:03.385962 31681 raft_consensus.cc:515] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.407527 31504 ts_tablet_manager.cc:1434] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.036s user 0.005s sys 0.002s
W20260203 09:18:03.403174 31341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:45511, user_credentials={real_user=slave}} blocked reactor thread for 50888.3us
W20260203 09:18:03.425002 31341 leader_election.cc:343] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:03.425237 31628 raft_consensus.cc:493] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:03.429167 31628 raft_consensus.cc:515] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.432897 31496 tablet_bootstrap.cc:654] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:03.431834 31495 tablet_bootstrap.cc:654] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:03.441514 31681 leader_election.cc:290] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:03.443626 31594 raft_consensus.cc:493] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:03.444294 31594 raft_consensus.cc:515] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:03.446260 31594 leader_election.cc:290] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:03.449030 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8301405e2ead406caa7440c0337df77d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:03.449781 31223 raft_consensus.cc:2468] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
I20260203 09:18:03.450774 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8301405e2ead406caa7440c0337df77d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:03.451184 31267 leader_election.cc:304] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:03.452788 31594 raft_consensus.cc:2804] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:03.453294 31594 raft_consensus.cc:493] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:03.453395 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87ac8c99d77e47c2b1a373820b27c804" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:03.453764 31594 raft_consensus.cc:3060] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:18:03.454033 31267 leader_election.cc:343] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:03.454442 31448 raft_consensus.cc:2468] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 0.
I20260203 09:18:03.456141 31191 leader_election.cc:304] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:03.451473 31628 leader_election.cc:290] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:03.457113 31628 raft_consensus.cc:2804] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:03.457422 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03e1544e85d94310a17e919716a0e5b9" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:03.458192 31450 raft_consensus.cc:3060] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:03.452955 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87ac8c99d77e47c2b1a373820b27c804" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
W20260203 09:18:03.460253 31188 leader_election.cc:343] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:03.463223 31494 tablet_bootstrap.cc:492] T 9e9201a8d64c4b45982d775e4406a3fd P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:03.463726 31494 ts_tablet_manager.cc:1403] T 9e9201a8d64c4b45982d775e4406a3fd P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.129s user 0.006s sys 0.028s
I20260203 09:18:03.463543 31594 raft_consensus.cc:515] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:03.429215 31504 tablet_bootstrap.cc:492] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:03.467098 31494 raft_consensus.cc:359] T 9e9201a8d64c4b45982d775e4406a3fd P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.471688 31494 raft_consensus.cc:385] T 9e9201a8d64c4b45982d775e4406a3fd P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:03.471976 31494 raft_consensus.cc:740] T 9e9201a8d64c4b45982d775e4406a3fd P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:03.472666 31494 consensus_queue.cc:260] T 9e9201a8d64c4b45982d775e4406a3fd P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.468441 31222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03e1544e85d94310a17e919716a0e5b9" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:03.457533 31628 raft_consensus.cc:493] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:03.473747 31628 raft_consensus.cc:3060] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:03.469305 31707 consensus_queue.cc:1048] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:03.474404 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8301405e2ead406caa7440c0337df77d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:03.473086 31594 leader_election.cc:290] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:03.481489 31682 raft_consensus.cc:493] T 9e9201a8d64c4b45982d775e4406a3fd P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:03.483101 31494 ts_tablet_manager.cc:1434] T 9e9201a8d64c4b45982d775e4406a3fd P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.019s user 0.009s sys 0.000s
I20260203 09:18:03.482057 31682 raft_consensus.cc:515] T 9e9201a8d64c4b45982d775e4406a3fd P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.491633 31682 leader_election.cc:290] T 9e9201a8d64c4b45982d775e4406a3fd P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:03.482755 31222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8301405e2ead406caa7440c0337df77d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:03.492995 31222 raft_consensus.cc:3060] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:03.476429 31681 consensus_queue.cc:1048] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
W20260203 09:18:03.501534 31267 leader_election.cc:343] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:18:03.502238 31341 leader_election.cc:343] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:03.506429 31224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9e9201a8d64c4b45982d775e4406a3fd" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:03.508982 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9e9201a8d64c4b45982d775e4406a3fd" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:03.509277 31628 raft_consensus.cc:515] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.493026 31494 tablet_bootstrap.cc:492] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:03.517477 31341 leader_election.cc:304] T 9e9201a8d64c4b45982d775e4406a3fd P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
W20260203 09:18:03.518251 31188 consensus_peers.cc:597] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a -> Peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Couldn't send request to peer 73bf755165c4487c81c67b5ab44f7104. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:03.520442 31681 raft_consensus.cc:2749] T 9e9201a8d64c4b45982d775e4406a3fd P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:03.521504 31496 tablet_bootstrap.cc:492] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:03.522102 31496 ts_tablet_manager.cc:1403] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.154s user 0.010s sys 0.005s
I20260203 09:18:03.511765 31450 raft_consensus.cc:2468] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 1.
I20260203 09:18:03.527645 31681 raft_consensus.cc:493] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:03.531641 31681 raft_consensus.cc:515] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.533803 31681 leader_election.cc:290] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:03.533975 31685 consensus_queue.cc:1048] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:03.542678 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70796ace22d548219e05b0c9a86346e7" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:03.543056 31224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70796ace22d548219e05b0c9a86346e7" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:03.543736 31224 raft_consensus.cc:2468] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 0.
I20260203 09:18:03.544813 31341 leader_election.cc:304] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:03.545845 31681 raft_consensus.cc:2804] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:03.546270 31681 raft_consensus.cc:493] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:03.546612 31681 raft_consensus.cc:3060] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:03.554039 31222 raft_consensus.cc:2468] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:03.555758 31267 leader_election.cc:304] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:03.556718 31594 raft_consensus.cc:2804] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:03.557191 31594 raft_consensus.cc:697] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:03.558230 31494 tablet_bootstrap.cc:654] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:03.558049 31594 consensus_queue.cc:237] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:03.557281 31504 tablet_bootstrap.cc:654] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:03.562983 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87ac8c99d77e47c2b1a373820b27c804" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
W20260203 09:18:03.564491 31188 leader_election.cc:343] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:03.561420 31341 leader_election.cc:304] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:03.568663 31682 raft_consensus.cc:2804] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:03.569159 31682 raft_consensus.cc:697] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Becoming Leader. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:03.569999 31682 consensus_queue.cc:237] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
W20260203 09:18:03.572775 31341 leader_election.cc:343] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:03.577733 31628 leader_election.cc:290] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:03.570392 31373 raft_consensus.cc:3060] T 9e9201a8d64c4b45982d775e4406a3fd P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:03.578967 31496 raft_consensus.cc:359] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.583312 31496 raft_consensus.cc:385] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:03.583623 31496 raft_consensus.cc:740] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:03.585376 31496 consensus_queue.cc:260] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.587541 31504 tablet_bootstrap.cc:492] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:03.588011 31496 ts_tablet_manager.cc:1434] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.066s user 0.004s sys 0.003s
I20260203 09:18:03.589393 31496 tablet_bootstrap.cc:492] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:03.588070 31504 ts_tablet_manager.cc:1403] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.174s user 0.013s sys 0.000s
I20260203 09:18:03.608148 31504 raft_consensus.cc:359] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:03.609086 31504 raft_consensus.cc:385] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:03.598712 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87ac8c99d77e47c2b1a373820b27c804" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:03.611768 31448 raft_consensus.cc:3060] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:03.614809 31504 raft_consensus.cc:740] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:03.616075 31504 consensus_queue.cc:260] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:03.609158 31681 raft_consensus.cc:515] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.618804 31681 leader_election.cc:290] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:03.628667 31504 ts_tablet_manager.cc:1434] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.036s user 0.004s sys 0.002s
I20260203 09:18:03.629843 31504 tablet_bootstrap.cc:492] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:03.637596 31495 tablet_bootstrap.cc:492] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:03.638075 31495 ts_tablet_manager.cc:1403] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.239s user 0.016s sys 0.033s
I20260203 09:18:03.638842 31494 tablet_bootstrap.cc:492] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:03.639259 31494 ts_tablet_manager.cc:1403] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.146s user 0.011s sys 0.007s
I20260203 09:18:03.648955 31448 raft_consensus.cc:2468] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:03.650736 31191 leader_election.cc:304] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:03.651559 31689 raft_consensus.cc:2804] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:03.652032 31689 raft_consensus.cc:697] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:03.655193 31689 consensus_queue.cc:237] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.657269 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70796ace22d548219e05b0c9a86346e7" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:03.657939 31449 raft_consensus.cc:3060] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:03.658006 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70796ace22d548219e05b0c9a86346e7" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:03.658699 31223 raft_consensus.cc:3060] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:03.664950 31496 tablet_bootstrap.cc:654] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:03.658035 31121 catalog_manager.cc:5654] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 1 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:03.668772 31449 raft_consensus.cc:2468] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 1.
I20260203 09:18:03.671157 31504 tablet_bootstrap.cc:654] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:03.682345 31494 raft_consensus.cc:359] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:03.683111 31494 raft_consensus.cc:385] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:03.683379 31494 raft_consensus.cc:740] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:03.687215 31504 tablet_bootstrap.cc:492] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:03.689213 31504 ts_tablet_manager.cc:1403] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.060s user 0.005s sys 0.009s
I20260203 09:18:03.691426 31504 raft_consensus.cc:359] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:03.691943 31504 raft_consensus.cc:385] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:03.692214 31504 raft_consensus.cc:740] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:03.692893 31504 consensus_queue.cc:260] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:03.692929 31119 catalog_manager.cc:5654] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67). New cstate: current_term: 1 leader_uuid: "73bf755165c4487c81c67b5ab44f7104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:03.693822 31118 catalog_manager.cc:5654] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 0 to 1, leader changed from <none> to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 1 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:03.695655 31504 ts_tablet_manager.cc:1434] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.006s user 0.004s sys 0.002s
I20260203 09:18:03.696599 31504 tablet_bootstrap.cc:492] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:03.699970 31494 consensus_queue.cc:260] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:03.704912 31588 consensus_queue.cc:1048] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:03.701364 31495 raft_consensus.cc:359] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:03.707234 31495 raft_consensus.cc:385] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:03.707466 31495 raft_consensus.cc:740] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:03.710625 31223 raft_consensus.cc:2468] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 1.
I20260203 09:18:03.717947 31494 ts_tablet_manager.cc:1434] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.078s user 0.006s sys 0.001s
I20260203 09:18:03.719064 31494 tablet_bootstrap.cc:492] T dbf01f6b7a2f4b7db0978441f72e138d P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:03.722121 31341 leader_election.cc:304] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters:
I20260203 09:18:03.724010 31504 tablet_bootstrap.cc:654] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:03.725390 31375 raft_consensus.cc:3060] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:03.725883 31496 tablet_bootstrap.cc:492] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:03.726420 31496 ts_tablet_manager.cc:1403] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.137s user 0.012s sys 0.000s
I20260203 09:18:03.708832 31495 consensus_queue.cc:260] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:03.729122 31496 raft_consensus.cc:359] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.732036 31496 raft_consensus.cc:385] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:03.732264 31496 raft_consensus.cc:740] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:03.736127 31750 raft_consensus.cc:2804] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:03.745203 31750 raft_consensus.cc:697] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Becoming Leader. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:03.746105 31750 consensus_queue.cc:237] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.749012 31689 raft_consensus.cc:493] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:03.749639 31689 raft_consensus.cc:515] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:03.736438 31496 consensus_queue.cc:260] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.751809 31689 leader_election.cc:290] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:03.757102 31496 ts_tablet_manager.cc:1434] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.030s user 0.006s sys 0.000s
I20260203 09:18:03.758296 31496 tablet_bootstrap.cc:492] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:03.761814 31602 raft_consensus.cc:493] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:03.762480 31602 raft_consensus.cc:515] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:03.765189 31588 raft_consensus.cc:493] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:03.767031 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:03.769892 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:03.772512 31588 raft_consensus.cc:515] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.770748 31371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5ccddc8d332443c97a92e59957dfa69" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:03.772769 31373 raft_consensus.cc:2468] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 2.
W20260203 09:18:03.774773 31188 leader_election.cc:343] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:03.775004 31588 leader_election.cc:290] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:03.776288 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a5ca73a494b4d7389eec90025653337" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:03.776981 31223 raft_consensus.cc:2468] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 0.
I20260203 09:18:03.777208 31188 leader_election.cc:304] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:03.767413 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5ccddc8d332443c97a92e59957dfa69" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:03.778270 31685 raft_consensus.cc:2804] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:18:03.778658 31685 raft_consensus.cc:493] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:03.778986 31685 raft_consensus.cc:3060] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:18:03.782042 31191 leader_election.cc:343] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:03.782608 31191 leader_election.cc:304] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:03.787956 31496 tablet_bootstrap.cc:654] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:03.785099 31628 raft_consensus.cc:2749] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:03.788514 31371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a5ca73a494b4d7389eec90025653337" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:03.797202 31416 leader_election.cc:304] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:03.764603 31602 leader_election.cc:290] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:03.798167 31588 raft_consensus.cc:2804] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:03.798530 31588 raft_consensus.cc:493] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:03.798866 31588 raft_consensus.cc:3060] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:18:03.802652 31413 leader_election.cc:343] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:03.802994 31495 ts_tablet_manager.cc:1434] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.165s user 0.005s sys 0.002s
I20260203 09:18:03.804109 31495 tablet_bootstrap.cc:492] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:03.812116 31602 raft_consensus.cc:493] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:03.812722 31602 raft_consensus.cc:515] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:03.814365 31588 raft_consensus.cc:515] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.814679 31602 leader_election.cc:290] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:03.816368 31371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f6fed7d1dca4d4184fd89b136a55ec1" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:03.817045 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a5ca73a494b4d7389eec90025653337" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
W20260203 09:18:03.818303 31413 leader_election.cc:343] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:18:03.818542 31188 leader_election.cc:343] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:03.823652 31494 tablet_bootstrap.cc:654] T dbf01f6b7a2f4b7db0978441f72e138d P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:03.824517 31588 leader_election.cc:290] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:03.828258 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a5ca73a494b4d7389eec90025653337" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:03.828820 31682 consensus_queue.cc:1048] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:03.831646 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f6fed7d1dca4d4184fd89b136a55ec1" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:03.834460 31223 raft_consensus.cc:3060] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:18:03.837599 31191 leader_election.cc:343] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:03.828294 31685 raft_consensus.cc:515] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:03.846035 31191 leader_election.cc:304] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:03.857515 31689 raft_consensus.cc:2749] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:03.864632 31500 raft_consensus.cc:493] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:03.865240 31500 raft_consensus.cc:515] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:03.867353 31500 leader_election.cc:290] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:03.870107 31504 tablet_bootstrap.cc:492] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:03.870548 31504 ts_tablet_manager.cc:1403] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.174s user 0.027s sys 0.036s
I20260203 09:18:03.875389 31222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbf01f6b7a2f4b7db0978441f72e138d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:03.876163 31222 raft_consensus.cc:2468] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
I20260203 09:18:03.879343 31373 raft_consensus.cc:1275] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260203 09:18:03.882443 31371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbf01f6b7a2f4b7db0978441f72e138d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:03.873764 31223 raft_consensus.cc:2468] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 1.
W20260203 09:18:03.888772 31264 leader_election.cc:343] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:03.891903 31267 leader_election.cc:304] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:03.892776 31500 raft_consensus.cc:2804] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:03.893149 31500 raft_consensus.cc:493] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:03.893487 31500 raft_consensus.cc:3060] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:03.894171 31628 consensus_queue.cc:1048] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:03.896696 31299 raft_consensus.cc:3060] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:03.897722 31448 raft_consensus.cc:1275] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260203 09:18:03.899343 31524 consensus_queue.cc:1048] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:03.901068 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:03.902473 31372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:03.903086 31372 raft_consensus.cc:3060] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:03.905714 31495 tablet_bootstrap.cc:654] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:03.906282 31685 leader_election.cc:290] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:03.909021 31416 leader_election.cc:304] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:03.916317 31494 tablet_bootstrap.cc:492] T dbf01f6b7a2f4b7db0978441f72e138d P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:03.916958 31494 ts_tablet_manager.cc:1403] T dbf01f6b7a2f4b7db0978441f72e138d P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.198s user 0.008s sys 0.005s
I20260203 09:18:03.930167 31504 raft_consensus.cc:359] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.930936 31504 raft_consensus.cc:385] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:03.931210 31504 raft_consensus.cc:740] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:03.931872 31504 consensus_queue.cc:260] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.914582 31588 raft_consensus.cc:2804] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:03.933629 31588 raft_consensus.cc:697] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:03.934465 31588 consensus_queue.cc:237] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:03.941286 31504 ts_tablet_manager.cc:1434] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.070s user 0.007s sys 0.000s
I20260203 09:18:03.942602 31504 tablet_bootstrap.cc:492] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:03.914275 31685 raft_consensus.cc:493] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:03.945050 31685 raft_consensus.cc:515] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:03.947134 31685 leader_election.cc:290] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:03.948768 31594 raft_consensus.cc:493] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:03.949344 31594 raft_consensus.cc:515] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:03.951325 31594 leader_election.cc:290] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:03.952270 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3eab34196fcb483abc69a625b7ca6300" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:03.952589 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3eab34196fcb483abc69a625b7ca6300" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:03.953128 31298 raft_consensus.cc:2468] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 0.
W20260203 09:18:03.956331 31191 leader_election.cc:343] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:03.958527 31494 raft_consensus.cc:359] T dbf01f6b7a2f4b7db0978441f72e138d P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:03.959283 31494 raft_consensus.cc:385] T dbf01f6b7a2f4b7db0978441f72e138d P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:03.959600 31494 raft_consensus.cc:740] T dbf01f6b7a2f4b7db0978441f72e138d P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:03.961053 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:03.960250 31494 consensus_queue.cc:260] T dbf01f6b7a2f4b7db0978441f72e138d P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:03.958981 31372 raft_consensus.cc:2468] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 3.
I20260203 09:18:03.977947 31496 tablet_bootstrap.cc:492] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:03.978370 31496 ts_tablet_manager.cc:1403] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.220s user 0.018s sys 0.013s
I20260203 09:18:03.980991 31758 raft_consensus.cc:493] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:03.981326 31188 leader_election.cc:304] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters: 79b10fa125f242419f66b577440e66d0
I20260203 09:18:03.981564 31758 raft_consensus.cc:515] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:03.981087 31222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:03.983032 31222 raft_consensus.cc:2368] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79b10fa125f242419f66b577440e66d0 for earlier term 2. Current term is 3.
I20260203 09:18:03.984824 31524 raft_consensus.cc:2804] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:18:03.985309 31524 raft_consensus.cc:697] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 3 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:03.986205 31524 consensus_queue.cc:237] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:03.986394 31494 ts_tablet_manager.cc:1434] T dbf01f6b7a2f4b7db0978441f72e138d P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.069s user 0.007s sys 0.000s
I20260203 09:18:03.987799 31496 raft_consensus.cc:359] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:03.988484 31496 raft_consensus.cc:385] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:03.989635 31496 raft_consensus.cc:740] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:03.990378 31496 consensus_queue.cc:260] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:03.992660 31496 ts_tablet_manager.cc:1434] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20260203 09:18:03.993252 31494 tablet_bootstrap.cc:492] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:03.976883 31500 raft_consensus.cc:515] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:03.995337 31496 tablet_bootstrap.cc:492] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:03.996774 31682 consensus_queue.cc:1048] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:04.000967 31267 leader_election.cc:400] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Vote denied by peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511) with higher term. Message: Invalid argument: T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79b10fa125f242419f66b577440e66d0 for earlier term 2. Current term is 3.
I20260203 09:18:04.001132 31191 leader_election.cc:304] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:04.023785 31494 tablet_bootstrap.cc:654] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:04.024586 31689 raft_consensus.cc:2804] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:04.025084 31689 raft_consensus.cc:493] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:04.025415 31689 raft_consensus.cc:3060] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:04.025311 31504 tablet_bootstrap.cc:654] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:04.038667 31494 tablet_bootstrap.cc:492] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:04.039166 31494 ts_tablet_manager.cc:1403] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.049s user 0.009s sys 0.014s
I20260203 09:18:04.001356 31267 leader_election.cc:403] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260203 09:18:04.010881 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbf01f6b7a2f4b7db0978441f72e138d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:04.042380 31494 raft_consensus.cc:359] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.042816 31373 raft_consensus.cc:3060] T dbf01f6b7a2f4b7db0978441f72e138d P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:04.016732 31371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8dbd55217e2546b5b3361ddf019f01d6" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
W20260203 09:18:04.043520 31267 consensus_peers.cc:597] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 -> Peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Couldn't send request to peer 2bf9aa3533b14841a52177c8cc3130ec. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:04.044317 31496 tablet_bootstrap.cc:654] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:04.047256 31495 tablet_bootstrap.cc:492] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:04.044385 31759 raft_consensus.cc:3060] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 3
I20260203 09:18:04.047792 31689 raft_consensus.cc:515] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:04.016834 31758 leader_election.cc:290] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:04.050516 31682 consensus_queue.cc:1048] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:04.051157 31373 raft_consensus.cc:2468] T dbf01f6b7a2f4b7db0978441f72e138d P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:04.051919 31494 raft_consensus.cc:385] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:04.052237 31494 raft_consensus.cc:740] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:04.052983 31495 ts_tablet_manager.cc:1403] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.249s user 0.009s sys 0.006s
I20260203 09:18:04.053849 31264 leader_election.cc:304] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:04.054586 31758 raft_consensus.cc:2804] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:04.055781 31495 raft_consensus.cc:359] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:04.008376 31500 leader_election.cc:290] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:04.023092 31120 catalog_manager.cc:5654] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67). New cstate: current_term: 1 leader_uuid: "73bf755165c4487c81c67b5ab44f7104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:04.052996 31494 consensus_queue.cc:260] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.059386 31759 raft_consensus.cc:2749] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511) with higher term. Message: Invalid argument: T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79b10fa125f242419f66b577440e66d0 for earlier term 2. Current term is 3.
I20260203 09:18:04.056483 31495 raft_consensus.cc:385] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:04.060578 31495 raft_consensus.cc:740] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:04.060312 31494 ts_tablet_manager.cc:1434] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.021s user 0.004s sys 0.004s
I20260203 09:18:04.062774 31758 raft_consensus.cc:697] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:04.063064 31494 tablet_bootstrap.cc:492] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:04.063177 31495 consensus_queue.cc:260] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:04.063688 31758 consensus_queue.cc:237] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.065946 31495 ts_tablet_manager.cc:1434] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20260203 09:18:04.067006 31495 tablet_bootstrap.cc:492] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:04.070454 31494 tablet_bootstrap.cc:654] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
W20260203 09:18:04.076450 31341 consensus_peers.cc:597] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:04.079510 31222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbf01f6b7a2f4b7db0978441f72e138d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:04.080255 31222 raft_consensus.cc:3060] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:04.080562 31504 tablet_bootstrap.cc:492] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:04.081128 31504 ts_tablet_manager.cc:1403] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.139s user 0.010s sys 0.003s
I20260203 09:18:04.083837 31504 raft_consensus.cc:359] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:04.084496 31494 tablet_bootstrap.cc:492] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:04.085052 31494 ts_tablet_manager.cc:1403] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.022s user 0.012s sys 0.005s
I20260203 09:18:04.087350 31496 tablet_bootstrap.cc:492] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:04.087872 31496 ts_tablet_manager.cc:1403] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.094s user 0.010s sys 0.000s
I20260203 09:18:04.090476 31496 raft_consensus.cc:359] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:04.091166 31496 raft_consensus.cc:385] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:04.091439 31496 raft_consensus.cc:740] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:04.092535 31494 raft_consensus.cc:359] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.093465 31494 raft_consensus.cc:385] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:04.093730 31494 raft_consensus.cc:740] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:04.084549 31504 raft_consensus.cc:385] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:04.094210 31504 raft_consensus.cc:740] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:04.094534 31494 consensus_queue.cc:260] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.094908 31504 consensus_queue.cc:260] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:04.097287 31494 ts_tablet_manager.cc:1434] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.012s user 0.007s sys 0.000s
I20260203 09:18:04.098295 31494 tablet_bootstrap.cc:492] T c2ce342ceda546bbad30e8eff5485a48 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:04.100369 31495 tablet_bootstrap.cc:654] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
W20260203 09:18:04.104074 31171 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:18:04.104218 31494 tablet_bootstrap.cc:654] T c2ce342ceda546bbad30e8eff5485a48 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:04.109234 31504 ts_tablet_manager.cc:1434] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.028s user 0.004s sys 0.002s
I20260203 09:18:04.110868 31504 tablet_bootstrap.cc:492] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
W20260203 09:18:04.111562 31188 consensus_peers.cc:597] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a -> Peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Couldn't send request to peer 73bf755165c4487c81c67b5ab44f7104. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:04.116266 31494 tablet_bootstrap.cc:492] T c2ce342ceda546bbad30e8eff5485a48 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:04.116863 31494 ts_tablet_manager.cc:1403] T c2ce342ceda546bbad30e8eff5485a48 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.019s user 0.010s sys 0.007s
I20260203 09:18:04.117847 31496 consensus_queue.cc:260] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:04.120407 31602 consensus_queue.cc:1048] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:04.126718 31496 ts_tablet_manager.cc:1434] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.039s user 0.006s sys 0.001s
I20260203 09:18:04.128042 31496 tablet_bootstrap.cc:492] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:04.128269 31682 raft_consensus.cc:493] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:04.128918 31682 raft_consensus.cc:515] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.130990 31682 leader_election.cc:290] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:04.132858 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b4a1f3d804ae39a009a23ea4e90f3" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:04.133145 31494 raft_consensus.cc:359] T c2ce342ceda546bbad30e8eff5485a48 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:04.135341 31494 raft_consensus.cc:385] T c2ce342ceda546bbad30e8eff5485a48 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:04.135448 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b4a1f3d804ae39a009a23ea4e90f3" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:04.137041 31494 raft_consensus.cc:740] T c2ce342ceda546bbad30e8eff5485a48 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:04.137676 31341 leader_election.cc:304] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:04.141533 31494 consensus_queue.cc:260] T c2ce342ceda546bbad30e8eff5485a48 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:04.142719 31738 raft_consensus.cc:2749] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:04.144060 31494 ts_tablet_manager.cc:1434] T c2ce342ceda546bbad30e8eff5485a48 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.027s user 0.006s sys 0.000s
I20260203 09:18:04.144073 31504 tablet_bootstrap.cc:654] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:04.145264 31494 tablet_bootstrap.cc:492] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:04.145658 31222 raft_consensus.cc:2468] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:04.146965 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8dbd55217e2546b5b3361ddf019f01d6" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:04.162448 31496 tablet_bootstrap.cc:654] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:04.153620 31494 tablet_bootstrap.cc:654] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:04.159231 31495 tablet_bootstrap.cc:492] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:04.165378 31495 ts_tablet_manager.cc:1403] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.099s user 0.013s sys 0.000s
I20260203 09:18:04.175859 31495 raft_consensus.cc:359] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.181532 31495 raft_consensus.cc:385] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:04.181946 31495 raft_consensus.cc:740] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:04.182715 31689 leader_election.cc:290] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:04.188050 31504 tablet_bootstrap.cc:492] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:04.188716 31504 ts_tablet_manager.cc:1403] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.078s user 0.015s sys 0.000s
I20260203 09:18:04.191622 31504 raft_consensus.cc:359] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.192389 31504 raft_consensus.cc:385] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:04.192638 31504 raft_consensus.cc:740] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:04.200485 31504 consensus_queue.cc:260] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.201179 31495 consensus_queue.cc:260] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.203167 31504 ts_tablet_manager.cc:1434] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20260203 09:18:04.203562 31119 catalog_manager.cc:5654] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 1 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:04.206008 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3eab34196fcb483abc69a625b7ca6300" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:04.208724 31496 tablet_bootstrap.cc:492] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
W20260203 09:18:04.208796 31191 leader_election.cc:343] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:04.179011 31267 leader_election.cc:304] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:04.209741 31496 ts_tablet_manager.cc:1403] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.082s user 0.010s sys 0.004s
I20260203 09:18:04.210325 31758 raft_consensus.cc:493] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:04.210829 31758 raft_consensus.cc:515] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.212828 31496 raft_consensus.cc:359] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:04.213605 31496 raft_consensus.cc:385] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:04.213872 31496 raft_consensus.cc:740] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:04.215524 31758 leader_election.cc:290] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:04.217304 31371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14073202fe424a9b9a72f4c7e6075bdf" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:04.217562 31758 raft_consensus.cc:493] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:04.218128 31758 raft_consensus.cc:515] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:04.220036 31758 leader_election.cc:290] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
W20260203 09:18:04.221061 31264 leader_election.cc:343] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:04.220839 31118 catalog_manager.cc:5654] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } }
W20260203 09:18:04.222555 31267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:42099, user_credentials={real_user=slave}} blocked reactor thread for 43653.9us
I20260203 09:18:04.207564 31495 ts_tablet_manager.cc:1434] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.042s user 0.006s sys 0.001s
I20260203 09:18:04.225184 31495 tablet_bootstrap.cc:492] T c2ce342ceda546bbad30e8eff5485a48 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:04.227555 31682 raft_consensus.cc:493] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:04.228103 31682 raft_consensus.cc:515] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.228950 31496 consensus_queue.cc:260] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:04.229652 31500 consensus_queue.cc:1048] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:04.230255 31682 leader_election.cc:290] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:04.231853 31496 ts_tablet_manager.cc:1434] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.022s user 0.006s sys 0.000s
I20260203 09:18:04.232239 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5ccddc8d332443c97a92e59957dfa69" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:04.232959 31496 tablet_bootstrap.cc:492] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
W20260203 09:18:04.233878 31341 leader_election.cc:343] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:04.236483 31222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5ccddc8d332443c97a92e59957dfa69" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:04.237396 31222 raft_consensus.cc:2468] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 0.
I20260203 09:18:04.237356 31504 tablet_bootstrap.cc:492] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:04.238602 31341 leader_election.cc:304] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters: 79b10fa125f242419f66b577440e66d0
I20260203 09:18:04.239905 31682 raft_consensus.cc:2804] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:04.240275 31682 raft_consensus.cc:493] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:04.240621 31682 raft_consensus.cc:3060] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:04.245787 31504 tablet_bootstrap.cc:654] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:04.246744 31222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14073202fe424a9b9a72f4c7e6075bdf" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:04.247252 31758 raft_consensus.cc:2749] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:04.254498 31494 tablet_bootstrap.cc:492] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:04.255002 31494 ts_tablet_manager.cc:1403] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.110s user 0.009s sys 0.003s
I20260203 09:18:04.257576 31494 raft_consensus.cc:359] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.258253 31494 raft_consensus.cc:385] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:04.258522 31494 raft_consensus.cc:740] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:04.260191 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4d4fa5c03a74205a7c5fdda5e37cfe4" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:04.260982 31448 raft_consensus.cc:2468] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
I20260203 09:18:04.262967 31222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4d4fa5c03a74205a7c5fdda5e37cfe4" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:04.263367 31496 tablet_bootstrap.cc:654] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:04.263563 31222 raft_consensus.cc:2468] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:04.267266 31504 tablet_bootstrap.cc:492] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:04.267822 31504 ts_tablet_manager.cc:1403] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.031s user 0.010s sys 0.000s
I20260203 09:18:04.270627 31504 raft_consensus.cc:359] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:04.274472 31494 consensus_queue.cc:260] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.275298 31682 raft_consensus.cc:515] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.275826 31708 raft_consensus.cc:493] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:04.282888 31708 raft_consensus.cc:515] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:04.283766 31496 tablet_bootstrap.cc:492] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:04.284369 31496 ts_tablet_manager.cc:1403] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.052s user 0.012s sys 0.001s
I20260203 09:18:04.284891 31708 leader_election.cc:290] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:04.286677 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5ccddc8d332443c97a92e59957dfa69" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:04.276280 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3eab34196fcb483abc69a625b7ca6300" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:04.271376 31504 raft_consensus.cc:385] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:04.287418 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3eab34196fcb483abc69a625b7ca6300" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:04.287345 31223 raft_consensus.cc:3060] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:04.287760 31504 raft_consensus.cc:740] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:04.287463 31224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3eab34196fcb483abc69a625b7ca6300" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:04.288874 31224 raft_consensus.cc:2393] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bf9aa3533b14841a52177c8cc3130ec in current term 1: Already voted for candidate d44c40c0ed244c4e962a26f9aebea76a in this term.
I20260203 09:18:04.288837 31504 consensus_queue.cc:260] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:04.290154 31416 leader_election.cc:304] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:04.291349 31504 ts_tablet_manager.cc:1434] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.023s user 0.007s sys 0.000s
I20260203 09:18:04.291553 31708 raft_consensus.cc:3060] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:04.287809 31298 raft_consensus.cc:3060] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:04.299845 31738 consensus_queue.cc:1048] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:04.303465 31504 tablet_bootstrap.cc:492] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:04.306370 31223 raft_consensus.cc:2468] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 1.
I20260203 09:18:04.307734 31341 leader_election.cc:304] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:04.287238 31496 raft_consensus.cc:359] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:04.308633 31496 raft_consensus.cc:385] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:04.308604 31738 raft_consensus.cc:2804] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:04.309414 31738 raft_consensus.cc:697] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Becoming Leader. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:04.310344 31298 raft_consensus.cc:2468] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:04.310281 31738 consensus_queue.cc:237] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.316744 31682 leader_election.cc:290] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:04.286648 31494 ts_tablet_manager.cc:1434] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.031s user 0.006s sys 0.001s
I20260203 09:18:04.318262 31494 tablet_bootstrap.cc:492] T f0a785c5c3bf4846b008f0bc6de21607 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:04.319293 31504 tablet_bootstrap.cc:654] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:04.321166 31524 raft_consensus.cc:493] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:04.281235 31267 leader_election.cc:304] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:04.313796 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5ccddc8d332443c97a92e59957dfa69" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:04.322765 31758 raft_consensus.cc:2804] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:04.316427 31495 tablet_bootstrap.cc:654] T c2ce342ceda546bbad30e8eff5485a48 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:04.321730 31524 raft_consensus.cc:515] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
W20260203 09:18:04.323019 31267 leader_election.cc:343] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:04.323081 31496 raft_consensus.cc:740] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:04.337385 31267 leader_election.cc:304] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:04.338304 31500 raft_consensus.cc:2749] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:04.337898 31496 consensus_queue.cc:260] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
W20260203 09:18:04.323730 31341 leader_election.cc:343] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:04.338840 31371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "563e8640cca54f9cab7822a8136fb583" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
W20260203 09:18:04.340371 31188 leader_election.cc:343] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:04.341226 31496 ts_tablet_manager.cc:1434] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.057s user 0.010s sys 0.005s
I20260203 09:18:04.342258 31496 tablet_bootstrap.cc:492] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:04.348810 31750 consensus_queue.cc:1048] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:04.351123 31689 raft_consensus.cc:493] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:04.351294 31708 raft_consensus.cc:2749] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:04.351642 31689 raft_consensus.cc:515] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:04.353703 31689 leader_election.cc:290] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:04.355463 31371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d46f012a03d4d73afb2cffe5d847486" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:04.357836 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d46f012a03d4d73afb2cffe5d847486" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
W20260203 09:18:04.360088 31191 leader_election.cc:343] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:18:04.360956 31188 leader_election.cc:343] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:04.361368 31188 leader_election.cc:304] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:04.361512 31504 tablet_bootstrap.cc:492] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:04.362202 31504 ts_tablet_manager.cc:1403] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.059s user 0.017s sys 0.001s
I20260203 09:18:04.362987 31689 raft_consensus.cc:2749] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:04.365016 31504 raft_consensus.cc:359] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:04.365662 31504 raft_consensus.cc:385] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:04.365914 31504 raft_consensus.cc:740] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:04.366528 31504 consensus_queue.cc:260] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:04.323222 31758 raft_consensus.cc:493] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:04.367676 31758 raft_consensus.cc:3060] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:04.369037 31504 ts_tablet_manager.cc:1434] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260203 09:18:04.370086 31504 tablet_bootstrap.cc:492] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:04.369709 31118 catalog_manager.cc:5654] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 1 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:04.371315 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "563e8640cca54f9cab7822a8136fb583" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
W20260203 09:18:04.373092 31191 leader_election.cc:343] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:04.373562 31191 leader_election.cc:304] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:04.374411 31689 raft_consensus.cc:2749] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:04.374851 31524 leader_election.cc:290] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:04.379177 31504 tablet_bootstrap.cc:654] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:04.383891 31494 tablet_bootstrap.cc:654] T f0a785c5c3bf4846b008f0bc6de21607 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
W20260203 09:18:04.388067 31267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:45511, user_credentials={real_user=slave}} blocked reactor thread for 65088us
W20260203 09:18:04.415405 31413 consensus_peers.cc:597] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Couldn't send request to peer 73bf755165c4487c81c67b5ab44f7104. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:04.424984 31191 leader_election.cc:304] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:04.426682 31524 raft_consensus.cc:2804] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:04.427217 31524 raft_consensus.cc:697] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:04.427743 31496 tablet_bootstrap.cc:654] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:04.429894 31708 consensus_queue.cc:1048] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:04.431704 31758 raft_consensus.cc:515] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:04.435688 31758 leader_election.cc:290] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:04.438623 31373 raft_consensus.cc:3060] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:04.442750 31119 catalog_manager.cc:5654] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67). New cstate: current_term: 1 leader_uuid: "73bf755165c4487c81c67b5ab44f7104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:04.448808 31682 raft_consensus.cc:493] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:04.449355 31682 raft_consensus.cc:515] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.451283 31682 leader_election.cc:290] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:04.462102 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4d4fa5c03a74205a7c5fdda5e37cfe4" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:04.462803 31449 raft_consensus.cc:3060] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 2
I20260203 09:18:04.474043 31708 raft_consensus.cc:493] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:04.474512 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f6fed7d1dca4d4184fd89b136a55ec1" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:04.456681 31594 raft_consensus.cc:493] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:04.474680 31708 raft_consensus.cc:515] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:04.475246 31225 raft_consensus.cc:2468] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 0.
I20260203 09:18:04.476368 31221 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4d4fa5c03a74205a7c5fdda5e37cfe4" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:04.477016 31221 raft_consensus.cc:3060] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:04.477849 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2ce342ceda546bbad30e8eff5485a48" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:04.477902 31708 leader_election.cc:290] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:04.478960 31371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2ce342ceda546bbad30e8eff5485a48" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
W20260203 09:18:04.479473 31416 leader_election.cc:343] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:04.479597 31371 raft_consensus.cc:2468] T c2ce342ceda546bbad30e8eff5485a48 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 0.
I20260203 09:18:04.428094 31524 consensus_queue.cc:237] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:04.480693 31413 leader_election.cc:304] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters: 79b10fa125f242419f66b577440e66d0
I20260203 09:18:04.481806 31708 raft_consensus.cc:2804] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:04.482163 31708 raft_consensus.cc:493] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:04.482477 31708 raft_consensus.cc:3060] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:04.483986 31341 leader_election.cc:304] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:04.486531 31682 raft_consensus.cc:2804] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:04.475329 31594 raft_consensus.cc:515] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:04.492785 31682 raft_consensus.cc:493] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:04.493182 31682 raft_consensus.cc:3060] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:04.474833 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f6fed7d1dca4d4184fd89b136a55ec1" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:04.502413 31444 raft_consensus.cc:3060] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:18:04.505927 31341 leader_election.cc:343] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:04.508569 31221 raft_consensus.cc:2468] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 2.
I20260203 09:18:04.510172 31689 raft_consensus.cc:493] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:04.526114 31495 tablet_bootstrap.cc:492] T c2ce342ceda546bbad30e8eff5485a48 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:04.527992 31594 leader_election.cc:290] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:04.528882 31449 raft_consensus.cc:2468] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 2.
I20260203 09:18:04.530807 31495 ts_tablet_manager.cc:1403] T c2ce342ceda546bbad30e8eff5485a48 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.306s user 0.014s sys 0.008s
I20260203 09:18:04.534479 31504 tablet_bootstrap.cc:492] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:04.534917 31504 ts_tablet_manager.cc:1403] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.165s user 0.020s sys 0.050s
I20260203 09:18:04.536892 31494 tablet_bootstrap.cc:492] T f0a785c5c3bf4846b008f0bc6de21607 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:04.537322 31494 ts_tablet_manager.cc:1403] T f0a785c5c3bf4846b008f0bc6de21607 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.219s user 0.027s sys 0.021s
I20260203 09:18:04.535233 31689 raft_consensus.cc:515] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:04.547150 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f0a785c5c3bf4846b008f0bc6de21607" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:04.550848 31496 tablet_bootstrap.cc:492] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:04.551293 31496 ts_tablet_manager.cc:1403] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.209s user 0.020s sys 0.042s
I20260203 09:18:04.532796 31758 consensus_queue.cc:1048] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260203 09:18:04.543233 31689 leader_election.cc:290] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:04.554741 31495 raft_consensus.cc:359] T c2ce342ceda546bbad30e8eff5485a48 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:04.556231 31495 raft_consensus.cc:385] T c2ce342ceda546bbad30e8eff5485a48 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:04.556411 31495 raft_consensus.cc:740] T c2ce342ceda546bbad30e8eff5485a48 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:04.547545 31267 leader_election.cc:304] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:04.562701 31758 raft_consensus.cc:2804] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:04.563244 31758 raft_consensus.cc:697] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 2 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:04.564081 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03e1544e85d94310a17e919716a0e5b9" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:04.564284 31446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f0a785c5c3bf4846b008f0bc6de21607" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:04.573078 31682 raft_consensus.cc:515] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
W20260203 09:18:04.574079 31267 leader_election.cc:343] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:04.564054 31758 consensus_queue.cc:237] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:04.580808 31504 raft_consensus.cc:359] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:04.582510 31504 raft_consensus.cc:385] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:04.582759 31504 raft_consensus.cc:740] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:04.583365 31495 consensus_queue.cc:260] T c2ce342ceda546bbad30e8eff5485a48 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:04.583766 31504 consensus_queue.cc:260] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:04.589542 31496 raft_consensus.cc:359] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:04.590237 31496 raft_consensus.cc:385] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:04.590444 31496 raft_consensus.cc:740] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
W20260203 09:18:04.592427 31794 log.cc:927] Time spent T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a: Append to log took a long time: real 0.051s user 0.000s sys 0.001s
I20260203 09:18:04.596074 31496 consensus_queue.cc:260] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:04.601128 31495 ts_tablet_manager.cc:1434] T c2ce342ceda546bbad30e8eff5485a48 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.067s user 0.006s sys 0.000s
I20260203 09:18:04.602224 31495 tablet_bootstrap.cc:492] T f5ccddc8d332443c97a92e59957dfa69 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:04.603967 31504 ts_tablet_manager.cc:1434] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.069s user 0.009s sys 0.001s
I20260203 09:18:04.608083 31495 tablet_bootstrap.cc:654] T f5ccddc8d332443c97a92e59957dfa69 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:04.608318 31682 leader_election.cc:290] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:04.613858 31223 raft_consensus.cc:3060] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:04.603832 31494 raft_consensus.cc:359] T f0a785c5c3bf4846b008f0bc6de21607 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:04.618263 31494 raft_consensus.cc:385] T f0a785c5c3bf4846b008f0bc6de21607 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:04.618551 31494 raft_consensus.cc:740] T f0a785c5c3bf4846b008f0bc6de21607 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:04.607939 31224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f6fed7d1dca4d4184fd89b136a55ec1" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:04.624537 31224 raft_consensus.cc:3060] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:04.630295 31298 raft_consensus.cc:1275] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260203 09:18:04.631937 31689 consensus_queue.cc:1048] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:04.638705 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f6fed7d1dca4d4184fd89b136a55ec1" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:04.640357 31494 consensus_queue.cc:260] T f0a785c5c3bf4846b008f0bc6de21607 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:04.642531 31375 raft_consensus.cc:2468] T f0a785c5c3bf4846b008f0bc6de21607 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
I20260203 09:18:04.643934 31494 ts_tablet_manager.cc:1434] T f0a785c5c3bf4846b008f0bc6de21607 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.106s user 0.006s sys 0.000s
W20260203 09:18:04.648103 31341 leader_election.cc:343] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:04.638764 31373 raft_consensus.cc:1275] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260203 09:18:04.653676 31494 tablet_bootstrap.cc:492] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:04.656912 31496 ts_tablet_manager.cc:1434] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.105s user 0.004s sys 0.003s
I20260203 09:18:04.574877 31708 raft_consensus.cc:515] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:04.666025 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2ce342ceda546bbad30e8eff5485a48" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:04.666975 31299 raft_consensus.cc:3060] T c2ce342ceda546bbad30e8eff5485a48 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:04.677048 31496 tablet_bootstrap.cc:492] T f0a785c5c3bf4846b008f0bc6de21607 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:04.692170 31689 raft_consensus.cc:493] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:04.693550 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03e1544e85d94310a17e919716a0e5b9" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:04.698355 31264 leader_election.cc:304] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:04.688525 31224 raft_consensus.cc:2468] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 1.
I20260203 09:18:04.700395 31758 raft_consensus.cc:2804] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:04.700801 31758 raft_consensus.cc:493] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:04.701143 31758 raft_consensus.cc:3060] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:04.701031 31341 leader_election.cc:304] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters: 79b10fa125f242419f66b577440e66d0
I20260203 09:18:04.704211 31738 raft_consensus.cc:2804] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:04.704702 31738 raft_consensus.cc:697] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Becoming Leader. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:04.695195 31524 raft_consensus.cc:493] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:04.701531 31119 catalog_manager.cc:5654] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 0 to 2, leader changed from <none> to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 2 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:04.711474 31738 consensus_queue.cc:237] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.714605 31496 tablet_bootstrap.cc:654] T f0a785c5c3bf4846b008f0bc6de21607 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:04.722285 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2ce342ceda546bbad30e8eff5485a48" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:04.722970 31373 raft_consensus.cc:3060] T c2ce342ceda546bbad30e8eff5485a48 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:04.717481 31524 raft_consensus.cc:515] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:04.726104 31594 consensus_queue.cc:1048] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260203 09:18:04.727015 31795 log.cc:927] Time spent T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec: Append to log took a long time: real 0.124s user 0.005s sys 0.000s
I20260203 09:18:04.728276 31524 leader_election.cc:290] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:04.732256 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9e063333ea146ed9efb0110b67e9520" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:04.733052 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9e063333ea146ed9efb0110b67e9520" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:04.699111 31689 raft_consensus.cc:515] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.735407 31689 leader_election.cc:290] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
W20260203 09:18:04.735972 31191 leader_election.cc:343] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:04.737079 31191 leader_election.cc:304] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:04.738947 31602 raft_consensus.cc:2749] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:04.738606 31123 catalog_manager.cc:5654] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 0 to 1, leader changed from <none> to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 1 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } }
W20260203 09:18:04.741844 31799 log.cc:927] Time spent T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0: Append to log took a long time: real 0.066s user 0.001s sys 0.000s
I20260203 09:18:04.749665 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f94dad823fea42d2976b19da7bc7b258" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:04.708590 31708 leader_election.cc:290] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
W20260203 09:18:04.754737 31191 leader_election.cc:343] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:04.758626 31495 tablet_bootstrap.cc:492] T f5ccddc8d332443c97a92e59957dfa69 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:04.759168 31495 ts_tablet_manager.cc:1403] T f5ccddc8d332443c97a92e59957dfa69 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.157s user 0.042s sys 0.050s
W20260203 09:18:04.769565 31191 leader_election.cc:343] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:04.771955 31191 leader_election.cc:304] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:04.777313 31504 tablet_bootstrap.cc:492] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:04.760056 31373 raft_consensus.cc:2468] T c2ce342ceda546bbad30e8eff5485a48 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 1.
I20260203 09:18:04.778072 31685 raft_consensus.cc:2749] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260203 09:18:04.791245 31804 log.cc:927] Time spent T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a: Append to log took a long time: real 0.076s user 0.001s sys 0.000s
I20260203 09:18:04.792537 31494 tablet_bootstrap.cc:654] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:04.793500 31413 leader_election.cc:304] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters:
I20260203 09:18:04.794557 31798 raft_consensus.cc:2804] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:04.795032 31798 raft_consensus.cc:697] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:04.795809 31798 consensus_queue.cc:237] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:04.796520 31118 catalog_manager.cc:5654] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67). New cstate: current_term: 1 leader_uuid: "73bf755165c4487c81c67b5ab44f7104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:04.800335 31685 consensus_queue.cc:1048] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:04.802970 31758 raft_consensus.cc:515] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:04.804983 31299 raft_consensus.cc:2468] T c2ce342ceda546bbad30e8eff5485a48 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 1.
I20260203 09:18:04.807905 31495 raft_consensus.cc:359] T f5ccddc8d332443c97a92e59957dfa69 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.808679 31495 raft_consensus.cc:385] T f5ccddc8d332443c97a92e59957dfa69 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:04.808961 31495 raft_consensus.cc:740] T f5ccddc8d332443c97a92e59957dfa69 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:04.809592 31495 consensus_queue.cc:260] T f5ccddc8d332443c97a92e59957dfa69 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.813447 31495 ts_tablet_manager.cc:1434] T f5ccddc8d332443c97a92e59957dfa69 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.054s user 0.007s sys 0.001s
I20260203 09:18:04.814798 31495 tablet_bootstrap.cc:492] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:04.819473 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f0a785c5c3bf4846b008f0bc6de21607" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:04.820281 31758 leader_election.cc:290] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:04.822244 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f0a785c5c3bf4846b008f0bc6de21607" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:04.823479 31496 tablet_bootstrap.cc:492] T f0a785c5c3bf4846b008f0bc6de21607 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:04.824014 31496 ts_tablet_manager.cc:1403] T f0a785c5c3bf4846b008f0bc6de21607 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.151s user 0.018s sys 0.002s
W20260203 09:18:04.824316 31267 leader_election.cc:343] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:04.820142 31373 raft_consensus.cc:3060] T f0a785c5c3bf4846b008f0bc6de21607 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:04.826694 31496 raft_consensus.cc:359] T f0a785c5c3bf4846b008f0bc6de21607 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:04.827407 31496 raft_consensus.cc:385] T f0a785c5c3bf4846b008f0bc6de21607 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:04.827706 31496 raft_consensus.cc:740] T f0a785c5c3bf4846b008f0bc6de21607 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:04.823350 31738 consensus_queue.cc:1048] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260203 09:18:04.828373 31496 consensus_queue.cc:260] T f0a785c5c3bf4846b008f0bc6de21607 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:04.831442 31504 tablet_bootstrap.cc:654] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:04.831724 31496 ts_tablet_manager.cc:1434] T f0a785c5c3bf4846b008f0bc6de21607 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260203 09:18:04.842058 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f94dad823fea42d2976b19da7bc7b258" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:04.848718 31496 tablet_bootstrap.cc:492] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:04.857854 31495 tablet_bootstrap.cc:654] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:04.857415 31119 catalog_manager.cc:5654] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 1 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:04.863459 31373 raft_consensus.cc:2468] T f0a785c5c3bf4846b008f0bc6de21607 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:04.864742 31264 leader_election.cc:304] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:04.865859 31758 raft_consensus.cc:2804] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:04.866964 31758 raft_consensus.cc:697] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:04.867766 31758 consensus_queue.cc:237] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
W20260203 09:18:04.873580 31188 leader_election.cc:343] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:04.881008 31188 leader_election.cc:304] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:04.881886 31602 raft_consensus.cc:2749] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:04.887668 31602 raft_consensus.cc:493] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:04.888747 31602 raft_consensus.cc:515] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.889384 31494 tablet_bootstrap.cc:492] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:04.889892 31494 ts_tablet_manager.cc:1403] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.239s user 0.018s sys 0.014s
I20260203 09:18:04.890676 31602 leader_election.cc:290] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:04.892540 31494 raft_consensus.cc:359] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.893280 31494 raft_consensus.cc:385] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:04.893555 31494 raft_consensus.cc:740] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:04.894486 31494 consensus_queue.cc:260] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.896759 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9884e996f0443f2ae2ab5606633ce3c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:04.902014 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9884e996f0443f2ae2ab5606633ce3c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:04.902648 31375 raft_consensus.cc:2468] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 0.
W20260203 09:18:04.904062 31191 leader_election.cc:343] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:04.905965 31495 tablet_bootstrap.cc:492] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:04.906271 31299 raft_consensus.cc:3060] T f5ccddc8d332443c97a92e59957dfa69 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:04.906466 31495 ts_tablet_manager.cc:1403] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.092s user 0.023s sys 0.011s
I20260203 09:18:04.906761 31494 ts_tablet_manager.cc:1434] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.017s user 0.007s sys 0.000s
I20260203 09:18:04.893797 31602 consensus_queue.cc:1048] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260203 09:18:04.907799 31494 tablet_bootstrap.cc:492] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:04.908931 31524 raft_consensus.cc:493] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:04.909628 31524 raft_consensus.cc:515] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:04.911506 31524 leader_election.cc:290] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:04.912992 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20dfe4990e0a46ef9b0cf1cdf3dfdb09" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:04.913072 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20dfe4990e0a46ef9b0cf1cdf3dfdb09" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:04.914273 31188 leader_election.cc:304] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters: 79b10fa125f242419f66b577440e66d0
W20260203 09:18:04.914877 31191 leader_election.cc:343] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:18:04.915462 31191 leader_election.cc:343] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:04.915571 31524 raft_consensus.cc:2804] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:04.915861 31191 leader_election.cc:304] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:04.916859 31602 raft_consensus.cc:2749] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:04.915977 31524 raft_consensus.cc:493] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:04.917568 31524 raft_consensus.cc:3060] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:04.918633 31496 tablet_bootstrap.cc:654] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:04.922613 31689 raft_consensus.cc:493] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:04.923106 31689 raft_consensus.cc:515] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:04.923631 31504 tablet_bootstrap.cc:492] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:04.924104 31504 ts_tablet_manager.cc:1403] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.151s user 0.009s sys 0.002s
I20260203 09:18:04.925151 31689 leader_election.cc:290] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:04.926630 31504 raft_consensus.cc:359] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:04.926899 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a68c16f0da84e9683a5121f63b3f22c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:04.927296 31504 raft_consensus.cc:385] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:04.927580 31504 raft_consensus.cc:740] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
W20260203 09:18:04.929598 31188 leader_election.cc:343] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:04.930102 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a68c16f0da84e9683a5121f63b3f22c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:04.928174 31504 consensus_queue.cc:260] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
W20260203 09:18:04.945287 31191 leader_election.cc:343] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:04.945840 31191 leader_election.cc:304] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:04.953648 31494 tablet_bootstrap.cc:654] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:04.950848 31602 raft_consensus.cc:2749] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:04.957476 31495 raft_consensus.cc:359] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:04.958307 31495 raft_consensus.cc:385] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:04.958567 31495 raft_consensus.cc:740] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:04.959281 31495 consensus_queue.cc:260] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:04.961405 31495 ts_tablet_manager.cc:1434] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.055s user 0.005s sys 0.002s
I20260203 09:18:04.961632 31119 catalog_manager.cc:5654] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 1 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:04.962543 31495 tablet_bootstrap.cc:492] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:04.961494 31682 consensus_queue.cc:1048] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260203 09:18:04.968899 31495 tablet_bootstrap.cc:654] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:04.981225 31602 consensus_queue.cc:1048] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:04.991055 31504 ts_tablet_manager.cc:1434] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.067s user 0.008s sys 0.000s
I20260203 09:18:05.008512 31504 tablet_bootstrap.cc:492] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:05.021420 31496 tablet_bootstrap.cc:492] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:05.021950 31496 ts_tablet_manager.cc:1403] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.175s user 0.017s sys 0.015s
I20260203 09:18:05.022440 31524 raft_consensus.cc:515] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:05.024067 31524 leader_election.cc:290] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:05.024996 31301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9884e996f0443f2ae2ab5606633ce3c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:05.024366 31496 raft_consensus.cc:359] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:05.026619 31496 raft_consensus.cc:385] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260203 09:18:05.027771 31191 leader_election.cc:343] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:05.026835 31496 raft_consensus.cc:740] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:05.029096 31496 consensus_queue.cc:260] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:05.047636 31495 tablet_bootstrap.cc:492] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:05.048323 31495 ts_tablet_manager.cc:1403] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.086s user 0.021s sys 0.018s
I20260203 09:18:05.050098 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9884e996f0443f2ae2ab5606633ce3c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:05.050760 31374 raft_consensus.cc:3060] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:05.054792 31504 tablet_bootstrap.cc:654] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:05.075744 31496 ts_tablet_manager.cc:1434] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.054s user 0.006s sys 0.000s
I20260203 09:18:05.071502 31374 raft_consensus.cc:2468] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:05.100147 31496 tablet_bootstrap.cc:492] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:05.105072 31494 tablet_bootstrap.cc:492] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:05.105621 31494 ts_tablet_manager.cc:1403] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.198s user 0.011s sys 0.016s
I20260203 09:18:05.109589 31494 raft_consensus.cc:359] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:05.110014 31188 leader_election.cc:304] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters: 79b10fa125f242419f66b577440e66d0
I20260203 09:18:05.110281 31494 raft_consensus.cc:385] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:05.110625 31494 raft_consensus.cc:740] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:05.110782 31805 raft_consensus.cc:2804] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:05.111714 31805 raft_consensus.cc:697] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:05.113489 31495 raft_consensus.cc:359] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:05.114174 31495 raft_consensus.cc:385] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:05.114416 31495 raft_consensus.cc:740] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:05.115017 31495 consensus_queue.cc:260] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:05.118288 31223 raft_consensus.cc:1275] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Refusing update from remote peer 79b10fa125f242419f66b577440e66d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260203 09:18:05.118759 31805 consensus_queue.cc:237] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:05.120028 31504 tablet_bootstrap.cc:492] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:05.120543 31504 ts_tablet_manager.cc:1403] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.114s user 0.013s sys 0.021s
I20260203 09:18:05.120060 31758 consensus_queue.cc:1048] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:05.123172 31504 raft_consensus.cc:359] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:05.123844 31504 raft_consensus.cc:385] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:05.123937 31738 consensus_queue.cc:1048] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:05.126874 31494 consensus_queue.cc:260] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:05.129230 31494 ts_tablet_manager.cc:1434] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.023s user 0.008s sys 0.000s
I20260203 09:18:05.146944 31449 raft_consensus.cc:1275] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Refusing update from remote peer 79b10fa125f242419f66b577440e66d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260203 09:18:05.148387 31500 consensus_queue.cc:1048] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:05.149345 31496 tablet_bootstrap.cc:654] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:05.150151 31495 ts_tablet_manager.cc:1434] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.068s user 0.003s sys 0.000s
I20260203 09:18:05.124151 31504 raft_consensus.cc:740] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:05.151285 31504 consensus_queue.cc:260] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:05.152731 31494 tablet_bootstrap.cc:492] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:05.166095 31504 ts_tablet_manager.cc:1434] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.045s user 0.005s sys 0.001s
I20260203 09:18:05.167819 31588 raft_consensus.cc:493] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:05.168346 31588 raft_consensus.cc:515] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:05.170745 31588 leader_election.cc:290] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:05.171782 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3cb6ffb2d8d4a528e8f6108d59adb09" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
W20260203 09:18:05.176133 31413 leader_election.cc:343] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:05.176240 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3cb6ffb2d8d4a528e8f6108d59adb09" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:05.180001 31495 tablet_bootstrap.cc:492] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:05.177953 31118 catalog_manager.cc:5654] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 0 to 1, leader changed from <none> to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 1 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } }
W20260203 09:18:05.188864 31416 leader_election.cc:343] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:05.191322 31416 leader_election.cc:304] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:05.193054 31798 raft_consensus.cc:2749] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:05.196024 31504 tablet_bootstrap.cc:492] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:05.180934 31524 raft_consensus.cc:493] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:05.197650 31524 raft_consensus.cc:515] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:05.200336 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f617ef4ccf984446b1ab7084a92efe17" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
W20260203 09:18:05.202196 31188 leader_election.cc:343] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:05.202553 31504 tablet_bootstrap.cc:654] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:05.208719 31299 raft_consensus.cc:3060] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:05.217638 31494 tablet_bootstrap.cc:654] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:05.215493 31496 tablet_bootstrap.cc:492] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:05.220534 31496 ts_tablet_manager.cc:1403] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.121s user 0.011s sys 0.005s
I20260203 09:18:05.221740 31495 tablet_bootstrap.cc:654] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:05.231717 31500 raft_consensus.cc:493] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:05.232251 31500 raft_consensus.cc:515] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:05.234026 31500 leader_election.cc:290] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:05.236553 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06460fafee594578bed03068236ad9f2" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:05.238056 31221 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06460fafee594578bed03068236ad9f2" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
W20260203 09:18:05.239691 31267 leader_election.cc:343] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:05.244268 31524 leader_election.cc:290] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:05.246721 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f617ef4ccf984446b1ab7084a92efe17" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
W20260203 09:18:05.248428 31191 leader_election.cc:343] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:05.249964 31191 leader_election.cc:304] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
W20260203 09:18:05.250969 31171 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:18:05.252561 31738 consensus_queue.cc:1048] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:05.255024 31588 raft_consensus.cc:493] T f0a785c5c3bf4846b008f0bc6de21607 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:05.255571 31588 raft_consensus.cc:515] T f0a785c5c3bf4846b008f0bc6de21607 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:05.248412 31496 raft_consensus.cc:359] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:05.257354 31496 raft_consensus.cc:385] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:05.257616 31496 raft_consensus.cc:740] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:05.258203 31496 consensus_queue.cc:260] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:05.262014 31449 raft_consensus.cc:2468] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
I20260203 09:18:05.262771 31496 ts_tablet_manager.cc:1434] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.042s user 0.006s sys 0.000s
I20260203 09:18:05.263149 31588 leader_election.cc:290] T f0a785c5c3bf4846b008f0bc6de21607 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:05.263697 31496 tablet_bootstrap.cc:492] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:05.264596 31267 leader_election.cc:304] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:05.264954 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f0a785c5c3bf4846b008f0bc6de21607" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:05.265574 31500 raft_consensus.cc:2804] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:05.265975 31500 raft_consensus.cc:493] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:05.266299 31500 raft_consensus.cc:3060] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:05.269930 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f0a785c5c3bf4846b008f0bc6de21607" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:05.270757 31373 raft_consensus.cc:2393] T f0a785c5c3bf4846b008f0bc6de21607 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bf9aa3533b14841a52177c8cc3130ec in current term 1: Already voted for candidate 79b10fa125f242419f66b577440e66d0 in this term.
I20260203 09:18:05.272545 31413 leader_election.cc:304] T f0a785c5c3bf4846b008f0bc6de21607 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:05.274067 31500 raft_consensus.cc:515] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:05.275801 31588 raft_consensus.cc:3060] T f0a785c5c3bf4846b008f0bc6de21607 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:05.276255 31500 leader_election.cc:290] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:05.260710 31524 raft_consensus.cc:2749] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:05.281785 31496 tablet_bootstrap.cc:654] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:05.282469 31494 tablet_bootstrap.cc:492] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:05.283090 31494 ts_tablet_manager.cc:1403] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.131s user 0.016s sys 0.004s
I20260203 09:18:05.282088 31221 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06460fafee594578bed03068236ad9f2" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:05.286531 31504 tablet_bootstrap.cc:492] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:05.286916 31504 ts_tablet_manager.cc:1403] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.099s user 0.016s sys 0.009s
W20260203 09:18:05.288246 31267 leader_election.cc:343] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:05.289723 31588 raft_consensus.cc:2749] T f0a785c5c3bf4846b008f0bc6de21607 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:05.289985 31504 raft_consensus.cc:359] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:05.290696 31504 raft_consensus.cc:385] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:05.291013 31504 raft_consensus.cc:740] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:05.292531 31504 consensus_queue.cc:260] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:05.294430 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06460fafee594578bed03068236ad9f2" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:05.295099 31448 raft_consensus.cc:3060] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:05.301165 31504 ts_tablet_manager.cc:1434] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.014s user 0.006s sys 0.001s
I20260203 09:18:05.301509 31495 tablet_bootstrap.cc:492] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:05.302057 31495 ts_tablet_manager.cc:1403] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.137s user 0.015s sys 0.017s
I20260203 09:18:05.301155 31494 raft_consensus.cc:359] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:05.303211 31494 raft_consensus.cc:385] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:05.303494 31494 raft_consensus.cc:740] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:05.302610 31504 tablet_bootstrap.cc:492] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:05.304203 31494 consensus_queue.cc:260] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:05.305181 31495 raft_consensus.cc:359] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:05.307026 31495 raft_consensus.cc:385] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:05.310523 31495 raft_consensus.cc:740] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:05.310951 31495 consensus_queue.cc:260] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:05.319422 31504 tablet_bootstrap.cc:654] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:05.326572 31495 ts_tablet_manager.cc:1434] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.024s user 0.004s sys 0.001s
I20260203 09:18:05.328169 31495 tablet_bootstrap.cc:492] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:05.335367 31588 consensus_queue.cc:1048] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:05.338050 31588 consensus_queue.cc:1048] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:05.348143 31495 tablet_bootstrap.cc:654] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:05.349578 31494 ts_tablet_manager.cc:1434] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.066s user 0.006s sys 0.000s
I20260203 09:18:05.338487 31448 raft_consensus.cc:2468] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:05.355999 31494 tablet_bootstrap.cc:492] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:05.360966 31797 raft_consensus.cc:493] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:05.370100 31797 raft_consensus.cc:515] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:05.372155 31797 leader_election.cc:290] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:05.371951 31500 consensus_queue.cc:1048] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:05.374083 31267 leader_election.cc:304] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:05.374351 31496 tablet_bootstrap.cc:492] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:05.375380 31759 consensus_queue.cc:1048] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:05.375687 31496 ts_tablet_manager.cc:1403] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.112s user 0.023s sys 0.018s
I20260203 09:18:05.376633 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20dfe4990e0a46ef9b0cf1cdf3dfdb09" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:05.378547 31759 raft_consensus.cc:2804] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:05.379406 31759 raft_consensus.cc:697] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:05.379988 31221 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20dfe4990e0a46ef9b0cf1cdf3dfdb09" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:05.380903 31602 raft_consensus.cc:493] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:05.381384 31602 raft_consensus.cc:515] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:05.380285 31759 consensus_queue.cc:237] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:05.382367 31221 raft_consensus.cc:2468] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 0.
I20260203 09:18:05.383298 31602 leader_election.cc:290] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:05.380535 31494 tablet_bootstrap.cc:654] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:05.378445 31496 raft_consensus.cc:359] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:05.385592 31496 raft_consensus.cc:385] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:05.384512 31372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14073202fe424a9b9a72f4c7e6075bdf" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:05.385900 31496 raft_consensus.cc:740] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:05.388033 31496 consensus_queue.cc:260] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:05.390308 31416 leader_election.cc:304] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters:
W20260203 09:18:05.391083 31188 leader_election.cc:343] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:18:05.391968 31416 leader_election.cc:343] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:05.393052 31588 raft_consensus.cc:2804] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:05.393535 31588 raft_consensus.cc:493] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:05.393841 31588 raft_consensus.cc:3060] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:05.394446 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14073202fe424a9b9a72f4c7e6075bdf" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:05.395038 31299 raft_consensus.cc:2468] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 0.
I20260203 09:18:05.396674 31191 leader_election.cc:304] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:05.397771 31524 raft_consensus.cc:2804] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:05.404421 31496 ts_tablet_manager.cc:1434] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.028s user 0.006s sys 0.000s
I20260203 09:18:05.405611 31496 tablet_bootstrap.cc:492] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:05.398144 31524 raft_consensus.cc:493] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:05.409895 31504 tablet_bootstrap.cc:492] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:05.410480 31504 ts_tablet_manager.cc:1403] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.108s user 0.025s sys 0.013s
I20260203 09:18:05.410527 31524 raft_consensus.cc:3060] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:05.427551 31588 raft_consensus.cc:515] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:05.431496 31738 raft_consensus.cc:493] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:05.432293 31588 leader_election.cc:290] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:05.434355 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20dfe4990e0a46ef9b0cf1cdf3dfdb09" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
W20260203 09:18:05.435981 31416 leader_election.cc:343] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:05.432111 31738 raft_consensus.cc:515] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:05.444574 31738 leader_election.cc:290] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:05.451364 31504 raft_consensus.cc:359] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:05.452232 31504 raft_consensus.cc:385] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:05.452524 31504 raft_consensus.cc:740] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:05.453238 31504 consensus_queue.cc:260] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:05.460155 31495 tablet_bootstrap.cc:492] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:05.460717 31495 ts_tablet_manager.cc:1403] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.133s user 0.011s sys 0.017s
I20260203 09:18:05.462939 31496 tablet_bootstrap.cc:654] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:05.448112 31524 raft_consensus.cc:515] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:05.463248 31495 raft_consensus.cc:359] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:05.465768 31495 raft_consensus.cc:385] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:05.465827 31504 ts_tablet_manager.cc:1434] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.055s user 0.006s sys 0.000s
I20260203 09:18:05.466212 31495 raft_consensus.cc:740] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:05.467168 31504 tablet_bootstrap.cc:492] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:05.467067 31495 consensus_queue.cc:260] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:05.469830 31495 ts_tablet_manager.cc:1434] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.009s user 0.005s sys 0.001s
I20260203 09:18:05.471280 31495 tablet_bootstrap.cc:492] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:05.471836 31524 leader_election.cc:290] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:05.478590 31524 raft_consensus.cc:493] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:05.479120 31524 raft_consensus.cc:515] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:05.481599 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87ac8c99d77e47c2b1a373820b27c804" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:05.484344 31524 leader_election.cc:290] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:05.487028 31494 tablet_bootstrap.cc:492] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:05.487651 31494 ts_tablet_manager.cc:1403] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.132s user 0.019s sys 0.014s
I20260203 09:18:05.487572 31504 tablet_bootstrap.cc:654] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:05.489017 31496 tablet_bootstrap.cc:492] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:05.489501 31496 ts_tablet_manager.cc:1403] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.084s user 0.012s sys 0.001s
I20260203 09:18:05.493752 31495 tablet_bootstrap.cc:654] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:05.495767 31496 raft_consensus.cc:359] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:05.496593 31496 raft_consensus.cc:385] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:05.496439 31494 raft_consensus.cc:359] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:05.496996 31496 raft_consensus.cc:740] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:05.497249 31494 raft_consensus.cc:385] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:05.497601 31494 raft_consensus.cc:740] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:05.497740 31496 consensus_queue.cc:260] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:05.498261 31494 consensus_queue.cc:260] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:05.500056 31496 ts_tablet_manager.cc:1434] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260203 09:18:05.500736 31494 ts_tablet_manager.cc:1434] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.013s user 0.007s sys 0.000s
I20260203 09:18:05.501338 31496 tablet_bootstrap.cc:492] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:05.501768 31494 tablet_bootstrap.cc:492] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:05.509089 31495 tablet_bootstrap.cc:492] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:05.509239 31496 tablet_bootstrap.cc:654] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:05.509774 31495 ts_tablet_manager.cc:1403] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.039s user 0.005s sys 0.008s
I20260203 09:18:05.511879 31494 tablet_bootstrap.cc:654] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:05.513123 31221 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20dfe4990e0a46ef9b0cf1cdf3dfdb09" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:05.513000 31495 raft_consensus.cc:359] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:05.513792 31221 raft_consensus.cc:3060] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:05.514020 31495 raft_consensus.cc:385] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:05.509372 31504 tablet_bootstrap.cc:492] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:05.514463 31495 raft_consensus.cc:740] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:05.515066 31504 ts_tablet_manager.cc:1403] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.048s user 0.016s sys 0.009s
I20260203 09:18:05.515590 31495 consensus_queue.cc:260] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:05.518043 31495 ts_tablet_manager.cc:1434] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260203 09:18:05.517729 31504 raft_consensus.cc:359] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:05.518507 31504 raft_consensus.cc:385] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:05.518793 31504 raft_consensus.cc:740] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:05.519306 31495 tablet_bootstrap.cc:492] T c43e17bc65f048a9a9fd229bb9c98bfb P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:05.519431 31504 consensus_queue.cc:260] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:05.521661 31504 ts_tablet_manager.cc:1434] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260203 09:18:05.522538 31496 tablet_bootstrap.cc:492] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:05.523308 31496 ts_tablet_manager.cc:1403] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.022s user 0.013s sys 0.005s
I20260203 09:18:05.522621 31504 tablet_bootstrap.cc:492] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:05.528340 31495 tablet_bootstrap.cc:654] T c43e17bc65f048a9a9fd229bb9c98bfb P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:05.532339 31496 raft_consensus.cc:359] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:05.533352 31496 raft_consensus.cc:385] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:05.533691 31496 raft_consensus.cc:740] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:05.535377 31496 consensus_queue.cc:260] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:05.538034 31496 ts_tablet_manager.cc:1434] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.014s user 0.004s sys 0.002s
I20260203 09:18:05.532591 31504 tablet_bootstrap.cc:654] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:05.539358 31496 tablet_bootstrap.cc:492] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:05.522644 31221 raft_consensus.cc:2468] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 1.
I20260203 09:18:05.819397 31848 raft_consensus.cc:493] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:05.831415 31849 raft_consensus.cc:493] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:05.831719 31848 raft_consensus.cc:515] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:05.832158 31849 raft_consensus.cc:515] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:05.833520 31848 leader_election.cc:290] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:05.834249 31849 leader_election.cc:290] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:05.848380 31221 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87ac8c99d77e47c2b1a373820b27c804" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:05.886034 31297 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06460fafee594578bed03068236ad9f2" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:05.886229 31300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec42a05859cf4d5ebe1e1f268d01b3fc" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
W20260203 09:18:05.891010 31191 leader_election.cc:343] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:05.922645 31495 tablet_bootstrap.cc:492] T c43e17bc65f048a9a9fd229bb9c98bfb P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:05.923148 31495 ts_tablet_manager.cc:1403] T c43e17bc65f048a9a9fd229bb9c98bfb P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.404s user 0.012s sys 0.008s
I20260203 09:18:05.926309 31495 raft_consensus.cc:359] T c43e17bc65f048a9a9fd229bb9c98bfb P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:05.927438 31495 raft_consensus.cc:385] T c43e17bc65f048a9a9fd229bb9c98bfb P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:05.927704 31495 raft_consensus.cc:740] T c43e17bc65f048a9a9fd229bb9c98bfb P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:05.928318 31495 consensus_queue.cc:260] T c43e17bc65f048a9a9fd229bb9c98bfb P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:05.930765 31495 ts_tablet_manager.cc:1434] T c43e17bc65f048a9a9fd229bb9c98bfb P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260203 09:18:05.931561 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14073202fe424a9b9a72f4c7e6075bdf" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:05.934324 31495 tablet_bootstrap.cc:492] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
W20260203 09:18:05.939977 31188 leader_election.cc:343] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:05.943634 31849 consensus_queue.cc:1048] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:05.946256 31495 tablet_bootstrap.cc:654] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:05.956812 31852 raft_consensus.cc:493] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:05.957257 31588 raft_consensus.cc:493] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:05.957412 31852 raft_consensus.cc:515] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:05.957875 31588 raft_consensus.cc:515] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:05.959502 31852 leader_election.cc:290] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:05.962337 31588 leader_election.cc:290] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:05.967986 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9ac7485f9224e0b9a9e95ce8b3c5654" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
W20260203 09:18:05.969920 31191 leader_election.cc:343] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:05.972249 31494 tablet_bootstrap.cc:492] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:05.972901 31494 ts_tablet_manager.cc:1403] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.471s user 0.010s sys 0.020s
I20260203 09:18:05.976051 31494 raft_consensus.cc:359] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:05.976851 31494 raft_consensus.cc:385] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:05.977151 31494 raft_consensus.cc:740] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:05.977847 31494 consensus_queue.cc:260] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:05.978909 31504 tablet_bootstrap.cc:492] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:05.979418 31504 ts_tablet_manager.cc:1403] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.457s user 0.019s sys 0.002s
I20260203 09:18:05.980000 31494 ts_tablet_manager.cc:1434] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260203 09:18:05.981369 31850 raft_consensus.cc:493] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:05.981846 31850 raft_consensus.cc:515] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:05.982431 31494 tablet_bootstrap.cc:492] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:05.983755 31850 leader_election.cc:290] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:05.985898 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9884e996f0443f2ae2ab5606633ce3c" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:05.994688 31504 raft_consensus.cc:359] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:05.995419 31504 raft_consensus.cc:385] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:05.995707 31504 raft_consensus.cc:740] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:05.996369 31504 consensus_queue.cc:260] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:05.997018 31495 tablet_bootstrap.cc:492] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:05.997529 31495 ts_tablet_manager.cc:1403] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.066s user 0.009s sys 0.007s
I20260203 09:18:05.998871 31504 ts_tablet_manager.cc:1434] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20260203 09:18:05.999998 31504 tablet_bootstrap.cc:492] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:06.000067 31495 raft_consensus.cc:359] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:06.001003 31495 raft_consensus.cc:385] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:06.001271 31495 raft_consensus.cc:740] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:06.001997 31495 consensus_queue.cc:260] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:06.004390 31495 ts_tablet_manager.cc:1434] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260203 09:18:06.005566 31495 tablet_bootstrap.cc:492] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:06.011416 31494 tablet_bootstrap.cc:654] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:06.012105 31495 tablet_bootstrap.cc:654] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:06.017010 31504 tablet_bootstrap.cc:654] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:06.028141 31495 tablet_bootstrap.cc:492] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:06.028877 31495 ts_tablet_manager.cc:1403] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.024s user 0.011s sys 0.006s
I20260203 09:18:06.030910 31494 tablet_bootstrap.cc:492] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:06.031426 31494 ts_tablet_manager.cc:1403] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.049s user 0.007s sys 0.009s
I20260203 09:18:06.031664 31495 raft_consensus.cc:359] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:06.032372 31495 raft_consensus.cc:385] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:06.032620 31495 raft_consensus.cc:740] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:06.033489 31495 consensus_queue.cc:260] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:06.034626 31504 tablet_bootstrap.cc:492] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:06.034284 31494 raft_consensus.cc:359] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:06.035017 31494 raft_consensus.cc:385] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:06.035106 31504 ts_tablet_manager.cc:1403] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.035s user 0.009s sys 0.004s
I20260203 09:18:06.035310 31494 raft_consensus.cc:740] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:06.035956 31495 ts_tablet_manager.cc:1434] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.007s user 0.002s sys 0.004s
I20260203 09:18:06.036101 31494 consensus_queue.cc:260] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:06.037004 31495 tablet_bootstrap.cc:492] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:06.038364 31494 ts_tablet_manager.cc:1434] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260203 09:18:06.038106 31504 raft_consensus.cc:359] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:06.039026 31504 raft_consensus.cc:385] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:06.039309 31504 raft_consensus.cc:740] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:06.039939 31504 consensus_queue.cc:260] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:06.040522 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9ac7485f9224e0b9a9e95ce8b3c5654" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
W20260203 09:18:06.041945 31191 leader_election.cc:343] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:06.042097 31504 ts_tablet_manager.cc:1434] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260203 09:18:06.042415 31191 leader_election.cc:304] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:06.043119 31504 tablet_bootstrap.cc:492] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:06.044489 31850 raft_consensus.cc:493] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:06.045011 31850 raft_consensus.cc:515] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:06.046931 31850 leader_election.cc:290] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:06.047766 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b0e416075b74212b54e341eba13fd78" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:06.048414 31495 tablet_bootstrap.cc:654] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:06.048417 31225 raft_consensus.cc:2468] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
I20260203 09:18:06.049983 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14073202fe424a9b9a72f4c7e6075bdf" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:06.050514 31299 raft_consensus.cc:3060] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.051337 31267 leader_election.cc:304] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:06.052196 31850 raft_consensus.cc:2804] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:06.052778 31850 raft_consensus.cc:493] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:06.053135 31850 raft_consensus.cc:3060] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.053906 31851 raft_consensus.cc:493] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:06.054409 31851 raft_consensus.cc:515] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:06.043159 31849 raft_consensus.cc:2749] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:06.056756 31375 raft_consensus.cc:3060] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.058593 31504 tablet_bootstrap.cc:654] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:06.063506 31496 tablet_bootstrap.cc:654] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:06.063982 31851 leader_election.cc:290] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
W20260203 09:18:06.005511 31759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s user 0.013s sys 0.001s
W20260203 09:18:06.077008 31759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s user 0.014s sys 0.001s
I20260203 09:18:06.118988 31849 raft_consensus.cc:493] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:06.119622 31849 raft_consensus.cc:515] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:06.121609 31849 leader_election.cc:290] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:06.122494 31850 raft_consensus.cc:515] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:06.124794 31850 leader_election.cc:290] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:06.126096 31372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "653756c5b80f438b91b3d00ce86f52bb" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:06.129714 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec42a05859cf4d5ebe1e1f268d01b3fc" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:06.131577 31494 tablet_bootstrap.cc:492] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:06.134003 31294 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "653756c5b80f438b91b3d00ce86f52bb" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:06.149124 31446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06460fafee594578bed03068236ad9f2" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:06.150025 31446 raft_consensus.cc:2393] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d44c40c0ed244c4e962a26f9aebea76a in current term 1: Already voted for candidate 79b10fa125f242419f66b577440e66d0 in this term.
W20260203 09:18:06.150336 31188 leader_election.cc:343] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:06.150844 31295 raft_consensus.cc:3060] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.153035 31294 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c43e17bc65f048a9a9fd229bb9c98bfb" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:06.153791 31294 raft_consensus.cc:2468] T c43e17bc65f048a9a9fd229bb9c98bfb P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 0.
I20260203 09:18:06.121517 31750 raft_consensus.cc:493] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:06.155154 31750 raft_consensus.cc:515] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:06.159608 31299 raft_consensus.cc:2468] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
W20260203 09:18:06.160773 31191 leader_election.cc:343] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:06.160540 31219 raft_consensus.cc:3060] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.162444 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b0e416075b74212b54e341eba13fd78" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:06.163048 31225 raft_consensus.cc:3060] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.161024 31682 raft_consensus.cc:493] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:06.164929 31191 leader_election.cc:304] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:06.164889 31682 raft_consensus.cc:515] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:06.165938 31849 raft_consensus.cc:2749] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:06.167114 31682 leader_election.cc:290] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:06.167936 31191 leader_election.cc:304] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
W20260203 09:18:06.169237 31191 leader_election.cc:343] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:06.169436 31849 raft_consensus.cc:2749] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:06.169677 31191 leader_election.cc:304] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:06.171350 31225 raft_consensus.cc:2468] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:06.174029 31849 raft_consensus.cc:2749] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:06.175154 31267 leader_election.cc:304] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:06.178013 31191 leader_election.cc:304] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:06.178848 31849 raft_consensus.cc:2804] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:06.179518 31849 raft_consensus.cc:697] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:06.180377 31849 consensus_queue.cc:237] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:06.182304 31758 raft_consensus.cc:2804] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:06.183408 31758 raft_consensus.cc:697] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:06.184733 31689 raft_consensus.cc:493] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:06.185277 31689 raft_consensus.cc:515] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:06.187252 31689 leader_election.cc:290] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:06.185024 31758 consensus_queue.cc:237] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:06.188443 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d46f012a03d4d73afb2cffe5d847486" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:06.191737 31225 raft_consensus.cc:2468] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 0.
I20260203 09:18:06.189154 31372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d46f012a03d4d73afb2cffe5d847486" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:06.192963 31372 raft_consensus.cc:2468] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 0.
I20260203 09:18:06.190716 31446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d46f012a03d4d73afb2cffe5d847486" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:06.194188 31446 raft_consensus.cc:2468] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 0.
I20260203 09:18:06.195348 31188 leader_election.cc:304] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:06.196614 31689 raft_consensus.cc:2804] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:06.197026 31689 raft_consensus.cc:493] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:06.197397 31689 raft_consensus.cc:3060] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.208482 31494 tablet_bootstrap.cc:654] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:06.217517 31682 raft_consensus.cc:493] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:06.218345 31682 raft_consensus.cc:515] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:06.220237 31682 leader_election.cc:290] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:06.160634 31750 leader_election.cc:290] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:06.222245 31689 raft_consensus.cc:515] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:06.225539 31446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d46f012a03d4d73afb2cffe5d847486" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:06.226151 31446 raft_consensus.cc:3060] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.226641 31118 catalog_manager.cc:5654] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 1 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:06.222476 31416 leader_election.cc:304] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:06.229451 31708 raft_consensus.cc:2804] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:06.229820 31708 raft_consensus.cc:493] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:06.230121 31708 raft_consensus.cc:3060] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.233490 31372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d46f012a03d4d73afb2cffe5d847486" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:06.234118 31372 raft_consensus.cc:3060] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.242969 31372 raft_consensus.cc:2468] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:06.243707 31494 tablet_bootstrap.cc:492] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:06.242583 31708 raft_consensus.cc:515] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:06.244302 31188 leader_election.cc:304] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:06.245126 31494 ts_tablet_manager.cc:1403] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.114s user 0.012s sys 0.001s
I20260203 09:18:06.250555 31849 raft_consensus.cc:2804] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:06.256666 31849 raft_consensus.cc:697] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:06.247885 31689 leader_election.cc:290] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:06.250104 31446 raft_consensus.cc:2468] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:06.257552 31849 consensus_queue.cc:237] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:06.274106 31496 tablet_bootstrap.cc:492] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:06.274575 31496 ts_tablet_manager.cc:1403] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.736s user 0.011s sys 0.013s
I20260203 09:18:06.277164 31366 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c43e17bc65f048a9a9fd229bb9c98bfb" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:06.279672 31708 leader_election.cc:290] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:06.280190 31367 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d46f012a03d4d73afb2cffe5d847486" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:06.325176 31367 raft_consensus.cc:2393] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bf9aa3533b14841a52177c8cc3130ec in current term 1: Already voted for candidate d44c40c0ed244c4e962a26f9aebea76a in this term.
I20260203 09:18:06.325999 31221 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b0e416075b74212b54e341eba13fd78" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:06.326973 31221 raft_consensus.cc:2393] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73bf755165c4487c81c67b5ab44f7104 in current term 1: Already voted for candidate 79b10fa125f242419f66b577440e66d0 in this term.
I20260203 09:18:06.282256 31369 raft_consensus.cc:3060] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.329753 31295 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b0e416075b74212b54e341eba13fd78" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:06.306270 31708 raft_consensus.cc:493] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:06.333308 31708 raft_consensus.cc:515] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:06.307839 31416 leader_election.cc:304] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters: 79b10fa125f242419f66b577440e66d0
I20260203 09:18:06.288168 31602 consensus_queue.cc:1048] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:06.311914 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3cb6ffb2d8d4a528e8f6108d59adb09" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:06.313189 31446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a5ca73a494b4d7389eec90025653337" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:06.314800 31220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a5ca73a494b4d7389eec90025653337" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:06.284018 31496 raft_consensus.cc:359] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:06.337035 31496 raft_consensus.cc:385] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:06.337280 31496 raft_consensus.cc:740] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:06.337843 31496 consensus_queue.cc:260] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:06.315637 31445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3cb6ffb2d8d4a528e8f6108d59adb09" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:06.316427 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3cb6ffb2d8d4a528e8f6108d59adb09" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:06.317962 31685 raft_consensus.cc:493] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:06.305600 31494 raft_consensus.cc:359] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:06.335129 31299 raft_consensus.cc:2468] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 0.
I20260203 09:18:06.339511 31797 raft_consensus.cc:2804] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:06.340312 31494 raft_consensus.cc:385] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:06.341060 31494 raft_consensus.cc:740] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:06.341567 31494 consensus_queue.cc:260] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:06.344166 31366 raft_consensus.cc:2468] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 0.
I20260203 09:18:06.344588 31445 raft_consensus.cc:2468] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
I20260203 09:18:06.344318 31685 raft_consensus.cc:515] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:06.345503 31797 raft_consensus.cc:697] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:06.351699 31797 consensus_queue.cc:237] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:06.352147 31685 leader_election.cc:290] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:06.356424 31416 leader_election.cc:304] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:06.357450 31853 raft_consensus.cc:2764] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260203 09:18:06.361191 31341 leader_election.cc:304] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:06.362080 31496 ts_tablet_manager.cc:1434] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.087s user 0.005s sys 0.002s
I20260203 09:18:06.363857 31495 tablet_bootstrap.cc:492] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:06.364450 31495 ts_tablet_manager.cc:1403] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.328s user 0.017s sys 0.013s
I20260203 09:18:06.367120 31494 ts_tablet_manager.cc:1434] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.119s user 0.005s sys 0.001s
I20260203 09:18:06.368798 31708 leader_election.cc:290] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:06.370025 31496 tablet_bootstrap.cc:492] T a9e063333ea146ed9efb0110b67e9520 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:06.365892 31682 raft_consensus.cc:2804] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:06.379963 31496 tablet_bootstrap.cc:654] T a9e063333ea146ed9efb0110b67e9520 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:06.381059 31494 tablet_bootstrap.cc:492] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:06.381853 31504 tablet_bootstrap.cc:492] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:06.382344 31504 ts_tablet_manager.cc:1403] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.339s user 0.071s sys 0.108s
I20260203 09:18:06.384925 31504 raft_consensus.cc:359] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:06.385586 31504 raft_consensus.cc:385] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:06.385833 31504 raft_consensus.cc:740] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:06.386442 31367 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "563e8640cca54f9cab7822a8136fb583" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:06.386543 31504 consensus_queue.cc:260] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:06.386894 31267 leader_election.cc:304] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:06.388599 31682 raft_consensus.cc:493] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260203 09:18:06.393420 31188 leader_election.cc:343] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:06.397629 31294 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d9139b651d14e5082793499087ed2d4" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:06.403256 31494 tablet_bootstrap.cc:654] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:06.401839 31500 raft_consensus.cc:493] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:06.406219 31500 raft_consensus.cc:515] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:06.408102 31500 leader_election.cc:290] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:06.394953 31682 raft_consensus.cc:3060] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.409153 31220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20dfe4990e0a46ef9b0cf1cdf3dfdb09" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:06.409996 31220 raft_consensus.cc:2393] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79b10fa125f242419f66b577440e66d0 in current term 1: Already voted for candidate 2bf9aa3533b14841a52177c8cc3130ec in this term.
I20260203 09:18:06.395068 31758 raft_consensus.cc:2804] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:06.412916 31758 raft_consensus.cc:493] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:06.413297 31758 raft_consensus.cc:3060] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.401116 31295 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c43e17bc65f048a9a9fd229bb9c98bfb" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:06.418090 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20dfe4990e0a46ef9b0cf1cdf3dfdb09" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:06.418350 31295 raft_consensus.cc:3060] T c43e17bc65f048a9a9fd229bb9c98bfb P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.419621 31267 leader_election.cc:304] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:06.420811 31594 raft_consensus.cc:3060] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.422336 31504 ts_tablet_manager.cc:1434] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.040s user 0.008s sys 0.000s
I20260203 09:18:06.424005 31504 tablet_bootstrap.cc:492] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:06.422228 31500 raft_consensus.cc:493] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:06.425344 31500 raft_consensus.cc:515] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:06.425709 31366 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9884e996f0443f2ae2ab5606633ce3c" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:06.427198 31500 leader_election.cc:290] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:06.427429 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "563e8640cca54f9cab7822a8136fb583" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:06.428100 31448 raft_consensus.cc:2468] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 0.
I20260203 09:18:06.428769 31220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9e063333ea146ed9efb0110b67e9520" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:06.429435 31220 raft_consensus.cc:2468] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
I20260203 09:18:06.429896 31370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3cb6ffb2d8d4a528e8f6108d59adb09" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:06.431262 31267 leader_election.cc:304] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:06.432163 31862 raft_consensus.cc:2804] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:06.432525 31862 raft_consensus.cc:493] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:06.432879 31862 raft_consensus.cc:3060] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.434027 31366 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b0e416075b74212b54e341eba13fd78" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:06.434639 31366 raft_consensus.cc:3060] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.438875 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9e063333ea146ed9efb0110b67e9520" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:06.429068 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b0e416075b74212b54e341eba13fd78" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
W20260203 09:18:06.443774 31267 leader_election.cc:343] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:06.443601 31862 raft_consensus.cc:515] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:06.445591 31862 leader_election.cc:290] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:06.447712 31341 leader_election.cc:304] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:06.448719 31738 raft_consensus.cc:2749] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:06.450263 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9e063333ea146ed9efb0110b67e9520" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:06.450309 31341 leader_election.cc:304] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:06.452785 31220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9e063333ea146ed9efb0110b67e9520" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:06.453472 31220 raft_consensus.cc:3060] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:18:06.454432 31416 leader_election.cc:343] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:06.456312 31495 raft_consensus.cc:359] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:06.457044 31495 raft_consensus.cc:385] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:06.457755 31191 leader_election.cc:304] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:06.457839 31495 raft_consensus.cc:740] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
W20260203 09:18:06.457978 31267 leader_election.cc:343] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:06.458941 31495 consensus_queue.cc:260] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:06.443310 31594 raft_consensus.cc:2749] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:06.464967 31495 ts_tablet_manager.cc:1434] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.100s user 0.007s sys 0.000s
I20260203 09:18:06.466784 31341 leader_election.cc:304] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:06.470080 31495 tablet_bootstrap.cc:492] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:06.446636 31758 raft_consensus.cc:515] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:06.471395 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d9139b651d14e5082793499087ed2d4" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:06.472924 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c43e17bc65f048a9a9fd229bb9c98bfb" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:06.463297 31689 raft_consensus.cc:2804] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:06.479712 31375 raft_consensus.cc:3060] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.488261 31220 raft_consensus.cc:2468] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:06.478878 31689 raft_consensus.cc:493] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:06.481657 31295 raft_consensus.cc:2468] T c43e17bc65f048a9a9fd229bb9c98bfb P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 1.
I20260203 09:18:06.508634 31267 leader_election.cc:304] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:06.499105 31689 raft_consensus.cc:3060] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.508558 31682 raft_consensus.cc:515] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:06.539307 31682 leader_election.cc:290] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:06.533850 31862 raft_consensus.cc:493] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:06.541167 31862 raft_consensus.cc:515] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
W20260203 09:18:06.543087 31874 log.cc:927] Time spent T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec: Append to log took a long time: real 0.061s user 0.000s sys 0.000s
I20260203 09:18:06.543164 31862 leader_election.cc:290] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:06.545109 31495 tablet_bootstrap.cc:654] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:06.532277 31759 raft_consensus.cc:2804] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election won for term 1
W20260203 09:18:06.554740 31171 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:18:06.536216 31366 raft_consensus.cc:2468] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:06.561609 31873 raft_consensus.cc:2749] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:06.562412 31295 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3cb6ffb2d8d4a528e8f6108d59adb09" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:06.563241 31295 raft_consensus.cc:2393] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 73bf755165c4487c81c67b5ab44f7104 in current term 1: Already voted for candidate 79b10fa125f242419f66b577440e66d0 in this term.
W20260203 09:18:06.535629 31413 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:41289, user_credentials={real_user=slave}} blocked reactor thread for 49893.6us
I20260203 09:18:06.565207 31416 leader_election.cc:304] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters:
W20260203 09:18:06.553881 31247 debug-util.cc:398] Leaking SignalData structure 0x7b0800304ee0 after lost signal to thread 27556
I20260203 09:18:06.568856 31758 leader_election.cc:290] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:06.569327 31750 raft_consensus.cc:2749] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:06.567948 31264 leader_election.cc:304] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:06.565861 31370 raft_consensus.cc:2393] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79b10fa125f242419f66b577440e66d0 in current term 1: Already voted for candidate 73bf755165c4487c81c67b5ab44f7104 in this term.
I20260203 09:18:06.570708 31797 raft_consensus.cc:2804] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:06.571352 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d9139b651d14e5082793499087ed2d4" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:06.572003 31448 raft_consensus.cc:2468] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
I20260203 09:18:06.572682 31850 raft_consensus.cc:2749] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:06.559072 31759 raft_consensus.cc:697] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:06.573686 31759 consensus_queue.cc:237] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
W20260203 09:18:06.569582 31247 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5720 after lost signal to thread 31157
I20260203 09:18:06.577199 31369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3cb6ffb2d8d4a528e8f6108d59adb09" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:06.579152 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d9139b651d14e5082793499087ed2d4" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
W20260203 09:18:06.580971 31264 leader_election.cc:343] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:06.582949 31494 tablet_bootstrap.cc:492] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:06.583688 31797 raft_consensus.cc:697] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:06.584630 31797 consensus_queue.cc:237] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:06.590593 31504 tablet_bootstrap.cc:654] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:06.594026 31375 raft_consensus.cc:2468] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 1.
I20260203 09:18:06.594355 31494 ts_tablet_manager.cc:1403] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.213s user 0.013s sys 0.010s
W20260203 09:18:06.600601 31875 log.cc:927] Time spent T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723: Append to log took a long time: real 0.117s user 0.002s sys 0.000s
I20260203 09:18:06.601238 31689 raft_consensus.cc:515] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
W20260203 09:18:06.576795 31247 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0140 after lost signal to thread 31250
I20260203 09:18:06.603404 31500 consensus_queue.cc:1048] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260203 09:18:06.604137 31413 leader_election.cc:343] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:18:06.604190 31247 debug-util.cc:398] Leaking SignalData structure 0x7b0800381ec0 after lost signal to thread 31325
I20260203 09:18:06.607788 31689 leader_election.cc:290] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:06.610215 31443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "563e8640cca54f9cab7822a8136fb583" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:06.611326 31267 leader_election.cc:304] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:06.600255 31494 raft_consensus.cc:359] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:06.617954 31494 raft_consensus.cc:385] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:06.618309 31494 raft_consensus.cc:740] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:06.626837 31494 consensus_queue.cc:260] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:06.630980 31496 tablet_bootstrap.cc:492] T a9e063333ea146ed9efb0110b67e9520 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:06.631633 31496 ts_tablet_manager.cc:1403] T a9e063333ea146ed9efb0110b67e9520 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.262s user 0.015s sys 0.005s
I20260203 09:18:06.634516 31496 raft_consensus.cc:359] T a9e063333ea146ed9efb0110b67e9520 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:06.635272 31496 raft_consensus.cc:385] T a9e063333ea146ed9efb0110b67e9520 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:06.635578 31496 raft_consensus.cc:740] T a9e063333ea146ed9efb0110b67e9520 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:06.642724 31494 ts_tablet_manager.cc:1434] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.048s user 0.005s sys 0.001s
I20260203 09:18:06.644093 31494 tablet_bootstrap.cc:492] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:06.621361 31850 raft_consensus.cc:2804] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:06.653920 31495 tablet_bootstrap.cc:492] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:06.654376 31495 ts_tablet_manager.cc:1403] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.184s user 0.022s sys 0.021s
I20260203 09:18:06.656417 31495 raft_consensus.cc:359] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:06.656965 31495 raft_consensus.cc:385] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:06.657171 31495 raft_consensus.cc:740] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:06.657714 31495 consensus_queue.cc:260] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:06.636359 31496 consensus_queue.cc:260] T a9e063333ea146ed9efb0110b67e9520 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:06.659349 31495 ts_tablet_manager.cc:1434] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260203 09:18:06.660247 31495 tablet_bootstrap.cc:492] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:06.661674 31494 tablet_bootstrap.cc:654] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:06.664667 31495 tablet_bootstrap.cc:654] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:06.626550 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "563e8640cca54f9cab7822a8136fb583" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:06.640169 31443 raft_consensus.cc:3060] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.616021 31413 leader_election.cc:304] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:06.647176 31445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3cb6ffb2d8d4a528e8f6108d59adb09" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:06.665581 31850 raft_consensus.cc:493] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260203 09:18:06.666431 31247 debug-util.cc:398] Leaking SignalData structure 0x7b0800145f20 after lost signal to thread 31400
W20260203 09:18:06.675294 31188 leader_election.cc:343] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:06.671823 31445 raft_consensus.cc:3060] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.668237 31602 raft_consensus.cc:493] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:06.678404 31602 raft_consensus.cc:515] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:06.680351 31602 leader_election.cc:290] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:06.677701 31797 raft_consensus.cc:2749] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260203 09:18:06.683496 31247 debug-util.cc:398] Leaking SignalData structure 0x7b0800219840 after lost signal to thread 31474
I20260203 09:18:06.683710 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9adae0a7f8a243ad9a35cb7a2047f472" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
W20260203 09:18:06.685324 31191 leader_election.cc:343] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:18:06.685586 31413 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:41289, user_credentials={real_user=slave}} blocked reactor thread for 83730.1us
I20260203 09:18:06.689478 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3cb6ffb2d8d4a528e8f6108d59adb09" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:06.690042 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9adae0a7f8a243ad9a35cb7a2047f472" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
W20260203 09:18:06.691833 31191 leader_election.cc:343] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:06.692245 31191 leader_election.cc:304] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:06.693253 31689 raft_consensus.cc:2749] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:06.696046 31443 raft_consensus.cc:2468] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:06.675890 31850 raft_consensus.cc:3060] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:18:06.693156 31188 consensus_peers.cc:597] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a -> Peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Couldn't send request to peer 73bf755165c4487c81c67b5ab44f7104. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:06.674446 31496 ts_tablet_manager.cc:1434] T a9e063333ea146ed9efb0110b67e9520 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.043s user 0.009s sys 0.001s
W20260203 09:18:06.675068 31416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:45019, user_credentials={real_user=slave}} blocked reactor thread for 56147.9us
I20260203 09:18:06.711998 31191 leader_election.cc:304] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:06.713820 31496 tablet_bootstrap.cc:492] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:06.716229 31602 raft_consensus.cc:2804] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:06.716845 31602 raft_consensus.cc:697] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:06.717680 31602 consensus_queue.cc:237] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:06.720152 31496 tablet_bootstrap.cc:654] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:06.705499 31689 raft_consensus.cc:493] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:06.726264 31689 raft_consensus.cc:515] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:06.728231 31689 leader_election.cc:290] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:06.711985 31848 consensus_queue.cc:1048] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260203 09:18:06.729292 31370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f94dad823fea42d2976b19da7bc7b258" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:06.729465 31445 raft_consensus.cc:2468] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:06.730197 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f94dad823fea42d2976b19da7bc7b258" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
W20260203 09:18:06.731302 31188 leader_election.cc:343] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:18:06.732339 31191 leader_election.cc:343] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:06.732756 31191 leader_election.cc:304] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:06.735589 31267 leader_election.cc:304] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:06.737079 31341 leader_election.cc:304] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:06.735144 31848 raft_consensus.cc:2749] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:06.740991 31863 raft_consensus.cc:2749] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260203 09:18:06.739028 31500 raft_consensus.cc:2804] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:06.742324 31500 raft_consensus.cc:697] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:06.743247 31500 consensus_queue.cc:237] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:06.743973 31504 tablet_bootstrap.cc:492] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a: No bootstrap required, opened a new log
I20260203 09:18:06.744464 31504 ts_tablet_manager.cc:1403] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.321s user 0.016s sys 0.003s
I20260203 09:18:06.747160 31504 raft_consensus.cc:359] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:06.747784 31504 raft_consensus.cc:385] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:06.748045 31504 raft_consensus.cc:740] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:06.750506 31504 consensus_queue.cc:260] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:06.755519 31504 ts_tablet_manager.cc:1434] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.011s user 0.004s sys 0.001s
I20260203 09:18:06.756789 31850 raft_consensus.cc:515] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:06.758903 31850 leader_election.cc:290] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:06.760563 31850 raft_consensus.cc:493] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:06.761068 31850 raft_consensus.cc:515] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:06.761793 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d9139b651d14e5082793499087ed2d4" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
W20260203 09:18:06.763049 31264 leader_election.cc:343] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:06.763028 31850 leader_election.cc:290] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:06.766206 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec42a05859cf4d5ebe1e1f268d01b3fc" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:06.767026 31225 raft_consensus.cc:2468] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
I20260203 09:18:06.770581 31267 leader_election.cc:304] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:06.771420 31850 raft_consensus.cc:2804] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:06.771850 31850 raft_consensus.cc:493] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:06.772212 31850 raft_consensus.cc:3060] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.774237 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d9139b651d14e5082793499087ed2d4" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:06.774909 31450 raft_consensus.cc:3060] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.777134 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec42a05859cf4d5ebe1e1f268d01b3fc" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:06.783943 31450 raft_consensus.cc:2468] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
W20260203 09:18:06.785050 31267 leader_election.cc:343] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:06.790637 31267 leader_election.cc:304] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:06.805078 31119 catalog_manager.cc:5654] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 0 to 1, leader changed from <none> to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 1 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:06.800803 31758 raft_consensus.cc:2804] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:06.807811 31758 raft_consensus.cc:697] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:06.808631 31758 consensus_queue.cc:237] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:06.812727 31494 tablet_bootstrap.cc:492] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:06.813252 31494 ts_tablet_manager.cc:1403] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.169s user 0.017s sys 0.011s
I20260203 09:18:06.815811 31495 tablet_bootstrap.cc:492] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:06.815696 31494 raft_consensus.cc:359] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:06.816360 31494 raft_consensus.cc:385] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:06.816453 31495 ts_tablet_manager.cc:1403] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.156s user 0.007s sys 0.017s
I20260203 09:18:06.819398 31494 raft_consensus.cc:740] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:06.819171 31495 raft_consensus.cc:359] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:06.819993 31495 raft_consensus.cc:385] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:06.820152 31494 consensus_queue.cc:260] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:06.823655 31494 ts_tablet_manager.cc:1434] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260203 09:18:06.824011 31890 consensus_queue.cc:1048] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260203 09:18:06.828253 31689 consensus_queue.cc:1048] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:06.829411 31494 tablet_bootstrap.cc:492] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:06.820331 31495 raft_consensus.cc:740] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:06.833200 31495 consensus_queue.cc:260] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:06.862479 31890 consensus_queue.cc:1048] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:06.874843 31495 ts_tablet_manager.cc:1434] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.058s user 0.005s sys 0.001s
I20260203 09:18:06.875983 31495 tablet_bootstrap.cc:492] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:06.878520 31884 consensus_queue.cc:1048] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:06.879268 31880 raft_consensus.cc:493] T a9e063333ea146ed9efb0110b67e9520 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:06.872087 31119 catalog_manager.cc:5654] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 1 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:06.888427 31119 catalog_manager.cc:5654] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 1 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:06.820289 31850 raft_consensus.cc:515] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:06.892549 31880 raft_consensus.cc:515] T a9e063333ea146ed9efb0110b67e9520 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:06.906368 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9e063333ea146ed9efb0110b67e9520" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:06.907188 31225 raft_consensus.cc:2393] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bf9aa3533b14841a52177c8cc3130ec in current term 1: Already voted for candidate 79b10fa125f242419f66b577440e66d0 in this term.
I20260203 09:18:06.917796 31880 leader_election.cc:290] T a9e063333ea146ed9efb0110b67e9520 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:06.927579 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9e063333ea146ed9efb0110b67e9520" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:06.931221 31416 leader_election.cc:304] T a9e063333ea146ed9efb0110b67e9520 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:06.932627 31880 raft_consensus.cc:3060] T a9e063333ea146ed9efb0110b67e9520 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.946521 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec42a05859cf4d5ebe1e1f268d01b3fc" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:06.949993 31221 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec42a05859cf4d5ebe1e1f268d01b3fc" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:06.950805 31850 leader_election.cc:290] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:06.950654 31221 raft_consensus.cc:3060] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:06.956282 31496 tablet_bootstrap.cc:492] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:06.960927 31495 tablet_bootstrap.cc:654] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:06.961513 31221 raft_consensus.cc:2468] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:06.966099 31496 ts_tablet_manager.cc:1403] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.253s user 0.036s sys 0.007s
W20260203 09:18:06.962064 31894 log.cc:927] Time spent T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a: Append to log took a long time: real 0.060s user 0.000s sys 0.000s
W20260203 09:18:06.966935 31267 leader_election.cc:343] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:06.968540 31863 raft_consensus.cc:493] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:06.974712 31880 raft_consensus.cc:2749] T a9e063333ea146ed9efb0110b67e9520 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:06.974743 31267 leader_election.cc:304] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:06.969630 31863 raft_consensus.cc:515] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:06.978237 31494 tablet_bootstrap.cc:654] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
W20260203 09:18:06.975450 31191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.68:42099, user_credentials={real_user=slave}} blocked reactor thread for 84977.7us
I20260203 09:18:06.980103 31863 leader_election.cc:290] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:06.978518 31118 catalog_manager.cc:5654] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 0 to 1, leader changed from <none> to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 1 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } }
I20260203 09:18:06.977945 31850 raft_consensus.cc:2804] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:06.991324 31689 raft_consensus.cc:493] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:06.999131 31848 raft_consensus.cc:493] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:06.999651 31848 raft_consensus.cc:515] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:07.001559 31848 leader_election.cc:290] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:07.003286 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f617ef4ccf984446b1ab7084a92efe17" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
W20260203 09:18:07.005525 31341 leader_election.cc:343] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:07.007040 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a68c16f0da84e9683a5121f63b3f22c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
W20260203 09:18:07.011080 31188 leader_election.cc:343] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:06.991859 31689 raft_consensus.cc:515] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:06.997596 31850 raft_consensus.cc:697] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:07.014118 31689 leader_election.cc:290] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:07.014732 31850 consensus_queue.cc:237] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:07.029106 31120 catalog_manager.cc:5654] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 1 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } }
I20260203 09:18:07.039618 31370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee25c6a8d94e49a2a9a5646d493c1bde" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
W20260203 09:18:07.042902 31188 leader_election.cc:343] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:07.049916 31220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f617ef4ccf984446b1ab7084a92efe17" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:07.046820 31120 catalog_manager.cc:5654] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 0 to 1, leader changed from <none> to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 1 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:07.076999 31220 raft_consensus.cc:2468] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 0.
I20260203 09:18:07.077807 31494 tablet_bootstrap.cc:492] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:07.079599 31494 ts_tablet_manager.cc:1403] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.255s user 0.017s sys 0.002s
I20260203 09:18:07.111371 31496 raft_consensus.cc:359] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:07.112538 31496 raft_consensus.cc:385] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:07.112903 31496 raft_consensus.cc:740] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:07.113579 31496 consensus_queue.cc:260] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:07.116245 31496 ts_tablet_manager.cc:1434] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.150s user 0.010s sys 0.000s
I20260203 09:18:07.118590 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a68c16f0da84e9683a5121f63b3f22c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:07.138247 31450 raft_consensus.cc:2468] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 0.
I20260203 09:18:07.123517 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee25c6a8d94e49a2a9a5646d493c1bde" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:07.136125 31890 consensus_queue.cc:1048] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:07.145296 31123 catalog_manager.cc:5654] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 1 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:07.147392 31123 catalog_manager.cc:5654] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 1 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:07.149127 31341 leader_election.cc:304] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:07.153515 31912 consensus_queue.cc:1048] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:07.154963 31191 leader_election.cc:304] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:07.155905 31911 raft_consensus.cc:2804] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260203 09:18:07.156109 31191 leader_election.cc:343] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:07.149156 31123 catalog_manager.cc:5654] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 1 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:07.156378 31911 raft_consensus.cc:493] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:07.157132 31911 raft_consensus.cc:3060] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:07.156576 31191 leader_election.cc:304] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:07.158727 31908 raft_consensus.cc:2749] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:07.162055 31873 raft_consensus.cc:2804] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:07.162817 31873 raft_consensus.cc:493] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:07.166554 31369 raft_consensus.cc:3060] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:18:07.167842 31188 consensus_peers.cc:597] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a -> Peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Couldn't send request to peer 73bf755165c4487c81c67b5ab44f7104. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:07.163064 31496 tablet_bootstrap.cc:492] T 9adae0a7f8a243ad9a35cb7a2047f472 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:07.163458 31882 consensus_queue.cc:1048] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:07.147264 31758 consensus_queue.cc:1048] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260203 09:18:07.165308 31873 raft_consensus.cc:3060] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:07.182322 31500 consensus_queue.cc:1048] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:07.191154 31494 raft_consensus.cc:359] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:07.191911 31494 raft_consensus.cc:385] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:07.192173 31494 raft_consensus.cc:740] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:07.192782 31494 consensus_queue.cc:260] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:07.204239 31495 tablet_bootstrap.cc:492] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:07.206212 31495 ts_tablet_manager.cc:1403] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.330s user 0.012s sys 0.008s
I20260203 09:18:07.224808 31495 raft_consensus.cc:359] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:07.225739 31495 raft_consensus.cc:385] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:07.226063 31495 raft_consensus.cc:740] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:07.226946 31495 consensus_queue.cc:260] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:07.234935 31496 tablet_bootstrap.cc:654] T 9adae0a7f8a243ad9a35cb7a2047f472 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:07.244789 31494 ts_tablet_manager.cc:1434] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.165s user 0.007s sys 0.000s
W20260203 09:18:07.255626 31914 log.cc:927] Time spent T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0: Append to log took a long time: real 0.069s user 0.001s sys 0.000s
I20260203 09:18:07.269745 31500 consensus_queue.cc:1048] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:07.283191 31494 tablet_bootstrap.cc:492] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:07.285513 31500 raft_consensus.cc:493] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:07.286028 31500 raft_consensus.cc:515] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:07.288008 31495 ts_tablet_manager.cc:1434] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.081s user 0.007s sys 0.000s
I20260203 09:18:07.291726 31500 leader_election.cc:290] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:07.301891 31221 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9adae0a7f8a243ad9a35cb7a2047f472" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:07.302667 31221 raft_consensus.cc:2468] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
I20260203 09:18:07.304020 31495 tablet_bootstrap.cc:492] T bd838f6bdcba4d728e975023e89894a5 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:07.304275 31267 leader_election.cc:304] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:07.310734 31759 raft_consensus.cc:2804] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:07.317284 31446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9adae0a7f8a243ad9a35cb7a2047f472" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
W20260203 09:18:07.323444 31264 consensus_peers.cc:597] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 -> Peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Couldn't send request to peer 73bf755165c4487c81c67b5ab44f7104. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:07.324848 31267 leader_election.cc:343] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:07.326370 31863 raft_consensus.cc:493] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:07.326867 31863 raft_consensus.cc:515] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:07.328029 31496 tablet_bootstrap.cc:492] T 9adae0a7f8a243ad9a35cb7a2047f472 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:07.328516 31496 ts_tablet_manager.cc:1403] T 9adae0a7f8a243ad9a35cb7a2047f472 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.166s user 0.008s sys 0.005s
I20260203 09:18:07.328747 31863 leader_election.cc:290] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:07.330991 31496 raft_consensus.cc:359] T 9adae0a7f8a243ad9a35cb7a2047f472 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:07.331640 31496 raft_consensus.cc:385] T 9adae0a7f8a243ad9a35cb7a2047f472 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:07.331905 31496 raft_consensus.cc:740] T 9adae0a7f8a243ad9a35cb7a2047f472 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:07.336382 31873 raft_consensus.cc:515] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:07.342032 31805 consensus_queue.cc:1048] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:07.342329 31219 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f617ef4ccf984446b1ab7084a92efe17" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:07.342921 31219 raft_consensus.cc:3060] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:07.320349 31759 raft_consensus.cc:493] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:07.344532 31496 consensus_queue.cc:260] T 9adae0a7f8a243ad9a35cb7a2047f472 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:07.338419 31873 leader_election.cc:290] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:07.358146 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a68c16f0da84e9683a5121f63b3f22c" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:07.358855 31444 raft_consensus.cc:2468] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 0.
I20260203 09:18:07.360514 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f617ef4ccf984446b1ab7084a92efe17" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:07.350291 31759 raft_consensus.cc:3060] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:07.365902 31120 catalog_manager.cc:5654] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 1 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:07.373535 31221 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a68c16f0da84e9683a5121f63b3f22c" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:07.377270 31911 raft_consensus.cc:515] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:07.379418 31911 leader_election.cc:290] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:07.380000 31494 tablet_bootstrap.cc:654] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:07.382473 31369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a68c16f0da84e9683a5121f63b3f22c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:07.383322 31369 raft_consensus.cc:3060] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:07.384451 31221 raft_consensus.cc:2393] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73bf755165c4487c81c67b5ab44f7104 in current term 1: Already voted for candidate d44c40c0ed244c4e962a26f9aebea76a in this term.
I20260203 09:18:07.385438 31495 tablet_bootstrap.cc:654] T bd838f6bdcba4d728e975023e89894a5 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:07.391485 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a68c16f0da84e9683a5121f63b3f22c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:07.392144 31444 raft_consensus.cc:3060] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:07.411335 31496 ts_tablet_manager.cc:1434] T 9adae0a7f8a243ad9a35cb7a2047f472 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.082s user 0.005s sys 0.000s
I20260203 09:18:07.415755 31341 leader_election.cc:304] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters: d44c40c0ed244c4e962a26f9aebea76a
W20260203 09:18:07.416877 31341 leader_election.cc:343] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:07.425885 31219 raft_consensus.cc:2468] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 1.
I20260203 09:18:07.431735 31341 leader_election.cc:304] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:07.432786 31750 raft_consensus.cc:2804] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:07.433264 31750 raft_consensus.cc:697] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Becoming Leader. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:07.434077 31750 consensus_queue.cc:237] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:07.402158 31884 consensus_queue.cc:1048] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260203 09:18:07.440560 31444 raft_consensus.cc:2468] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:07.445861 31758 consensus_queue.cc:1048] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260203 09:18:07.446255 31496 tablet_bootstrap.cc:492] T 15d598c8a8514ff5af7a0e48897dffa7 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:07.459085 31191 leader_election.cc:304] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:07.400410 31759 raft_consensus.cc:515] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:07.469796 31911 raft_consensus.cc:2804] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election won for term 1
W20260203 09:18:07.475442 31267 consensus_peers.cc:597] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 -> Peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Couldn't send request to peer 2bf9aa3533b14841a52177c8cc3130ec. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:07.482546 31911 raft_consensus.cc:697] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:07.483505 31911 consensus_queue.cc:237] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:07.488566 31494 tablet_bootstrap.cc:492] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:07.489063 31494 ts_tablet_manager.cc:1403] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.238s user 0.013s sys 0.008s
I20260203 09:18:07.517465 31759 leader_election.cc:290] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:07.519411 31369 raft_consensus.cc:2468] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:07.520200 31221 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9adae0a7f8a243ad9a35cb7a2047f472" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:07.520951 31221 raft_consensus.cc:3060] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:07.524840 31442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9adae0a7f8a243ad9a35cb7a2047f472" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:07.525503 31442 raft_consensus.cc:3060] T 9adae0a7f8a243ad9a35cb7a2047f472 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:07.520071 31873 raft_consensus.cc:2764] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260203 09:18:07.541272 31221 raft_consensus.cc:2468] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:07.545496 31442 raft_consensus.cc:2468] T 9adae0a7f8a243ad9a35cb7a2047f472 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:07.547469 31496 tablet_bootstrap.cc:654] T 15d598c8a8514ff5af7a0e48897dffa7 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:07.547946 31495 tablet_bootstrap.cc:492] T bd838f6bdcba4d728e975023e89894a5 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:07.548342 31495 ts_tablet_manager.cc:1403] T bd838f6bdcba4d728e975023e89894a5 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.251s user 0.021s sys 0.002s
I20260203 09:18:07.550057 31267 leader_election.cc:304] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:07.550956 31495 raft_consensus.cc:359] T bd838f6bdcba4d728e975023e89894a5 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:07.551827 31495 raft_consensus.cc:385] T bd838f6bdcba4d728e975023e89894a5 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:07.552201 31495 raft_consensus.cc:740] T bd838f6bdcba4d728e975023e89894a5 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:07.553028 31495 consensus_queue.cc:260] T bd838f6bdcba4d728e975023e89894a5 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:07.555335 31494 raft_consensus.cc:359] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:07.556468 31494 raft_consensus.cc:385] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:07.556804 31494 raft_consensus.cc:740] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:07.552690 31759 raft_consensus.cc:2804] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:07.563512 31759 raft_consensus.cc:697] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:07.564558 31494 consensus_queue.cc:260] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:07.574728 31495 ts_tablet_manager.cc:1434] T bd838f6bdcba4d728e975023e89894a5 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.026s user 0.004s sys 0.004s
I20260203 09:18:07.581089 31495 tablet_bootstrap.cc:492] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:07.585260 31759 consensus_queue.cc:237] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:07.600299 31494 ts_tablet_manager.cc:1434] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.111s user 0.002s sys 0.005s
I20260203 09:18:07.600410 31495 tablet_bootstrap.cc:654] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:07.614353 31758 consensus_queue.cc:1048] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:07.613682 31494 tablet_bootstrap.cc:492] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:07.621870 31123 catalog_manager.cc:5654] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 0 to 1, leader changed from <none> to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 1 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:07.643692 31496 tablet_bootstrap.cc:492] T 15d598c8a8514ff5af7a0e48897dffa7 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:07.644274 31496 ts_tablet_manager.cc:1403] T 15d598c8a8514ff5af7a0e48897dffa7 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.219s user 0.030s sys 0.031s
I20260203 09:18:07.638772 31120 catalog_manager.cc:5654] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 1 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:07.669684 31496 raft_consensus.cc:359] T 15d598c8a8514ff5af7a0e48897dffa7 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:07.670392 31496 raft_consensus.cc:385] T 15d598c8a8514ff5af7a0e48897dffa7 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:07.670640 31496 raft_consensus.cc:740] T 15d598c8a8514ff5af7a0e48897dffa7 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:07.671244 31496 consensus_queue.cc:260] T 15d598c8a8514ff5af7a0e48897dffa7 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:07.672787 31494 tablet_bootstrap.cc:654] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:07.673424 31496 ts_tablet_manager.cc:1434] T 15d598c8a8514ff5af7a0e48897dffa7 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.029s user 0.006s sys 0.000s
I20260203 09:18:07.674434 31496 tablet_bootstrap.cc:492] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:07.681902 31118 catalog_manager.cc:5654] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67). New cstate: current_term: 1 leader_uuid: "73bf755165c4487c81c67b5ab44f7104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:07.716148 31884 raft_consensus.cc:493] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:07.716970 31496 tablet_bootstrap.cc:654] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:07.716805 31884 raft_consensus.cc:515] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:07.721472 31884 leader_election.cc:290] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:07.723887 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15d598c8a8514ff5af7a0e48897dffa7" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:07.724598 31444 raft_consensus.cc:2468] T 15d598c8a8514ff5af7a0e48897dffa7 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
I20260203 09:18:07.725785 31267 leader_election.cc:304] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:07.726539 31884 raft_consensus.cc:2804] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:07.726895 31884 raft_consensus.cc:493] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:07.727222 31884 raft_consensus.cc:3060] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:18:07.727691 31171 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:18:07.728264 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15d598c8a8514ff5af7a0e48897dffa7" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
W20260203 09:18:07.730158 31264 leader_election.cc:343] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:07.719713 31495 tablet_bootstrap.cc:492] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:07.734880 31495 ts_tablet_manager.cc:1403] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.154s user 0.023s sys 0.030s
I20260203 09:18:07.735841 31494 tablet_bootstrap.cc:492] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:07.736315 31494 ts_tablet_manager.cc:1403] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.123s user 0.018s sys 0.004s
I20260203 09:18:07.737710 31495 raft_consensus.cc:359] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:07.738399 31495 raft_consensus.cc:385] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:07.738641 31495 raft_consensus.cc:740] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:07.739869 31494 raft_consensus.cc:359] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:07.740594 31494 raft_consensus.cc:385] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:07.740935 31494 raft_consensus.cc:740] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:07.741775 31494 consensus_queue.cc:260] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:07.739261 31495 consensus_queue.cc:260] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:07.744827 31494 ts_tablet_manager.cc:1434] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.008s user 0.003s sys 0.003s
I20260203 09:18:07.746546 31494 tablet_bootstrap.cc:492] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:07.748314 31495 ts_tablet_manager.cc:1434] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.013s user 0.005s sys 0.001s
I20260203 09:18:07.759716 31495 tablet_bootstrap.cc:492] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:07.761085 31759 raft_consensus.cc:493] T bd838f6bdcba4d728e975023e89894a5 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:07.761634 31759 raft_consensus.cc:515] T bd838f6bdcba4d728e975023e89894a5 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:07.764376 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd838f6bdcba4d728e975023e89894a5" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:07.765403 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd838f6bdcba4d728e975023e89894a5" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
W20260203 09:18:07.765527 31264 leader_election.cc:343] T bd838f6bdcba4d728e975023e89894a5 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:18:07.766924 31267 leader_election.cc:343] T bd838f6bdcba4d728e975023e89894a5 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:07.767338 31267 leader_election.cc:304] T bd838f6bdcba4d728e975023e89894a5 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:07.768090 31758 raft_consensus.cc:2749] T bd838f6bdcba4d728e975023e89894a5 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:07.769937 31495 tablet_bootstrap.cc:654] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:07.775147 31494 tablet_bootstrap.cc:654] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:07.765189 31759 leader_election.cc:290] T bd838f6bdcba4d728e975023e89894a5 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:07.783686 31884 raft_consensus.cc:515] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:07.800925 31495 tablet_bootstrap.cc:492] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:07.865358 31495 ts_tablet_manager.cc:1403] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.106s user 0.013s sys 0.005s
I20260203 09:18:07.807612 31375 raft_consensus.cc:3060] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:07.818890 31494 tablet_bootstrap.cc:492] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:07.867033 31494 ts_tablet_manager.cc:1403] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.121s user 0.011s sys 0.005s
I20260203 09:18:07.869777 31494 raft_consensus.cc:359] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:07.870486 31494 raft_consensus.cc:385] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:07.870777 31494 raft_consensus.cc:740] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:07.871758 31370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15d598c8a8514ff5af7a0e48897dffa7" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:07.871671 31494 consensus_queue.cc:260] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:07.873358 31494 ts_tablet_manager.cc:1434] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260203 09:18:07.874050 31264 leader_election.cc:343] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:07.874990 31495 raft_consensus.cc:359] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:07.876843 31495 raft_consensus.cc:385] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:07.877175 31495 raft_consensus.cc:740] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
I20260203 09:18:07.877964 31495 consensus_queue.cc:260] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:07.880493 31495 ts_tablet_manager.cc:1434] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.015s user 0.004s sys 0.001s
I20260203 09:18:07.881562 31495 tablet_bootstrap.cc:492] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0: Bootstrap starting.
I20260203 09:18:07.881448 31494 tablet_bootstrap.cc:492] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:07.887218 31496 tablet_bootstrap.cc:492] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:07.887809 31496 ts_tablet_manager.cc:1403] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.214s user 0.031s sys 0.042s
I20260203 09:18:07.884598 31873 raft_consensus.cc:493] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:07.892079 31884 leader_election.cc:290] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:07.891983 31496 raft_consensus.cc:359] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:07.892288 31873 raft_consensus.cc:515] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:07.892735 31496 raft_consensus.cc:385] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:07.893088 31496 raft_consensus.cc:740] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:07.893181 31442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15d598c8a8514ff5af7a0e48897dffa7" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:07.869832 31911 consensus_queue.cc:1048] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:07.893816 31442 raft_consensus.cc:3060] T 15d598c8a8514ff5af7a0e48897dffa7 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:07.893857 31496 consensus_queue.cc:260] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:07.895004 31221 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "653756c5b80f438b91b3d00ce86f52bb" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:07.937305 31221 raft_consensus.cc:2468] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 0.
I20260203 09:18:07.986374 31341 leader_election.cc:304] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:07.987670 31885 raft_consensus.cc:2804] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:07.988425 31885 raft_consensus.cc:493] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:07.988898 31885 raft_consensus.cc:3060] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:07.896327 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "653756c5b80f438b91b3d00ce86f52bb" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:07.993746 31296 raft_consensus.cc:2468] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 0.
I20260203 09:18:07.922062 31750 consensus_queue.cc:1048] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260203 09:18:07.940229 31495 tablet_bootstrap.cc:654] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:07.898831 31494 tablet_bootstrap.cc:654] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:07.894369 31873 leader_election.cc:290] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:07.949707 31911 consensus_queue.cc:1048] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:07.957911 31442 raft_consensus.cc:2468] T 15d598c8a8514ff5af7a0e48897dffa7 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:08.003513 31267 leader_election.cc:304] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:08.004947 31758 raft_consensus.cc:2804] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:08.005851 31758 raft_consensus.cc:697] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:08.009630 31758 consensus_queue.cc:237] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:08.015051 31496 ts_tablet_manager.cc:1434] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.127s user 0.008s sys 0.000s
I20260203 09:18:08.009541 31450 raft_consensus.cc:3060] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:08.031020 31496 tablet_bootstrap.cc:492] T bd838f6bdcba4d728e975023e89894a5 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:08.061703 31494 tablet_bootstrap.cc:492] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:08.062310 31494 ts_tablet_manager.cc:1403] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.181s user 0.029s sys 0.009s
I20260203 09:18:08.082250 31885 raft_consensus.cc:515] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:08.097460 31496 tablet_bootstrap.cc:654] T bd838f6bdcba4d728e975023e89894a5 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:08.211308 31494 raft_consensus.cc:359] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:08.218716 31494 raft_consensus.cc:385] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:08.219036 31494 raft_consensus.cc:740] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:08.223762 31494 consensus_queue.cc:260] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:08.231693 31850 raft_consensus.cc:493] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:08.232405 31220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "653756c5b80f438b91b3d00ce86f52bb" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:08.232323 31850 raft_consensus.cc:515] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:08.233098 31220 raft_consensus.cc:3060] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:08.234411 31850 leader_election.cc:290] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:08.250295 31495 tablet_bootstrap.cc:492] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0: No bootstrap required, opened a new log
I20260203 09:18:08.250967 31495 ts_tablet_manager.cc:1403] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0: Time spent bootstrapping tablet: real 0.370s user 0.019s sys 0.031s
I20260203 09:18:08.243371 31885 leader_election.cc:290] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:08.273105 31123 catalog_manager.cc:5654] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 1 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:08.265139 31911 raft_consensus.cc:493] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:08.297927 31911 raft_consensus.cc:515] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:08.265419 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f94dad823fea42d2976b19da7bc7b258" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:08.259568 31885 consensus_queue.cc:1048] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20260203 09:18:08.299851 31911 leader_election.cc:290] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:08.310501 31496 tablet_bootstrap.cc:492] T bd838f6bdcba4d728e975023e89894a5 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:08.313596 31496 ts_tablet_manager.cc:1403] T bd838f6bdcba4d728e975023e89894a5 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.286s user 0.023s sys 0.017s
I20260203 09:18:08.307572 31295 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "653756c5b80f438b91b3d00ce86f52bb" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:08.308205 31375 raft_consensus.cc:2468] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
I20260203 09:18:08.338642 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9ac7485f9224e0b9a9e95ce8b3c5654" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:08.342713 31500 consensus_queue.cc:1048] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:08.325090 31295 raft_consensus.cc:3060] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:08.352267 31494 ts_tablet_manager.cc:1434] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.290s user 0.023s sys 0.014s
I20260203 09:18:08.354048 31264 leader_election.cc:304] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:08.354995 31500 raft_consensus.cc:2804] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:08.355392 31500 raft_consensus.cc:493] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:08.355721 31500 raft_consensus.cc:3060] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:08.346081 31953 raft_consensus.cc:493] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:08.363761 31953 raft_consensus.cc:515] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:08.365785 31953 leader_election.cc:290] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:08.368629 31445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9ac7485f9224e0b9a9e95ce8b3c5654" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:08.379904 31494 tablet_bootstrap.cc:492] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:08.409444 31495 raft_consensus.cc:359] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:08.410291 31495 raft_consensus.cc:385] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:08.410542 31495 raft_consensus.cc:740] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Initialized, Role: FOLLOWER
W20260203 09:18:08.438165 31191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:45019, user_credentials={real_user=slave}} blocked reactor thread for 81272.2us
I20260203 09:18:08.415557 31495 consensus_queue.cc:260] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:08.504408 31496 raft_consensus.cc:359] T bd838f6bdcba4d728e975023e89894a5 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:08.505307 31496 raft_consensus.cc:385] T bd838f6bdcba4d728e975023e89894a5 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:08.505586 31496 raft_consensus.cc:740] T bd838f6bdcba4d728e975023e89894a5 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:08.506263 31496 consensus_queue.cc:260] T bd838f6bdcba4d728e975023e89894a5 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
W20260203 09:18:08.512343 31267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:45511, user_credentials={real_user=slave}} blocked reactor thread for 127411us
W20260203 09:18:08.493553 31191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:45019, user_credentials={real_user=slave}} blocked reactor thread for 54582.8us
W20260203 09:18:08.511464 31416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:45511, user_credentials={real_user=slave}} blocked reactor thread for 153842us
I20260203 09:18:08.518991 31500 raft_consensus.cc:515] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:08.493000 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f94dad823fea42d2976b19da7bc7b258" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:08.527168 31495 ts_tablet_manager.cc:1434] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0: Time spent starting tablet: real 0.276s user 0.006s sys 0.003s
I20260203 09:18:08.528013 31500 leader_election.cc:290] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:08.536587 31496 ts_tablet_manager.cc:1434] T bd838f6bdcba4d728e975023e89894a5 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.223s user 0.007s sys 0.000s
I20260203 09:18:08.536806 31447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd838f6bdcba4d728e975023e89894a5" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:08.537459 31447 raft_consensus.cc:2468] T bd838f6bdcba4d728e975023e89894a5 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 0.
I20260203 09:18:08.538532 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd838f6bdcba4d728e975023e89894a5" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:08.539201 31296 raft_consensus.cc:2468] T bd838f6bdcba4d728e975023e89894a5 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 0.
I20260203 09:18:08.540120 31341 leader_election.cc:304] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters:
I20260203 09:18:08.540966 31955 raft_consensus.cc:2804] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:08.541337 31955 raft_consensus.cc:493] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:08.541637 31955 raft_consensus.cc:3060] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:08.546931 31223 raft_consensus.cc:2468] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
W20260203 09:18:08.599735 31191 leader_election.cc:343] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
W20260203 09:18:08.619959 31191 leader_election.cc:343] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:08.620378 31191 leader_election.cc:304] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
W20260203 09:18:08.635070 31188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:41289, user_credentials={real_user=slave}} blocked reactor thread for 249258us
I20260203 09:18:08.636292 31494 tablet_bootstrap.cc:654] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
W20260203 09:18:08.609594 31947 log.cc:927] Time spent T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec: Append to log took a long time: real 0.304s user 0.003s sys 0.000s
I20260203 09:18:08.596079 31220 raft_consensus.cc:2468] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 1.
I20260203 09:18:08.597718 31295 raft_consensus.cc:2468] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 1.
I20260203 09:18:08.648779 31968 raft_consensus.cc:2749] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260203 09:18:08.678915 31341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:45511, user_credentials={real_user=slave}} blocked reactor thread for 45317.9us
I20260203 09:18:08.690270 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f94dad823fea42d2976b19da7bc7b258" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:08.696866 31373 raft_consensus.cc:3060] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:08.742725 31341 leader_election.cc:304] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters:
W20260203 09:18:08.751194 31264 consensus_peers.cc:597] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 -> Peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Couldn't send request to peer 73bf755165c4487c81c67b5ab44f7104. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:08.734094 31890 raft_consensus.cc:493] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:08.754714 31890 raft_consensus.cc:515] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:08.754256 31496 tablet_bootstrap.cc:492] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:08.760208 31920 raft_consensus.cc:2804] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:08.764326 31373 raft_consensus.cc:2468] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:08.771576 31264 leader_election.cc:304] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:08.774804 31920 raft_consensus.cc:697] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Becoming Leader. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:08.789121 31218 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f94dad823fea42d2976b19da7bc7b258" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:08.794133 31218 raft_consensus.cc:3060] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:08.784233 31969 raft_consensus.cc:2804] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:08.809970 31969 raft_consensus.cc:697] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:08.814392 31496 tablet_bootstrap.cc:654] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:08.815894 31890 leader_election.cc:290] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:08.816695 31222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f617ef4ccf984446b1ab7084a92efe17" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:08.743049 31955 raft_consensus.cc:515] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:08.796622 31920 consensus_queue.cc:237] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:08.832787 31955 leader_election.cc:290] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:08.813987 31969 consensus_queue.cc:237] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:08.836314 31979 raft_consensus.cc:493] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:08.836834 31979 raft_consensus.cc:515] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:08.840368 31979 leader_election.cc:290] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:08.856215 31446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd838f6bdcba4d728e975023e89894a5" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:08.856932 31446 raft_consensus.cc:3060] T bd838f6bdcba4d728e975023e89894a5 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:08.895530 31965 consensus_queue.cc:1048] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:08.896700 31500 consensus_queue.cc:1048] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260203 09:18:08.922907 31171 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:18:08.901240 31218 raft_consensus.cc:2468] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:08.928954 31496 tablet_bootstrap.cc:492] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:08.929504 31496 ts_tablet_manager.cc:1403] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.175s user 0.017s sys 0.010s
I20260203 09:18:08.929852 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9ac7485f9224e0b9a9e95ce8b3c5654" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:08.930678 31220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9ac7485f9224e0b9a9e95ce8b3c5654" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:08.931308 31220 raft_consensus.cc:2468] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 0.
I20260203 09:18:08.931962 31496 raft_consensus.cc:359] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:08.932602 31496 raft_consensus.cc:385] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:08.934676 31496 raft_consensus.cc:740] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:08.943912 31496 consensus_queue.cc:260] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:08.953722 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd838f6bdcba4d728e975023e89894a5" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:08.954520 31298 raft_consensus.cc:3060] T bd838f6bdcba4d728e975023e89894a5 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:08.954839 31494 tablet_bootstrap.cc:492] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:08.955358 31494 ts_tablet_manager.cc:1403] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.592s user 0.011s sys 0.018s
I20260203 09:18:08.971889 31496 ts_tablet_manager.cc:1434] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.042s user 0.006s sys 0.000s
I20260203 09:18:08.973035 31496 tablet_bootstrap.cc:492] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:08.957885 31494 raft_consensus.cc:359] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:08.979856 31494 raft_consensus.cc:385] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:08.980168 31494 raft_consensus.cc:740] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:08.980820 31494 consensus_queue.cc:260] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:08.970781 31118 catalog_manager.cc:5654] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67). New cstate: current_term: 1 leader_uuid: "73bf755165c4487c81c67b5ab44f7104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:08.993175 31267 leader_election.cc:304] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:09.004532 31500 raft_consensus.cc:2804] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:09.005019 31500 raft_consensus.cc:493] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:09.005316 31500 raft_consensus.cc:3060] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 [term 0 FOLLOWER]: Advancing to term 1
W20260203 09:18:09.008499 31341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.68:42099, user_credentials={real_user=slave}} blocked reactor thread for 110335us
I20260203 09:18:09.012295 31956 raft_consensus.cc:493] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:09.012856 31956 raft_consensus.cc:515] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
W20260203 09:18:09.026746 31267 leader_election.cc:343] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:09.042128 31494 ts_tablet_manager.cc:1434] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.086s user 0.011s sys 0.000s
I20260203 09:18:09.044750 31446 raft_consensus.cc:2468] T bd838f6bdcba4d728e975023e89894a5 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 1.
I20260203 09:18:09.047010 31500 raft_consensus.cc:515] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:09.049152 31956 leader_election.cc:290] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:09.053630 31500 leader_election.cc:290] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:09.050772 31341 leader_election.cc:304] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters:
I20260203 09:18:09.065470 31366 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f617ef4ccf984446b1ab7084a92efe17" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:09.067085 31413 leader_election.cc:304] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:09.068308 31298 raft_consensus.cc:2468] T bd838f6bdcba4d728e975023e89894a5 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 1.
I20260203 09:18:09.058468 31750 raft_consensus.cc:2804] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:09.072937 31951 raft_consensus.cc:2749] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:09.081333 31970 raft_consensus.cc:493] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:09.082093 31970 raft_consensus.cc:515] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:09.085716 31970 leader_election.cc:290] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:09.089221 31445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee25c6a8d94e49a2a9a5646d493c1bde" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:09.081490 31216 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec42a05859cf4d5ebe1e1f268d01b3fc" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
W20260203 09:18:09.091895 31191 leader_election.cc:343] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:09.090788 31366 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee25c6a8d94e49a2a9a5646d493c1bde" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:09.097340 31366 raft_consensus.cc:2468] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 0.
I20260203 09:18:09.078744 31295 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec42a05859cf4d5ebe1e1f268d01b3fc" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:09.076732 31750 raft_consensus.cc:697] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Becoming Leader. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:09.103955 31188 leader_election.cc:304] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:09.106076 31954 raft_consensus.cc:2804] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:09.105865 31750 consensus_queue.cc:237] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:09.106506 31954 raft_consensus.cc:493] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:09.106887 31954 raft_consensus.cc:3060] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:09.111564 31416 leader_election.cc:304] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:09.112709 31951 raft_consensus.cc:2749] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:09.095417 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9ac7485f9224e0b9a9e95ce8b3c5654" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
W20260203 09:18:09.119307 31267 leader_election.cc:343] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:09.132566 31954 raft_consensus.cc:515] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:09.136991 31954 leader_election.cc:290] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:09.164053 31496 tablet_bootstrap.cc:654] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:09.498351 31496 tablet_bootstrap.cc:492] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:09.498960 31496 ts_tablet_manager.cc:1403] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.526s user 0.012s sys 0.002s
I20260203 09:18:09.501909 31496 raft_consensus.cc:359] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:09.502621 31496 raft_consensus.cc:385] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:09.502923 31496 raft_consensus.cc:740] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:09.870020 31885 raft_consensus.cc:493] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:09.870648 31885 raft_consensus.cc:515] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:09.915592 31885 leader_election.cc:290] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.255668 31885 raft_consensus.cc:493] T dbf01f6b7a2f4b7db0978441f72e138d P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.256397 31885 raft_consensus.cc:515] T dbf01f6b7a2f4b7db0978441f72e138d P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:10.258615 31885 leader_election.cc:290] T dbf01f6b7a2f4b7db0978441f72e138d P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:10.353420 31294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47160 (request call id 179) took 1328 ms. Trace:
I20260203 09:18:10.354120 31294 rpcz_store.cc:276] 0203 09:18:09.025220 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:18:09.028309 (+ 3089us) service_pool.cc:225] Handling call
0203 09:18:10.264045 (+1235736us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b5800020a98. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd0b478b1 00007f2cd0cc9db1 00007f2cd0cca12e 000000000035a3c9 00007f2cd8cf4560 00007f2cd8dbcdd4 00007f2cd8dbce41 00007f2cd8d7eaf0 00007f2cd8d69459 00007f2cd8d68f02 00007f2cd22f5d34
0203 09:18:10.264256 (+ 211us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:18:10.264499 (+ 243us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:18:10.264530 (+ 31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:18:10.264581 (+ 51us) raft_consensus.cc:1645] Marking committed up to 1
0203 09:18:10.264616 (+ 35us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:18:10.353105 (+ 88489us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:18:10.353296 (+ 191us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":27616000}
I20260203 09:18:10.432950 31885 raft_consensus.cc:493] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.433737 31885 raft_consensus.cc:515] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.435647 31850 raft_consensus.cc:493] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.435834 31885 leader_election.cc:290] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.438453 31989 raft_consensus.cc:493] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.439585 31885 raft_consensus.cc:493] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.439720 31989 raft_consensus.cc:515] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.440109 31885 raft_consensus.cc:515] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.442034 31885 leader_election.cc:290] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:10.442569 31885 raft_consensus.cc:493] T f0a785c5c3bf4846b008f0bc6de21607 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.443071 31885 raft_consensus.cc:515] T f0a785c5c3bf4846b008f0bc6de21607 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:10.441952 31989 leader_election.cc:290] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.445482 31850 raft_consensus.cc:515] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.450412 31850 leader_election.cc:290] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.447351 31963 raft_consensus.cc:493] T a9e063333ea146ed9efb0110b67e9520 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.455818 31963 raft_consensus.cc:515] T a9e063333ea146ed9efb0110b67e9520 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.457456 31989 raft_consensus.cc:493] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:10.459627 31366 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "defda4c9fc6a4d0ba46ec287eb2f08d1" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:10.459959 31989 raft_consensus.cc:515] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:10.460449 31366 raft_consensus.cc:2468] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:10.462011 31989 leader_election.cc:290] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:10.462013 31850 raft_consensus.cc:493] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:10.463558 31850 raft_consensus.cc:515] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.457962 31963 leader_election.cc:290] T a9e063333ea146ed9efb0110b67e9520 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:10.465482 31963 raft_consensus.cc:493] T f0a785c5c3bf4846b008f0bc6de21607 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.465632 31264 leader_election.cc:304] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:10.466017 31963 raft_consensus.cc:515] T f0a785c5c3bf4846b008f0bc6de21607 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:10.467185 31955 raft_consensus.cc:493] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.467752 32002 raft_consensus.cc:493] T c2ce342ceda546bbad30e8eff5485a48 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:10.467671 31955 raft_consensus.cc:515] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:10.469588 31850 leader_election.cc:290] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.469588 31955 leader_election.cc:290] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:10.470160 31850 raft_consensus.cc:493] T c43e17bc65f048a9a9fd229bb9c98bfb P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:10.458966 32001 raft_consensus.cc:493] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:10.446951 31999 raft_consensus.cc:493] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.471381 32001 raft_consensus.cc:515] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:10.467979 31963 leader_election.cc:290] T f0a785c5c3bf4846b008f0bc6de21607 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:10.472397 31963 raft_consensus.cc:493] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.472965 31963 raft_consensus.cc:515] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.473536 32001 leader_election.cc:290] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:10.474941 31963 leader_election.cc:290] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.445133 31885 leader_election.cc:290] T f0a785c5c3bf4846b008f0bc6de21607 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:10.471499 31999 raft_consensus.cc:515] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:10.475274 31500 raft_consensus.cc:493] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:10.475900 31500 raft_consensus.cc:515] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.476822 32002 raft_consensus.cc:515] T c2ce342ceda546bbad30e8eff5485a48 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:10.477568 31500 leader_election.cc:290] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.478199 31366 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14073202fe424a9b9a72f4c7e6075bdf" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:10.479113 31885 raft_consensus.cc:493] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:10.479532 32002 leader_election.cc:290] T c2ce342ceda546bbad30e8eff5485a48 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:10.478869 31366 raft_consensus.cc:2468] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:10.479442 31369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2ce342ceda546bbad30e8eff5485a48" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:10.479648 31885 raft_consensus.cc:515] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:10.474148 32001 raft_consensus.cc:493] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.481011 32001 raft_consensus.cc:515] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.482432 31367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57862 (request call id 138) took 1459 ms. Trace:
I20260203 09:18:10.482722 31885 leader_election.cc:290] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:10.483167 32001 leader_election.cc:290] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:10.483741 32001 raft_consensus.cc:493] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.479681 31999 leader_election.cc:290] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:10.484236 32001 raft_consensus.cc:515] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.485709 31264 leader_election.cc:304] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:10.464841 32000 raft_consensus.cc:493] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:10.486088 31494 tablet_bootstrap.cc:492] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:10.482856 31367 rpcz_store.cc:276] 0203 09:18:09.022913 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:18:09.028626 (+ 5713us) service_pool.cc:225] Handling call
0203 09:18:10.481679 (+1453053us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b580052e998. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd0b478b1 00007f2cd0cc9db1 00007f2cd0cca12e 000000000035a3c9 00007f2cd8cf4560 00007f2cd8dbcdd4 00007f2cd8dbce41 00007f2cd8d7eaf0 00007f2cd8d69459 00007f2cd8d68f02 00007f2cd22f5d34
0203 09:18:10.481867 (+ 188us) raft_consensus.cc:1471] Updating replica for 0 ops
0203 09:18:10.482064 (+ 197us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:18:10.482104 (+ 40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0203 09:18:10.482152 (+ 48us) raft_consensus.cc:1645] Marking committed up to 1
0203 09:18:10.482189 (+ 37us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:18:10.482245 (+ 56us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:18:10.482354 (+ 109us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7426944}
I20260203 09:18:10.489614 31884 raft_consensus.cc:2804] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:10.478508 31500 raft_consensus.cc:2804] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:10.490033 31884 raft_consensus.cc:493] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.490340 31500 raft_consensus.cc:493] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.490718 31500 raft_consensus.cc:3060] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:10.496624 31884 raft_consensus.cc:3060] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:10.502701 31999 raft_consensus.cc:493] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.503379 31999 raft_consensus.cc:515] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:10.504434 32002 raft_consensus.cc:493] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:10.506122 32002 raft_consensus.cc:515] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:10.506439 31367 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b4a1f3d804ae39a009a23ea4e90f3" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:10.507107 31367 raft_consensus.cc:2468] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:10.508107 31264 leader_election.cc:304] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:10.511511 31441 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee25c6a8d94e49a2a9a5646d493c1bde" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:10.513152 31500 raft_consensus.cc:515] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.515666 31367 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "defda4c9fc6a4d0ba46ec287eb2f08d1" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:10.516249 31367 raft_consensus.cc:3060] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:10.516428 32002 leader_election.cc:290] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:10.517412 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbf01f6b7a2f4b7db0978441f72e138d" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:10.519059 31966 raft_consensus.cc:493] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:10.519281 31301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "707a391491654853bba7daefe8451eca" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:10.520274 31885 raft_consensus.cc:493] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.520809 31885 raft_consensus.cc:515] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:10.522604 31955 raft_consensus.cc:493] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.523132 31955 raft_consensus.cc:515] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:10.525027 31955 leader_election.cc:290] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:10.526489 31989 raft_consensus.cc:493] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:10.527066 31989 raft_consensus.cc:515] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:10.529448 31989 leader_election.cc:290] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:10.529937 31989 raft_consensus.cc:493] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:10.530556 31500 leader_election.cc:290] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.529377 32004 raft_consensus.cc:493] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:10.530361 31989 raft_consensus.cc:515] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:10.531450 32004 raft_consensus.cc:515] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.532439 31959 raft_consensus.cc:493] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:10.526525 31222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9ac7485f9224e0b9a9e95ce8b3c5654" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:10.533011 31959 raft_consensus.cc:515] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.533797 31222 raft_consensus.cc:3060] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:10.532672 31989 leader_election.cc:290] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:10.534363 32003 raft_consensus.cc:493] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:10.533169 31955 raft_consensus.cc:493] T 730e665d69354cad93df20607e256d58 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.535025 31955 raft_consensus.cc:515] T 730e665d69354cad93df20607e256d58 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:10.537338 31955 leader_election.cc:290] T 730e665d69354cad93df20607e256d58 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:10.537467 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec42a05859cf4d5ebe1e1f268d01b3fc" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:10.538115 31444 raft_consensus.cc:2468] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 0.
I20260203 09:18:10.538677 31955 raft_consensus.cc:493] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.538980 31956 raft_consensus.cc:493] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.534929 32003 raft_consensus.cc:515] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.532954 31966 raft_consensus.cc:515] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:10.540131 31301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14073202fe424a9b9a72f4c7e6075bdf" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:10.538903 31367 raft_consensus.cc:2468] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 2.
I20260203 09:18:10.532455 31890 raft_consensus.cc:493] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.541841 31966 leader_election.cc:290] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:10.541675 31890 raft_consensus.cc:515] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.542053 31264 leader_election.cc:304] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:10.539521 31956 raft_consensus.cc:515] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:10.543017 31989 raft_consensus.cc:493] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.543713 31500 raft_consensus.cc:2804] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:10.543507 31989 raft_consensus.cc:515] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:10.544206 31500 raft_consensus.cc:697] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [term 2 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:10.544315 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f0a785c5c3bf4846b008f0bc6de21607" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:10.544680 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f94dad823fea42d2976b19da7bc7b258" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:10.545116 31500 consensus_queue.cc:237] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.545987 31369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8dbd55217e2546b5b3361ddf019f01d6" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:10.517499 32002 raft_consensus.cc:2804] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:10.547482 31959 leader_election.cc:290] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.547955 31294 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:10.548367 32004 leader_election.cc:290] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:10.548841 31911 raft_consensus.cc:493] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:10.549391 32002 raft_consensus.cc:493] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.549346 31911 raft_consensus.cc:515] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.549904 32002 raft_consensus.cc:3060] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
W20260203 09:18:10.550467 31397 debug-util.cc:398] Leaking SignalData structure 0x7b08000f1040 after lost signal to thread 27556
I20260203 09:18:10.551359 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "653756c5b80f438b91b3d00ce86f52bb" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:10.553254 31294 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc8de34393ac472590f28a52d1bf55ff" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:10.553757 32003 leader_election.cc:290] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:10.554198 31954 raft_consensus.cc:493] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.555042 32006 raft_consensus.cc:493] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:10.554826 31954 raft_consensus.cc:515] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.555475 31294 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a8fd0dd8dc8d432b8e8bb19f4f3448cc" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:10.545979 31989 leader_election.cc:290] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:10.562162 31750 raft_consensus.cc:493] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.562661 31750 raft_consensus.cc:515] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.556849 31954 leader_election.cc:290] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:10.533027 31885 leader_election.cc:290] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:10.557946 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "730e665d69354cad93df20607e256d58" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:10.569583 31873 raft_consensus.cc:493] T e57c5a8761da4a818b634fda6687de01 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:10.557539 32004 raft_consensus.cc:493] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.543567 31890 leader_election.cc:290] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:10.558988 31295 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "defda4c9fc6a4d0ba46ec287eb2f08d1" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:10.558810 32006 raft_consensus.cc:515] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.559412 31294 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9884e996f0443f2ae2ab5606633ce3c" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:10.596174 32004 raft_consensus.cc:515] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.572826 31964 raft_consensus.cc:493] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:10.597900 31964 raft_consensus.cc:515] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.598991 32004 leader_election.cc:290] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:10.599967 31964 leader_election.cc:290] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:10.600255 32006 leader_election.cc:290] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:10.554298 32003 raft_consensus.cc:493] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:10.544106 31956 leader_election.cc:290] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:10.588256 31959 raft_consensus.cc:493] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:10.564626 31750 leader_election.cc:290] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.470674 31850 raft_consensus.cc:515] T c43e17bc65f048a9a9fd229bb9c98bfb P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:10.505420 31999 leader_election.cc:290] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:10.578130 31965 raft_consensus.cc:493] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.539594 31955 raft_consensus.cc:515] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:10.567037 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "420f71f998fb4c24a607beff32960d0d" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:10.607818 31494 tablet_bootstrap.cc:654] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:10.573697 31966 raft_consensus.cc:493] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.566614 31911 leader_election.cc:290] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:10.604224 31959 raft_consensus.cc:515] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
W20260203 09:18:10.651544 31341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:45019, user_credentials={real_user=slave}} blocked reactor thread for 57276.8us
I20260203 09:18:10.620601 31222 raft_consensus.cc:2468] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:10.601548 31989 raft_consensus.cc:493] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.614001 32001 leader_election.cc:290] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:10.611474 31956 raft_consensus.cc:493] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:10.596073 31873 raft_consensus.cc:515] T e57c5a8761da4a818b634fda6687de01 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.642953 31963 raft_consensus.cc:493] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.619103 31884 raft_consensus.cc:515] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:10.651454 31750 raft_consensus.cc:493] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.657481 31953 raft_consensus.cc:493] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.593592 32000 raft_consensus.cc:515] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:10.604012 32003 raft_consensus.cc:515] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.648062 31999 consensus_queue.cc:1048] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260203 09:18:10.647611 31966 raft_consensus.cc:515] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.661006 31911 raft_consensus.cc:493] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.676065 31500 raft_consensus.cc:493] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.604085 32009 consensus_queue.cc:1048] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.062s
I20260203 09:18:10.667203 32014 raft_consensus.cc:493] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
W20260203 09:18:10.661568 31222 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49860 (request call id 137) took 1584 ms (client timeout 1949 ms). Trace:
I20260203 09:18:10.709481 31500 raft_consensus.cc:515] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.640537 31965 raft_consensus.cc:515] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.673413 32008 raft_consensus.cc:493] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.727461 31500 leader_election.cc:290] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.732062 31500 raft_consensus.cc:493] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.664433 31956 raft_consensus.cc:515] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.732573 31500 raft_consensus.cc:515] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:10.662838 31989 raft_consensus.cc:515] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.666574 31963 raft_consensus.cc:515] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:10.737125 31366 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee25c6a8d94e49a2a9a5646d493c1bde" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:10.737522 32008 raft_consensus.cc:515] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.725044 31911 raft_consensus.cc:515] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.738253 31959 leader_election.cc:290] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:10.738556 31952 raft_consensus.cc:493] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
W20260203 09:18:10.739603 31341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:45019, user_credentials={real_user=slave}} blocked reactor thread for 81377.9us
I20260203 09:18:10.729225 31890 raft_consensus.cc:493] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.746167 32021 raft_consensus.cc:493] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.724038 31964 raft_consensus.cc:493] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:10.739305 31873 leader_election.cc:290] T e57c5a8761da4a818b634fda6687de01 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.675266 31750 raft_consensus.cc:515] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:10.677619 31953 raft_consensus.cc:515] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:10.750219 31301 raft_consensus.cc:2393] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73bf755165c4487c81c67b5ab44f7104 in current term 2: Already voted for candidate 79b10fa125f242419f66b577440e66d0 in this term.
W20260203 09:18:10.725164 31222 rpcz_store.cc:269] 0203 09:18:09.077386 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:18:10.526247 (+1448861us) service_pool.cc:225] Handling call
0203 09:18:10.659363 (+133116us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260203 09:18:10.739336 32011 raft_consensus.cc:493] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:10.755741 31366 raft_consensus.cc:3060] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:10.778761 32007 raft_consensus.cc:493] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.778402 31873 raft_consensus.cc:493] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:10.751111 32006 raft_consensus.cc:493] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.743237 32002 raft_consensus.cc:515] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:10.777899 31954 raft_consensus.cc:493] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:10.775275 31759 raft_consensus.cc:493] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
W20260203 09:18:10.794032 31413 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:41289, user_credentials={real_user=slave}} blocked reactor thread for 46354.3us
I20260203 09:18:10.761015 31885 consensus_queue.cc:1048] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260203 09:18:10.780966 31999 raft_consensus.cc:493] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:10.779834 31959 raft_consensus.cc:493] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.736038 32014 raft_consensus.cc:515] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.775736 31890 raft_consensus.cc:515] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.774830 31964 raft_consensus.cc:515] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.779425 32021 raft_consensus.cc:515] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.826558 31217 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14073202fe424a9b9a72f4c7e6075bdf" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:10.827135 31959 raft_consensus.cc:515] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.845036 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f6fed7d1dca4d4184fd89b136a55ec1" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:10.846633 31963 leader_election.cc:290] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:10.846835 31959 leader_election.cc:290] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.847438 31963 raft_consensus.cc:493] T 92861fb258ec44228e1c191bee2fee0b P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.848084 31959 raft_consensus.cc:493] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.797106 32006 raft_consensus.cc:515] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:10.849301 31890 leader_election.cc:290] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:10.787739 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "defda4c9fc6a4d0ba46ec287eb2f08d1" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:10.802204 31850 leader_election.cc:290] T c43e17bc65f048a9a9fd229bb9c98bfb P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:10.852053 32002 leader_election.cc:290] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:10.853312 31964 leader_election.cc:290] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:10.837841 32009 raft_consensus.cc:493] T 9e9201a8d64c4b45982d775e4406a3fd P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:10.838246 31222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1d1f5b1c3b64ebaa2824e9136285fbe" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:10.854416 31222 raft_consensus.cc:2468] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:10.854251 32009 raft_consensus.cc:515] T 9e9201a8d64c4b45982d775e4406a3fd P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.802927 31759 raft_consensus.cc:515] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:10.855891 31750 leader_election.cc:290] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:10.856264 32009 leader_election.cc:290] T 9e9201a8d64c4b45982d775e4406a3fd P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.857239 31911 leader_election.cc:290] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:10.857482 31759 leader_election.cc:290] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:10.802794 31954 raft_consensus.cc:515] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:10.787936 32011 raft_consensus.cc:515] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:10.801554 32016 raft_consensus.cc:493] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.858853 31953 leader_election.cc:290] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:10.859422 31954 leader_election.cc:290] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:10.859212 32016 raft_consensus.cc:515] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.859846 31989 leader_election.cc:290] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.860569 31966 leader_election.cc:290] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.861294 32011 leader_election.cc:290] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:10.852154 31884 leader_election.cc:290] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:10.862587 31496 consensus_queue.cc:260] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.863336 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b062505fb476790c4f06d074d67aa" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:10.825217 31961 raft_consensus.cc:493] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.864615 32016 leader_election.cc:290] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.865196 32016 raft_consensus.cc:493] T 9adae0a7f8a243ad9a35cb7a2047f472 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.826004 32018 raft_consensus.cc:493] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:10.826603 32013 raft_consensus.cc:493] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:10.842962 31371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:10.842948 31372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f0a785c5c3bf4846b008f0bc6de21607" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:10.844470 32021 leader_election.cc:290] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.799970 31873 raft_consensus.cc:515] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.863426 31951 raft_consensus.cc:493] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:10.797914 31955 leader_election.cc:290] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:10.805413 31999 raft_consensus.cc:515] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:10.866554 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d9139b651d14e5082793499087ed2d4" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:10.865640 32016 raft_consensus.cc:515] T 9adae0a7f8a243ad9a35cb7a2047f472 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.887456 32018 raft_consensus.cc:515] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:10.894572 32000 leader_election.cc:290] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:10.895255 31873 leader_election.cc:290] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.895663 32016 leader_election.cc:290] T 9adae0a7f8a243ad9a35cb7a2047f472 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:10.895879 32018 leader_election.cc:290] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:10.780069 31952 raft_consensus.cc:515] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:10.883258 32013 raft_consensus.cc:515] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:10.896334 31367 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03e1544e85d94310a17e919716a0e5b9" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:10.897661 31952 leader_election.cc:290] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:10.864876 32017 raft_consensus.cc:493] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.898015 32013 leader_election.cc:290] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:10.885877 31371 raft_consensus.cc:2468] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 2.
I20260203 09:18:10.898283 31375 raft_consensus.cc:2468] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:10.898607 31951 raft_consensus.cc:515] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.893673 32024 raft_consensus.cc:493] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:10.899098 31371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a5ca73a494b4d7389eec90025653337" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:10.899526 32024 raft_consensus.cc:515] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:10.900542 31371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3cb6ffb2d8d4a528e8f6108d59adb09" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:10.887277 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14fd7c3d313847f591177ebba8df09c4" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:10.901675 32024 leader_election.cc:290] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:10.803041 32007 raft_consensus.cc:515] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.850317 32006 leader_election.cc:290] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:10.902662 31951 leader_election.cc:290] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.903127 32017 raft_consensus.cc:515] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:10.903785 32007 leader_election.cc:290] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
W20260203 09:18:10.898387 32010 log.cc:927] Time spent T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0: Append to log took a long time: real 0.092s user 0.001s sys 0.000s
I20260203 09:18:10.905205 32017 leader_election.cc:290] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:10.905803 31371 raft_consensus.cc:1240] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Rejecting Update request from peer d44c40c0ed244c4e962a26f9aebea76a for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:10.897804 31372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f617ef4ccf984446b1ab7084a92efe17" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:10.853780 32014 leader_election.cc:290] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.868778 31959 raft_consensus.cc:515] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.912952 31441 raft_consensus.cc:3060] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:10.895735 31956 leader_election.cc:290] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.848135 31963 raft_consensus.cc:515] T 92861fb258ec44228e1c191bee2fee0b P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.917665 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8dbd55217e2546b5b3361ddf019f01d6" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:10.919728 31963 leader_election.cc:290] T 92861fb258ec44228e1c191bee2fee0b P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:10.864878 31961 raft_consensus.cc:515] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:10.922109 31946 raft_consensus.cc:493] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.922600 31946 raft_consensus.cc:515] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.924902 31956 raft_consensus.cc:493] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.925447 31956 raft_consensus.cc:515] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
W20260203 09:18:10.926822 31397 debug-util.cc:398] Leaking SignalData structure 0x7b08002a4b20 after lost signal to thread 31157
I20260203 09:18:10.927426 31956 leader_election.cc:290] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:10.928022 31956 raft_consensus.cc:493] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.897572 31367 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70796ace22d548219e05b0c9a86346e7" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:10.929495 31500 leader_election.cc:290] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:10.928982 31963 raft_consensus.cc:493] T 15d598c8a8514ff5af7a0e48897dffa7 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.949139 31218 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3abbec594ab143a1ade1030741cf9e7d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:10.949378 31963 raft_consensus.cc:515] T 15d598c8a8514ff5af7a0e48897dffa7 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:10.934909 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14073202fe424a9b9a72f4c7e6075bdf" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:10.914499 32007 raft_consensus.cc:493] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:10.933513 32016 raft_consensus.cc:493] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.935920 31217 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "653756c5b80f438b91b3d00ce86f52bb" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:10.935781 31961 leader_election.cc:290] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:10.928540 31959 leader_election.cc:290] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.924546 31946 leader_election.cc:290] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.931427 31219 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20dfe4990e0a46ef9b0cf1cdf3dfdb09" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:10.967971 31445 raft_consensus.cc:3060] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:10.914196 32003 leader_election.cc:290] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:10.954105 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b4a1f3d804ae39a009a23ea4e90f3" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:10.959065 31191 leader_election.cc:304] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:10.952448 32006 raft_consensus.cc:493] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:10.953483 31952 raft_consensus.cc:493] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.957821 31951 raft_consensus.cc:493] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:10.957960 32007 raft_consensus.cc:515] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.962674 31217 raft_consensus.cc:2468] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:10.978850 31951 raft_consensus.cc:515] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:10.954718 31370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c43e17bc65f048a9a9fd229bb9c98bfb" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:10.980139 31963 leader_election.cc:290] T 15d598c8a8514ff5af7a0e48897dffa7 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:10.955026 31965 leader_election.cc:290] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.980703 31951 leader_election.cc:290] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.924934 32019 raft_consensus.cc:493] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:10.981714 31370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a8fd0dd8dc8d432b8e8bb19f4f3448cc" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:10.922500 32025 raft_consensus.cc:493] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:10.982432 31372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f6fed7d1dca4d4184fd89b136a55ec1" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:10.982368 32025 raft_consensus.cc:515] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.928472 31956 raft_consensus.cc:515] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:10.978061 31367 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b4a1f3d804ae39a009a23ea4e90f3" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:10.988364 31367 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "707a391491654853bba7daefe8451eca" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:10.989440 31367 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:10.977270 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14073202fe424a9b9a72f4c7e6075bdf" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:10.980995 32007 leader_election.cc:290] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.990185 31373 raft_consensus.cc:3060] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:10.978219 31301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06460fafee594578bed03068236ad9f2" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:10.981470 32019 raft_consensus.cc:515] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.990415 31367 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93cc0a94606149e18c8764e851f4b826" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:10.992033 32019 leader_election.cc:290] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:10.991760 31952 raft_consensus.cc:515] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:10.993774 31952 leader_election.cc:290] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:10.974987 31496 ts_tablet_manager.cc:1434] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 1.476s user 0.012s sys 0.008s
I20260203 09:18:10.983613 31372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "55ce9fa640064a68a12f7f2c60a74bfd" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
W20260203 09:18:10.995489 31496 ts_tablet_manager.cc:1467] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec: Tablet startup took 1496ms
I20260203 09:18:10.984026 31218 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3eab34196fcb483abc69a625b7ca6300" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
W20260203 09:18:10.995836 31496 ts_tablet_manager.cc:1469] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec: Trace:
0203 09:17:59.586116 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:17:59.685005 (+ 98889us) service_pool.cc:225] Handling call
0203 09:17:59.686976 (+ 1971us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0203 09:17:59.687088 (+ 112us) ts_tablet_manager.cc:682] Creating new metadata...
0203 09:17:59.860396 (+173308us) tablet_metadata.cc:641] Metadata flushed
0203 09:17:59.879217 (+ 18821us) tablet_replica.cc:206] Creating consensus instance
0203 09:17:59.879749 (+ 532us) inbound_call.cc:173] Queueing success response
0203 09:18:08.972638 (+9092889us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0203 09:18:09.499258 (+526620us) ts_tablet_manager.cc:1435] Starting tablet replica
0203 09:18:09.499931 (+ 673us) tablet_replica.cc:261] Starting instrumentation
0203 09:18:09.500438 (+ 507us) tablet_replica.cc:280] Starting consensus
0203 09:18:10.969085 (+1468647us) spinlock_profiling.cc:243] Waited 38.9 ms on lock 0x7b54002e8e54. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd3d1e5a1 00007f2cd3dabdae 00007f2cd3daa90d 00007f2cd77a9ace 00007f2cd8db9a9a 00007f2cd8dcda11 00007f2cd8dcd9b9 00007f2cd8dcd949 00007f2cd8dcd911 00007f2cd8dccbed 0000000000379254
Metrics: {"raft.queue_time_us":1725,"spinlock_wait_cycles":89403776,"tablet-open.queue_time_us":9093012}
I20260203 09:18:10.982878 31370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc8de34393ac472590f28a52d1bf55ff" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:10.997445 32006 raft_consensus.cc:515] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:10.998484 31118 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60908 (request call id 69) took 2040 ms. Trace:
I20260203 09:18:10.999536 32006 leader_election.cc:290] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:11.000113 31219 raft_consensus.cc:2468] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:10.986323 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1d1f5b1c3b64ebaa2824e9136285fbe" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.000825 31294 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9e063333ea146ed9efb0110b67e9520" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.002950 31954 raft_consensus.cc:2804] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:11.003206 31294 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8301405e2ead406caa7440c0337df77d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.003383 31220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "defda4c9fc6a4d0ba46ec287eb2f08d1" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:11.004362 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b062505fb476790c4f06d074d67aa" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.005626 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1d1f5b1c3b64ebaa2824e9136285fbe" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
W20260203 09:18:11.005975 31397 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4200 after lost signal to thread 31250
I20260203 09:18:11.006101 31295 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f6fed7d1dca4d4184fd89b136a55ec1" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
W20260203 09:18:11.006383 31397 debug-util.cc:398] Leaking SignalData structure 0x7b080026a080 after lost signal to thread 31251
W20260203 09:18:11.008504 31397 debug-util.cc:398] Leaking SignalData structure 0x7b0800127140 after lost signal to thread 31325
W20260203 09:18:11.009779 31397 debug-util.cc:398] Leaking SignalData structure 0x7b08001113a0 after lost signal to thread 31326
W20260203 09:18:11.010797 31397 debug-util.cc:398] Leaking SignalData structure 0x7b0800143300 after lost signal to thread 31400
W20260203 09:18:11.011085 31397 debug-util.cc:398] Leaking SignalData structure 0x7b080014f0e0 after lost signal to thread 31401
I20260203 09:18:10.999428 31956 leader_election.cc:290] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:10.973600 31999 leader_election.cc:290] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:11.013792 31366 raft_consensus.cc:2468] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:10.959663 32016 raft_consensus.cc:515] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:11.015568 31294 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b0e416075b74212b54e341eba13fd78" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.016367 32016 leader_election.cc:290] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:10.995891 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec42a05859cf4d5ebe1e1f268d01b3fc" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:10.988441 32025 leader_election.cc:290] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:11.017894 31294 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92861fb258ec44228e1c191bee2fee0b" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.018138 31954 raft_consensus.cc:493] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:11.018553 31954 raft_consensus.cc:3060] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
W20260203 09:18:11.019253 31397 debug-util.cc:398] Leaking SignalData structure 0x7b0800384d60 after lost signal to thread 31474
I20260203 09:18:11.020095 32008 leader_election.cc:290] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:11.006667 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06460fafee594578bed03068236ad9f2" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.021317 31444 raft_consensus.cc:2468] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:11.026153 31217 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.026419 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b92ba54a16143c08cfa7303819aa929" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.027088 31443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a5ca73a494b4d7389eec90025653337" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.027626 31294 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2975d753fec1406eadec135c189d3ec3" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.028200 31443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70796ace22d548219e05b0c9a86346e7" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.028831 31443 raft_consensus.cc:2468] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:11.028968 31219 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f6fed7d1dca4d4184fd89b136a55ec1" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.029626 31219 raft_consensus.cc:2468] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:11.031208 31370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "374ce202ecd540008cded117a37bfeba" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:11.032204 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b0e416075b74212b54e341eba13fd78" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:11.034037 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f617ef4ccf984446b1ab7084a92efe17" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.034660 31449 raft_consensus.cc:2468] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:11.035229 31222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b4a1f3d804ae39a009a23ea4e90f3" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.040988 31297 raft_consensus.cc:1240] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [term 2 LEADER]: Rejecting Update request from peer d44c40c0ed244c4e962a26f9aebea76a for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:11.046157 31294 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f0a785c5c3bf4846b008f0bc6de21607" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.047449 31218 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93cc0a94606149e18c8764e851f4b826" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.050539 31441 raft_consensus.cc:2468] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:11.051298 31123 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60896 (request call id 68) took 2824 ms. Trace:
I20260203 09:18:11.051759 31294 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14fd7c3d313847f591177ebba8df09c4" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.052394 31294 raft_consensus.cc:2468] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 1.
I20260203 09:18:11.018592 31296 raft_consensus.cc:1240] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Rejecting Update request from peer d44c40c0ed244c4e962a26f9aebea76a for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:11.056638 31220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c2f90aaa7514d27a5a15b4fd6f90669" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.057343 31297 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9e063333ea146ed9efb0110b67e9520" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.058288 31295 raft_consensus.cc:1240] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Rejecting Update request from peer d44c40c0ed244c4e962a26f9aebea76a for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:11.026346 31447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03e1544e85d94310a17e919716a0e5b9" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.059513 31447 raft_consensus.cc:2468] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
W20260203 09:18:11.059855 31171 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:18:11.060946 31371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70796ace22d548219e05b0c9a86346e7" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:11.062193 31371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbf01f6b7a2f4b7db0978441f72e138d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:11.062556 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2975d753fec1406eadec135c189d3ec3" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:11.063308 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9e063333ea146ed9efb0110b67e9520" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.063539 31369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5ccddc8d332443c97a92e59957dfa69" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:11.064560 31447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92861fb258ec44228e1c191bee2fee0b" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.051677 31123 rpcz_store.cc:276] 0203 09:18:08.227345 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:18:08.229559 (+ 2214us) service_pool.cc:225] Handling call
0203 09:18:11.051214 (+2821655us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0203 09:18:08.514348 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0203 09:18:08.538069 (+ 23721us) write_op.cc:432] Acquiring schema lock in shared mode
0203 09:18:08.538101 (+ 32us) write_op.cc:435] Acquired schema lock
0203 09:18:08.538116 (+ 15us) tablet.cc:660] Decoding operations
0203 09:18:08.538421 (+ 305us) write_op.cc:620] Acquiring the partition lock for write op
0203 09:18:08.538475 (+ 54us) write_op.cc:641] Partition lock acquired for write op
0203 09:18:08.538500 (+ 25us) tablet.cc:683] Acquiring locks for 1 operations
0203 09:18:08.538669 (+ 169us) tablet.cc:699] Row locks acquired
0203 09:18:08.538682 (+ 13us) write_op.cc:260] PREPARE: finished
0203 09:18:08.791680 (+252998us) spinlock_profiling.cc:243] Waited 9.58 ms on lock 0x7b2c000fe6d8. stack: 00007f2cd0cd5373 00007f2cd0cd5270 00007f2cd0627574 00007f2cda2e36b4 00007f2cda2e3649 00007f2cd26b39b1 00007f2cd26c267a 00007f2cd26c2303 00007f2cd26c22a1 00007f2cd3df0752 00007f2cd3df052d 00007f2cd77ed193 00007f2cd77ecca8 00007f2cd77f1941 00007f2cd77f18f9 00007f2cd77f1889
0203 09:18:08.791748 (+ 68us) write_op.cc:270] Start()
0203 09:18:08.791940 (+ 192us) write_op.cc:276] Timestamp: P: 1770110288548356 usec, L: 0
0203 09:18:08.791967 (+ 27us) op_driver.cc:348] REPLICATION: starting
0203 09:18:08.792562 (+ 595us) log.cc:844] Serialized 540 byte log entry
0203 09:18:09.079893 (+287331us) op_driver.cc:464] REPLICATION: finished
0203 09:18:09.146161 (+ 66268us) write_op.cc:301] APPLY: starting
0203 09:18:09.146245 (+ 84us) tablet.cc:1365] starting BulkCheckPresence
0203 09:18:09.146336 (+ 91us) tablet.cc:1368] finished BulkCheckPresence
0203 09:18:09.146359 (+ 23us) tablet.cc:1370] starting ApplyRowOperation cycle
0203 09:18:09.148713 (+ 2354us) tablet.cc:1381] finished ApplyRowOperation cycle
0203 09:18:09.148876 (+ 163us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0203 09:18:09.148919 (+ 43us) write_op.cc:312] APPLY: finished
0203 09:18:09.149122 (+ 203us) log.cc:844] Serialized 22 byte log entry
0203 09:18:09.149294 (+ 172us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:18:09.149369 (+ 75us) write_op.cc:454] Released schema lock
0203 09:18:09.149408 (+ 39us) write_op.cc:341] FINISH: Updating metrics
0203 09:18:09.149703 (+ 295us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:18:09.149745 (+ 42us) write_op.cc:454] Released schema lock
0203 09:18:09.177820 (+ 28075us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:18:09.177862 (+ 42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":144666,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":52978,"apply.run_cpu_time_us":1505,"apply.run_wall_time_us":3534,"num_ops":1,"prepare.queue_time_us":150192,"prepare.run_cpu_time_us":25013,"prepare.run_wall_time_us":341158,"raft.queue_time_us":293981,"raft.run_cpu_time_us":14581,"raft.run_wall_time_us":126503,"replication_time_us":265772,"spinlock_wait_cycles":22034304,"thread_start_us":182255,"threads_started":4,"wal-append.queue_time_us":87756,"wal-append.run_cpu_time_us":32919,"wal-append.run_wall_time_us":1972114}]]}
I20260203 09:18:11.029675 31443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8301405e2ead406caa7440c0337df77d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.068480 31443 raft_consensus.cc:2468] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:10.998842 31118 rpcz_store.cc:276] 0203 09:18:08.957794 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:18:08.957974 (+ 180us) service_pool.cc:225] Handling call
0203 09:18:10.998408 (+2040434us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0203 09:18:09.008185 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0203 09:18:09.010231 (+ 2046us) write_op.cc:432] Acquiring schema lock in shared mode
0203 09:18:09.010262 (+ 31us) write_op.cc:435] Acquired schema lock
0203 09:18:09.010274 (+ 12us) tablet.cc:660] Decoding operations
0203 09:18:09.010589 (+ 315us) write_op.cc:620] Acquiring the partition lock for write op
0203 09:18:09.010634 (+ 45us) write_op.cc:641] Partition lock acquired for write op
0203 09:18:09.010661 (+ 27us) tablet.cc:683] Acquiring locks for 1 operations
0203 09:18:09.010846 (+ 185us) tablet.cc:699] Row locks acquired
0203 09:18:09.010859 (+ 13us) write_op.cc:260] PREPARE: finished
0203 09:18:09.010999 (+ 140us) write_op.cc:270] Start()
0203 09:18:09.011098 (+ 99us) write_op.cc:276] Timestamp: P: 1770110289010952 usec, L: 0
0203 09:18:09.011113 (+ 15us) op_driver.cc:348] REPLICATION: starting
0203 09:18:09.011672 (+ 559us) log.cc:844] Serialized 540 byte log entry
0203 09:18:09.146248 (+134576us) op_driver.cc:464] REPLICATION: finished
0203 09:18:09.150039 (+ 3791us) write_op.cc:301] APPLY: starting
0203 09:18:09.150109 (+ 70us) tablet.cc:1365] starting BulkCheckPresence
0203 09:18:09.150203 (+ 94us) tablet.cc:1368] finished BulkCheckPresence
0203 09:18:09.150301 (+ 98us) tablet.cc:1370] starting ApplyRowOperation cycle
0203 09:18:09.150492 (+ 191us) tablet.cc:1381] finished ApplyRowOperation cycle
0203 09:18:09.150631 (+ 139us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0203 09:18:09.150673 (+ 42us) write_op.cc:312] APPLY: finished
0203 09:18:09.150838 (+ 165us) log.cc:844] Serialized 22 byte log entry
0203 09:18:09.151004 (+ 166us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:18:09.151078 (+ 74us) write_op.cc:454] Released schema lock
0203 09:18:09.151112 (+ 34us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":363136,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":3622,"apply.run_cpu_time_us":1298,"apply.run_wall_time_us":1298,"num_ops":1,"prepare.queue_time_us":1806,"prepare.run_cpu_time_us":2350,"prepare.run_wall_time_us":17996,"replication_time_us":135021,"thread_start_us":31286,"threads_started":1}]]}
I20260203 09:18:11.073010 31441 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "374ce202ecd540008cded117a37bfeba" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.073559 31295 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3cb6ffb2d8d4a528e8f6108d59adb09" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.073709 31441 raft_consensus.cc:2468] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 1.
I20260203 09:18:11.074776 31297 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8dbd55217e2546b5b3361ddf019f01d6" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.075471 31301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03943e5b830f4ab4be9fe0b4e0ca4697" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
W20260203 09:18:11.075953 31267 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.26.232.65:45511 timed out after 1.949s (SENT) [suppressed 1 similar messages]
I20260203 09:18:11.074867 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c2f90aaa7514d27a5a15b4fd6f90669" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
W20260203 09:18:11.078012 31191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:45019, user_credentials={real_user=slave}} blocked reactor thread for 45050us
I20260203 09:18:11.078835 31294 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9adae0a7f8a243ad9a35cb7a2047f472" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.080884 31373 raft_consensus.cc:2468] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 2.
I20260203 09:18:11.081516 31366 raft_consensus.cc:1240] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Rejecting Update request from peer d44c40c0ed244c4e962a26f9aebea76a for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:11.083083 31294 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4d4fa5c03a74205a7c5fdda5e37cfe4" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.083527 31911 raft_consensus.cc:493] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:11.084062 31911 raft_consensus.cc:515] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:11.085297 31496 tablet_bootstrap.cc:492] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 2bf9aa3533b14841a52177c8cc3130ec: Bootstrap starting.
I20260203 09:18:11.085863 31911 leader_election.cc:290] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:11.089039 31443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1d1f5b1c3b64ebaa2824e9136285fbe" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.090166 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9e063333ea146ed9efb0110b67e9520" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.090510 31217 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.090903 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14fd7c3d313847f591177ebba8df09c4" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.089039 31294 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92861fb258ec44228e1c191bee2fee0b" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.092316 31264 leader_election.cc:304] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:11.093190 31219 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70796ace22d548219e05b0c9a86346e7" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.093803 31219 raft_consensus.cc:2468] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 1.
I20260203 09:18:11.096400 31969 raft_consensus.cc:2804] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:11.096964 31969 raft_consensus.cc:697] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 2 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:11.097048 31294 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93cc0a94606149e18c8764e851f4b826" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.098284 31297 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "55ce9fa640064a68a12f7f2c60a74bfd" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.097851 31969 consensus_queue.cc:237] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:11.099718 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a68c16f0da84e9683a5121f63b3f22c" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.101210 31443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2ce342ceda546bbad30e8eff5485a48" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.088225 31954 raft_consensus.cc:515] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:11.106724 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.110375 31301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "afe2065ab01641aa86dc384050ab810a" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.111508 31295 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c43e17bc65f048a9a9fd229bb9c98bfb" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.118824 31217 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "563e8640cca54f9cab7822a8136fb583" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.119043 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "374ce202ecd540008cded117a37bfeba" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.119371 31224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee25c6a8d94e49a2a9a5646d493c1bde" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.119704 31223 raft_consensus.cc:2468] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 1.
I20260203 09:18:11.120150 31220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c2f90aaa7514d27a5a15b4fd6f90669" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.120553 31217 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4d4fa5c03a74205a7c5fdda5e37cfe4" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.120913 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92861fb258ec44228e1c191bee2fee0b" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.120077 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8dbd55217e2546b5b3361ddf019f01d6" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.122100 31444 raft_consensus.cc:2468] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:11.123520 31224 raft_consensus.cc:2393] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bf9aa3533b14841a52177c8cc3130ec in current term 1: Already voted for candidate d44c40c0ed244c4e962a26f9aebea76a in this term.
I20260203 09:18:11.124403 31219 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9adae0a7f8a243ad9a35cb7a2047f472" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.124925 31494 tablet_bootstrap.cc:492] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:11.125383 31494 ts_tablet_manager.cc:1403] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.639s user 0.012s sys 0.016s
I20260203 09:18:11.125548 31441 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20dfe4990e0a46ef9b0cf1cdf3dfdb09" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.126567 31224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "defda4c9fc6a4d0ba46ec287eb2f08d1" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.127918 31224 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14073202fe424a9b9a72f4c7e6075bdf" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.128528 31217 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9884e996f0443f2ae2ab5606633ce3c" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.128876 31221 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
W20260203 09:18:11.130800 31413 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:41289, user_credentials={real_user=slave}} blocked reactor thread for 330044us
I20260203 09:18:11.131543 31188 leader_election.cc:304] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:11.134999 31413 leader_election.cc:304] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters:
I20260203 09:18:11.106159 32003 raft_consensus.cc:493] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
W20260203 09:18:11.137120 31267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:45511, user_credentials={real_user=slave}} blocked reactor thread for 61213.3us
I20260203 09:18:11.129012 31216 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87ac8c99d77e47c2b1a373820b27c804" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.139161 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "730e665d69354cad93df20607e256d58" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.128062 31494 raft_consensus.cc:359] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:11.139497 31220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbf01f6b7a2f4b7db0978441f72e138d" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.136533 32006 raft_consensus.cc:2749] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.143647 31494 raft_consensus.cc:385] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:11.145594 31494 raft_consensus.cc:740] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:11.144215 32027 consensus_queue.cc:1059] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:18:11.146229 31188 leader_election.cc:304] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:11.146293 31494 consensus_queue.cc:260] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:11.149796 31188 leader_election.cc:304] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:11.144799 32003 raft_consensus.cc:515] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:11.152529 31295 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5ccddc8d332443c97a92e59957dfa69" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.155169 31494 ts_tablet_manager.cc:1434] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.030s user 0.007s sys 0.000s
I20260203 09:18:11.152594 31218 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f94dad823fea42d2976b19da7bc7b258" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.148571 32016 raft_consensus.cc:2804] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:18:11.157917 31218 raft_consensus.cc:2468] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 1.
I20260203 09:18:11.158316 32016 raft_consensus.cc:493] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:11.155783 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14fd7c3d313847f591177ebba8df09c4" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.158716 32016 raft_consensus.cc:3060] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:11.156661 31188 leader_election.cc:304] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:11.161092 31267 leader_election.cc:304] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:11.157553 31494 tablet_bootstrap.cc:492] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104: Bootstrap starting.
I20260203 09:18:11.153647 31970 raft_consensus.cc:2804] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:11.165114 31965 raft_consensus.cc:2804] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:11.165465 31970 raft_consensus.cc:697] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:11.165544 31965 raft_consensus.cc:493] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:11.165983 31965 raft_consensus.cc:3060] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:11.155270 32006 raft_consensus.cc:2749] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.166379 31267 leader_election.cc:304] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:11.142113 31954 leader_election.cc:290] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:11.153486 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c17aa1880254f13a38a3c550b0894af" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.166117 31952 raft_consensus.cc:2804] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:11.168032 31952 raft_consensus.cc:493] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:11.167577 31500 raft_consensus.cc:2749] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.168388 31952 raft_consensus.cc:3060] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:11.169282 31267 leader_election.cc:304] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:11.170681 31267 leader_election.cc:304] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:11.171375 31999 raft_consensus.cc:2804] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:11.171731 31999 raft_consensus.cc:493] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:11.172091 31999 raft_consensus.cc:3060] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:11.163483 31188 leader_election.cc:304] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:11.158082 31911 raft_consensus.cc:3055] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:11.175923 31118 catalog_manager.cc:5654] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67). New cstate: current_term: 1 leader_uuid: "73bf755165c4487c81c67b5ab44f7104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:11.166354 31970 consensus_queue.cc:237] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:11.178740 31954 raft_consensus.cc:2749] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.156715 31969 consensus_queue.cc:1048] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260203 09:18:11.177457 31911 raft_consensus.cc:740] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:11.183861 32003 leader_election.cc:290] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:11.186759 31369 raft_consensus.cc:1275] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Refusing update from remote peer 79b10fa125f242419f66b577440e66d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:11.192735 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c43e17bc65f048a9a9fd229bb9c98bfb" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.178046 31267 leader_election.cc:304] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:11.178314 31118 catalog_manager.cc:5654] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 1 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } }
I20260203 09:18:11.182965 31911 consensus_queue.cc:260] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:11.189342 31368 raft_consensus.cc:3060] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:11.199322 31496 tablet_bootstrap.cc:654] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 2bf9aa3533b14841a52177c8cc3130ec: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:11.208170 31267 leader_election.cc:304] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:11.209528 32017 raft_consensus.cc:2804] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:11.209913 32017 raft_consensus.cc:493] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:11.210273 32017 raft_consensus.cc:3060] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:11.210704 31267 leader_election.cc:304] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:11.189307 31999 raft_consensus.cc:515] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:11.193610 31222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e57c5a8761da4a818b634fda6687de01" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.202075 31969 raft_consensus.cc:2749] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:18:11.215845 31500 raft_consensus.cc:2804] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:11.220218 31500 raft_consensus.cc:493] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:11.220669 31500 raft_consensus.cc:3060] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:11.212034 31220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a68c16f0da84e9683a5121f63b3f22c" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.223285 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3abbec594ab143a1ade1030741cf9e7d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.223618 32029 consensus_queue.cc:1048] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260203 09:18:11.223974 31442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c17aa1880254f13a38a3c550b0894af" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.227473 31494 tablet_bootstrap.cc:654] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:11.218029 31443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c2f90aaa7514d27a5a15b4fd6f90669" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.203294 32003 consensus_queue.cc:1059] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260203 09:18:11.230298 31965 raft_consensus.cc:515] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:11.231312 32003 raft_consensus.cc:3055] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:11.231945 32003 raft_consensus.cc:740] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:11.220566 31216 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "afe2065ab01641aa86dc384050ab810a" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.218806 31911 raft_consensus.cc:3060] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:11.236985 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b062505fb476790c4f06d074d67aa" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.204372 32016 raft_consensus.cc:515] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:11.239449 32016 leader_election.cc:290] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:11.239815 32003 consensus_queue.cc:260] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:11.241039 32003 raft_consensus.cc:3060] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:11.239840 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3eab34196fcb483abc69a625b7ca6300" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.242282 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b92ba54a16143c08cfa7303819aa929" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.242828 31999 leader_election.cc:290] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:11.243330 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a68c16f0da84e9683a5121f63b3f22c" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.244201 31971 raft_consensus.cc:2749] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.245004 31450 raft_consensus.cc:2468] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:11.245780 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc8de34393ac472590f28a52d1bf55ff" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.246688 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "420f71f998fb4c24a607beff32960d0d" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.247714 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "55ce9fa640064a68a12f7f2c60a74bfd" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.249222 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9e9201a8d64c4b45982d775e4406a3fd" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.237651 31446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a8fd0dd8dc8d432b8e8bb19f4f3448cc" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.259040 31446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87ac8c99d77e47c2b1a373820b27c804" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.263221 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20dfe4990e0a46ef9b0cf1cdf3dfdb09" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:11.257824 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "707a391491654853bba7daefe8451eca" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.270892 31191 leader_election.cc:304] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:11.260432 31416 leader_election.cc:304] T f0a785c5c3bf4846b008f0bc6de21607 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:11.306438 31191 leader_election.cc:304] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters: 79b10fa125f242419f66b577440e66d0
W20260203 09:18:11.307667 31416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.66:45019, user_credentials={real_user=slave}} blocked reactor thread for 47314.6us
I20260203 09:18:11.308014 31191 leader_election.cc:304] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:11.244442 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f0a785c5c3bf4846b008f0bc6de21607" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.318813 31416 leader_election.cc:304] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:11.318992 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a8fd0dd8dc8d432b8e8bb19f4f3448cc" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.320302 31416 leader_election.cc:304] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:11.321624 31416 leader_election.cc:304] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:11.322580 31191 leader_election.cc:304] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:11.326560 31341 leader_election.cc:304] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
W20260203 09:18:11.325206 31267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:45511, user_credentials={real_user=slave}} blocked reactor thread for 62675.4us
W20260203 09:18:11.317445 32040 log.cc:927] Time spent T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0: Append to log took a long time: real 0.106s user 0.001s sys 0.000s
W20260203 09:18:11.368676 31264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:41289, user_credentials={real_user=slave}} blocked reactor thread for 62623.9us
I20260203 09:18:11.369800 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9e9201a8d64c4b45982d775e4406a3fd" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:11.376102 31950 raft_consensus.cc:2749] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.376945 32012 raft_consensus.cc:2804] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:11.377363 32012 raft_consensus.cc:493] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:11.377722 32012 raft_consensus.cc:3060] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:11.378144 31295 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbf01f6b7a2f4b7db0978441f72e138d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.379312 31295 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06460fafee594578bed03068236ad9f2" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.381543 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3abbec594ab143a1ade1030741cf9e7d" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.385396 31500 raft_consensus.cc:515] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:11.315690 32016 raft_consensus.cc:2749] T f0a785c5c3bf4846b008f0bc6de21607 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.380378 31295 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "420f71f998fb4c24a607beff32960d0d" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.380939 31301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20dfe4990e0a46ef9b0cf1cdf3dfdb09" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.231335 31952 raft_consensus.cc:515] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:11.324864 32004 raft_consensus.cc:2749] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.325861 31951 raft_consensus.cc:2749] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.424973 31293 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8301405e2ead406caa7440c0337df77d" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.428467 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d46f012a03d4d73afb2cffe5d847486" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.390918 31299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec42a05859cf4d5ebe1e1f268d01b3fc" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:11.377614 31443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "707a391491654853bba7daefe8451eca" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.321511 32027 raft_consensus.cc:2804] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:11.328428 31369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e57c5a8761da4a818b634fda6687de01" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:11.326005 32007 raft_consensus.cc:2749] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.327930 32019 raft_consensus.cc:2804] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:11.424960 31446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d46f012a03d4d73afb2cffe5d847486" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.330104 31222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d46f012a03d4d73afb2cffe5d847486" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.393944 31191 leader_election.cc:304] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
W20260203 09:18:11.491669 31191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:42099, user_credentials={real_user=slave}} blocked reactor thread for 97829.4us
I20260203 09:18:11.493291 31191 leader_election.cc:304] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:11.417052 31500 leader_election.cc:290] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:11.390316 31297 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9adae0a7f8a243ad9a35cb7a2047f472" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.425097 31292 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15d598c8a8514ff5af7a0e48897dffa7" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.425339 32028 raft_consensus.cc:493] T bd838f6bdcba4d728e975023e89894a5 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:18:11.393676 31341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:45511, user_credentials={real_user=slave}} blocked reactor thread for 67203.9us
W20260203 09:18:11.489439 31190 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:18:11.504580 32028 raft_consensus.cc:515] T bd838f6bdcba4d728e975023e89894a5 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:11.506062 31494 tablet_bootstrap.cc:492] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104: No bootstrap required, opened a new log
I20260203 09:18:11.506610 31447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.507506 31494 ts_tablet_manager.cc:1403] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104: Time spent bootstrapping tablet: real 0.349s user 0.015s sys 0.018s
I20260203 09:18:11.499819 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8301405e2ead406caa7440c0337df77d" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.500089 31341 leader_election.cc:304] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:11.507529 31447 raft_consensus.cc:2393] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73bf755165c4487c81c67b5ab44f7104 in current term 3: Already voted for candidate 2bf9aa3533b14841a52177c8cc3130ec in this term.
I20260203 09:18:11.511554 31341 leader_election.cc:304] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:11.479619 32027 raft_consensus.cc:493] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:11.485175 32019 raft_consensus.cc:493] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:11.498673 32008 raft_consensus.cc:2804] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:11.514452 31341 leader_election.cc:304] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:11.489944 31300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3eab34196fcb483abc69a625b7ca6300" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.499209 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9e9201a8d64c4b45982d775e4406a3fd" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.500875 31446 raft_consensus.cc:2468] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 1.
I20260203 09:18:11.536954 31494 raft_consensus.cc:359] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:11.548625 31494 raft_consensus.cc:385] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:11.549147 31494 raft_consensus.cc:740] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Initialized, Role: FOLLOWER
I20260203 09:18:11.551880 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c17aa1880254f13a38a3c550b0894af" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.512977 31191 leader_election.cc:304] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:11.499437 31911 raft_consensus.cc:2804] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260203 09:18:11.558432 31191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:42099, user_credentials={real_user=slave}} blocked reactor thread for 59957.3us
I20260203 09:18:11.559247 31191 leader_election.cc:304] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
W20260203 09:18:11.556586 31416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:45511, user_credentials={real_user=slave}} blocked reactor thread for 157820us
I20260203 09:18:11.549814 31494 consensus_queue.cc:260] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:11.560475 31191 leader_election.cc:304] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters: 79b10fa125f242419f66b577440e66d0
I20260203 09:18:11.560539 31416 leader_election.cc:304] T a9e063333ea146ed9efb0110b67e9520 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:11.563392 31416 leader_election.cc:304] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:11.567720 31416 leader_election.cc:304] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:11.568711 31416 leader_election.cc:304] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
W20260203 09:18:11.518378 31267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.68:42099, user_credentials={real_user=slave}} blocked reactor thread for 105786us
I20260203 09:18:11.570413 31416 leader_election.cc:304] T 92861fb258ec44228e1c191bee2fee0b P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:11.515144 31955 raft_consensus.cc:2749] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.538945 32011 raft_consensus.cc:2749] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.517450 32019 raft_consensus.cc:3060] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:11.514228 32027 raft_consensus.cc:3060] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:11.516402 32018 raft_consensus.cc:2749] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260203 09:18:11.539081 32028 leader_election.cc:290] T bd838f6bdcba4d728e975023e89894a5 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:11.517956 32008 raft_consensus.cc:493] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:11.505311 31219 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9ac7485f9224e0b9a9e95ce8b3c5654" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:11.645318 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20dfe4990e0a46ef9b0cf1cdf3dfdb09" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.572784 31970 raft_consensus.cc:2749] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 09:18:11.697172 31191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:42099, user_credentials={real_user=slave}} blocked reactor thread for 136774us
W20260203 09:18:11.699707 31416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:45511, user_credentials={real_user=slave}} blocked reactor thread for 127382us
I20260203 09:18:11.574033 31445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "55ce9fa640064a68a12f7f2c60a74bfd" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.724951 31447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c43e17bc65f048a9a9fd229bb9c98bfb" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
W20260203 09:18:11.725415 32049 log.cc:927] Time spent T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723: Append to log took a long time: real 0.068s user 0.000s sys 0.000s
I20260203 09:18:11.726327 31447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9adae0a7f8a243ad9a35cb7a2047f472" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.557857 31443 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b062505fb476790c4f06d074d67aa" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.727500 31447 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec42a05859cf4d5ebe1e1f268d01b3fc" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:11.720489 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03e1544e85d94310a17e919716a0e5b9" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.731681 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d9139b651d14e5082793499087ed2d4" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.733435 31446 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e57c5a8761da4a818b634fda6687de01" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.722086 31219 raft_consensus.cc:2376] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1. Re-sending same reply.
I20260203 09:18:11.738879 31447 raft_consensus.cc:1240] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Rejecting Update request from peer d44c40c0ed244c4e962a26f9aebea76a for earlier term 2. Current term is 3. Ops: []
I20260203 09:18:11.565440 31959 raft_consensus.cc:2749] T a9e063333ea146ed9efb0110b67e9520 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.558851 31911 raft_consensus.cc:493] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:11.741636 31911 raft_consensus.cc:3060] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:11.742764 31952 leader_election.cc:290] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:11.640246 32005 raft_consensus.cc:2804] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:11.744407 32005 raft_consensus.cc:493] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:11.744822 32005 raft_consensus.cc:3060] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:11.635196 32012 raft_consensus.cc:515] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:11.720049 31191 leader_election.cc:304] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:11.746644 32012 leader_election.cc:290] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:11.747830 31366 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b062505fb476790c4f06d074d67aa" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:11.749898 31970 raft_consensus.cc:2804] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:11.750329 31970 raft_consensus.cc:493] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:11.750677 31970 raft_consensus.cc:3060] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:11.570346 32006 raft_consensus.cc:2749] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.753099 32006 consensus_queue.cc:1059] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:18:11.755613 31191 leader_election.cc:304] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:11.756901 31191 leader_election.cc:304] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:11.569281 32022 consensus_queue.cc:1048] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.074s
I20260203 09:18:11.569530 31890 raft_consensus.cc:2804] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:11.572078 31951 raft_consensus.cc:2804] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:11.634085 31885 raft_consensus.cc:2749] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.719964 31416 leader_election.cc:304] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:11.715816 32016 raft_consensus.cc:2749] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260203 09:18:11.716125 31267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.68:42099, user_credentials={real_user=slave}} blocked reactor thread for 145168us
W20260203 09:18:11.767346 31416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:45511, user_credentials={real_user=slave}} blocked reactor thread for 47457.1us
I20260203 09:18:11.722080 31494 ts_tablet_manager.cc:1434] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104: Time spent starting tablet: real 0.214s user 0.014s sys 0.000s
I20260203 09:18:11.768178 31416 leader_election.cc:304] T 9adae0a7f8a243ad9a35cb7a2047f472 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:11.725136 31445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e57c5a8761da4a818b634fda6687de01" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.645493 32052 raft_consensus.cc:2749] T 92861fb258ec44228e1c191bee2fee0b P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 09:18:11.764748 31341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:45511, user_credentials={real_user=slave}} blocked reactor thread for 246100us
I20260203 09:18:11.719015 32008 raft_consensus.cc:3060] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:11.769982 31267 leader_election.cc:304] T c2ce342ceda546bbad30e8eff5485a48 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:11.761397 31964 raft_consensus.cc:3055] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Stepping down as leader of term 1
W20260203 09:18:11.770476 32003 consensus_meta.cc:287] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a: Time spent flushing consensus metadata: real 0.529s user 0.008s sys 0.002s
I20260203 09:18:11.763558 31890 raft_consensus.cc:493] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:11.763190 31952 raft_consensus.cc:2749] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.709118 32017 raft_consensus.cc:515] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:11.779393 31341 leader_election.cc:304] T 730e665d69354cad93df20607e256d58 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:11.766882 31951 raft_consensus.cc:493] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:11.776060 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9e9201a8d64c4b45982d775e4406a3fd" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.782941 31267 leader_election.cc:304] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:11.776670 31961 raft_consensus.cc:2749] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.812105 31341 leader_election.cc:304] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters: 79b10fa125f242419f66b577440e66d0
I20260203 09:18:11.783972 32029 raft_consensus.cc:2749] T c2ce342ceda546bbad30e8eff5485a48 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.786051 31890 raft_consensus.cc:3060] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:11.782474 31964 raft_consensus.cc:740] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:11.780592 32056 raft_consensus.cc:2749] T 9adae0a7f8a243ad9a35cb7a2047f472 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.787799 32011 raft_consensus.cc:2749] T 730e665d69354cad93df20607e256d58 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.810853 31219 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f617ef4ccf984446b1ab7084a92efe17" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.832019 31911 raft_consensus.cc:515] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:11.833280 31298 raft_consensus.cc:1240] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Rejecting Update request from peer 2bf9aa3533b14841a52177c8cc3130ec for earlier term 1. Current term is 2. Ops: []
W20260203 09:18:11.833614 31368 consensus_meta.cc:287] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104: Time spent flushing consensus metadata: real 0.625s user 0.004s sys 0.004s
I20260203 09:18:11.834295 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d9139b651d14e5082793499087ed2d4" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.878307 32053 raft_consensus.cc:2804] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:11.837391 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3eab34196fcb483abc69a625b7ca6300" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.839046 31366 raft_consensus.cc:3060] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104 [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:11.843195 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70796ace22d548219e05b0c9a86346e7" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:11.845294 32014 raft_consensus.cc:493] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:11.847473 31220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:11.848974 31416 leader_election.cc:304] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:11.849273 32019 raft_consensus.cc:515] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:11.850303 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06460fafee594578bed03068236ad9f2" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.851075 31222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3abbec594ab143a1ade1030741cf9e7d" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.855070 31442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc8de34393ac472590f28a52d1bf55ff" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:11.773766 32012 raft_consensus.cc:2749] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 09:18:11.872987 31267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:42099, user_credentials={real_user=slave}} blocked reactor thread for 90134.6us
I20260203 09:18:11.957763 31267 leader_election.cc:304] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
W20260203 09:18:11.875291 31341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:45511, user_credentials={real_user=slave}} blocked reactor thread for 63282.6us
I20260203 09:18:11.876348 31496 tablet_bootstrap.cc:492] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 2bf9aa3533b14841a52177c8cc3130ec: No bootstrap required, opened a new log
I20260203 09:18:11.778496 32005 raft_consensus.cc:515] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:11.833122 31300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd838f6bdcba4d728e975023e89894a5" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:11.960723 31990 raft_consensus.cc:493] T c2ce342ceda546bbad30e8eff5485a48 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:11.874686 31951 raft_consensus.cc:3060] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:11.865515 32017 leader_election.cc:290] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:11.961256 31990 raft_consensus.cc:515] T c2ce342ceda546bbad30e8eff5485a48 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:11.970009 31990 leader_election.cc:290] T c2ce342ceda546bbad30e8eff5485a48 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:11.970764 31890 raft_consensus.cc:515] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:11.925454 31964 consensus_queue.cc:260] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:11.930826 32008 raft_consensus.cc:515] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:11.865862 32027 raft_consensus.cc:515] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:11.955785 32014 raft_consensus.cc:515] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:11.937682 32011 raft_consensus.cc:493] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:11.928478 31970 raft_consensus.cc:515] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:11.939003 31965 leader_election.cc:290] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
W20260203 09:18:11.943849 31191 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.68:42099, user_credentials={real_user=slave}} blocked reactor thread for 53031.5us
I20260203 09:18:11.983700 31191 leader_election.cc:304] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:11.984423 32012 consensus_queue.cc:1059] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:11.817586 31441 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20dfe4990e0a46ef9b0cf1cdf3dfdb09" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:11.985543 32012 raft_consensus.cc:2749] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.985847 32003 raft_consensus.cc:3055] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:18:11.947942 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b062505fb476790c4f06d074d67aa" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:11.879465 31955 raft_consensus.cc:2804] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:11.986304 32014 leader_election.cc:290] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:11.986616 31955 raft_consensus.cc:493] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:11.987066 31955 raft_consensus.cc:3060] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:11.949018 31445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70796ace22d548219e05b0c9a86346e7" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:11.959570 31952 consensus_queue.cc:1048] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260203 09:18:11.986251 32003 raft_consensus.cc:740] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:11.990458 32003 consensus_queue.cc:260] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
W20260203 09:18:11.950917 31188 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:41289, user_credentials={real_user=slave}} blocked reactor thread for 54504.5us
W20260203 09:18:11.954530 31416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:45511, user_credentials={real_user=slave}} blocked reactor thread for 105619us
I20260203 09:18:11.958760 31496 ts_tablet_manager.cc:1403] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent bootstrapping tablet: real 0.874s user 0.072s sys 0.034s
I20260203 09:18:11.961623 31341 leader_election.cc:304] T dbf01f6b7a2f4b7db0978441f72e138d P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:11.961979 31267 leader_election.cc:304] T c43e17bc65f048a9a9fd229bb9c98bfb P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:11.924757 31292 raft_consensus.cc:1240] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Rejecting Update request from peer 2bf9aa3533b14841a52177c8cc3130ec for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:11.951704 32053 raft_consensus.cc:493] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:11.956169 31946 raft_consensus.cc:2749] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.936892 31216 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93cc0a94606149e18c8764e851f4b826" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:11.996161 31885 raft_consensus.cc:2749] T dbf01f6b7a2f4b7db0978441f72e138d P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.971365 32026 raft_consensus.cc:2749] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.996562 31965 raft_consensus.cc:2749] T c43e17bc65f048a9a9fd229bb9c98bfb P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:11.981734 32011 raft_consensus.cc:515] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:11.996343 32053 raft_consensus.cc:3060] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:11.961272 31911 leader_election.cc:290] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:11.982192 32019 leader_election.cc:290] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:11.999989 32005 leader_election.cc:290] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:12.002502 31496 raft_consensus.cc:359] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:12.003783 31964 raft_consensus.cc:3060] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:12.004583 31341 leader_election.cc:304] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.005482 31990 raft_consensus.cc:2749] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.006319 32011 leader_election.cc:290] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:11.994160 32008 leader_election.cc:290] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:12.009148 32027 leader_election.cc:290] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:12.003288 31416 leader_election.cc:304] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.011287 31445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a5ca73a494b4d7389eec90025653337" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:12.011530 31990 raft_consensus.cc:493] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:12.012072 31990 raft_consensus.cc:515] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:12.012717 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2ce342ceda546bbad30e8eff5485a48" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:12.013157 31448 raft_consensus.cc:1240] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Rejecting Update request from peer 73bf755165c4487c81c67b5ab44f7104 for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:12.013975 31990 leader_election.cc:290] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:11.984884 31191 leader_election.cc:304] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:12.011143 31946 raft_consensus.cc:2749] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.015156 31496 raft_consensus.cc:385] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:12.015564 31496 raft_consensus.cc:740] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Initialized, Role: FOLLOWER
I20260203 09:18:12.016131 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03e1544e85d94310a17e919716a0e5b9" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:12.009963 31369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f617ef4ccf984446b1ab7084a92efe17" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
W20260203 09:18:12.016127 31267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:42099, user_credentials={real_user=slave}} blocked reactor thread for 54227.1us
I20260203 09:18:12.016970 32008 raft_consensus.cc:2749] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.016415 31496 consensus_queue.cc:260] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:12.017493 31267 leader_election.cc:304] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.002972 31970 leader_election.cc:290] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:12.018472 31965 raft_consensus.cc:2749] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.019013 32003 raft_consensus.cc:3060] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:12.022519 31496 ts_tablet_manager.cc:1434] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 2bf9aa3533b14841a52177c8cc3130ec: Time spent starting tablet: real 0.030s user 0.007s sys 0.001s
I20260203 09:18:12.015800 31191 leader_election.cc:304] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:12.027493 31369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "374ce202ecd540008cded117a37bfeba" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:12.028090 31191 leader_election.cc:304] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:12.029668 31970 raft_consensus.cc:2749] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.030352 31970 raft_consensus.cc:2749] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.018582 31267 leader_election.cc:304] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.031940 32014 raft_consensus.cc:2749] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.032387 31267 leader_election.cc:304] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.033179 32014 raft_consensus.cc:2749] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.033890 31441 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03e1544e85d94310a17e919716a0e5b9" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:12.034461 31448 raft_consensus.cc:1240] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Rejecting Update request from peer d44c40c0ed244c4e962a26f9aebea76a for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:12.034663 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "374ce202ecd540008cded117a37bfeba" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:12.035149 31442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8301405e2ead406caa7440c0337df77d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:12.037544 31442 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06460fafee594578bed03068236ad9f2" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:12.038296 31218 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14fd7c3d313847f591177ebba8df09c4" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:12.038466 31267 leader_election.cc:304] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.039649 31267 leader_election.cc:304] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:12.040189 31191 leader_election.cc:304] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:12.042399 31341 leader_election.cc:304] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.041158 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f617ef4ccf984446b1ab7084a92efe17" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:12.043650 31341 leader_election.cc:304] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.040778 31267 leader_election.cc:304] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:12.040517 31220 raft_consensus.cc:1240] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Rejecting Update request from peer 73bf755165c4487c81c67b5ab44f7104 for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:12.045462 31965 raft_consensus.cc:2804] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:12.016582 31890 leader_election.cc:290] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:12.045979 31955 raft_consensus.cc:515] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:12.046376 31216 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a5ca73a494b4d7389eec90025653337" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:12.045933 31965 raft_consensus.cc:493] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:12.052006 31965 raft_consensus.cc:3060] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:12.051687 31951 raft_consensus.cc:515] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:12.052801 31449 raft_consensus.cc:1240] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Rejecting Update request from peer 73bf755165c4487c81c67b5ab44f7104 for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:12.054364 31950 raft_consensus.cc:2749] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.055160 31950 consensus_queue.cc:1059] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:12.056506 32057 raft_consensus.cc:3055] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:12.047561 32014 raft_consensus.cc:2749] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.056879 32057 raft_consensus.cc:740] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:12.040861 32011 consensus_queue.cc:1048] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260203 09:18:12.057633 32057 consensus_queue.cc:260] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:12.058585 32057 raft_consensus.cc:3060] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:12.048071 32022 raft_consensus.cc:2749] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.061374 31965 raft_consensus.cc:515] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:12.062976 31416 leader_election.cc:304] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.063459 31965 leader_election.cc:290] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:12.065397 31955 leader_election.cc:290] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:12.065953 32011 raft_consensus.cc:2749] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.047210 32053 raft_consensus.cc:515] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:12.065510 31341 leader_election.cc:304] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:12.066913 31216 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70796ace22d548219e05b0c9a86346e7" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:12.068536 31220 raft_consensus.cc:1240] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Rejecting Update request from peer 2bf9aa3533b14841a52177c8cc3130ec for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:12.070314 31341 leader_election.cc:304] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:12.071095 32055 raft_consensus.cc:2749] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.071735 32055 raft_consensus.cc:2749] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.055267 31191 leader_election.cc:304] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:12.073091 32003 raft_consensus.cc:2749] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.073169 31341 leader_election.cc:304] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.073973 32055 raft_consensus.cc:2749] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.074599 32014 raft_consensus.cc:2749] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.075099 31341 leader_election.cc:304] T f0a785c5c3bf4846b008f0bc6de21607 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:12.075834 32055 raft_consensus.cc:2749] T f0a785c5c3bf4846b008f0bc6de21607 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.077025 31341 leader_election.cc:304] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:12.078675 32019 consensus_queue.cc:1059] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:12.079697 32019 raft_consensus.cc:2749] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.080260 32019 raft_consensus.cc:3055] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:12.080404 32053 leader_election.cc:290] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:12.080710 32019 raft_consensus.cc:740] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:12.081671 32011 raft_consensus.cc:2749] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.081534 32019 consensus_queue.cc:260] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:12.082679 32019 raft_consensus.cc:3060] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:12.082962 31341 leader_election.cc:304] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.084061 31292 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14fd7c3d313847f591177ebba8df09c4" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:12.084246 31955 raft_consensus.cc:3060] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:12.086355 31416 leader_election.cc:304] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.088558 31298 raft_consensus.cc:1240] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Rejecting Update request from peer 73bf755165c4487c81c67b5ab44f7104 for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:12.089035 31292 raft_consensus.cc:1240] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Rejecting Update request from peer 73bf755165c4487c81c67b5ab44f7104 for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:12.089787 31300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2ce342ceda546bbad30e8eff5485a48" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
W20260203 09:18:12.091073 31267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:42099, user_credentials={real_user=slave}} blocked reactor thread for 50372.2us
I20260203 09:18:12.084095 31341 leader_election.cc:304] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.094379 31267 leader_election.cc:304] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:12.096293 32011 raft_consensus.cc:2804] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:12.097573 32011 raft_consensus.cc:493] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:12.097970 32011 raft_consensus.cc:3060] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:12.098713 31965 raft_consensus.cc:2749] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.100209 31951 leader_election.cc:290] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:12.098196 31267 leader_election.cc:304] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:12.087108 31890 raft_consensus.cc:2749] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.074278 31191 leader_election.cc:304] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:12.106482 31965 raft_consensus.cc:2749] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.106670 32066 raft_consensus.cc:2749] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.110131 31341 leader_election.cc:304] T 9e9201a8d64c4b45982d775e4406a3fd P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.116242 31341 leader_election.cc:304] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:12.119629 31267 leader_election.cc:304] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.124682 31267 leader_election.cc:304] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:12.137714 31341 leader_election.cc:304] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:12.138082 31416 leader_election.cc:304] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.138792 32016 raft_consensus.cc:2749] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.140022 31951 consensus_queue.cc:1059] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:12.140955 32017 raft_consensus.cc:2804] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:12.144315 31191 leader_election.cc:304] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:12.141482 32017 raft_consensus.cc:697] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:12.145821 31191 leader_election.cc:304] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:12.141922 32018 raft_consensus.cc:2749] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.150817 31222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "653756c5b80f438b91b3d00ce86f52bb" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:12.120975 32055 raft_consensus.cc:2749] T 9e9201a8d64c4b45982d775e4406a3fd P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.137502 32029 raft_consensus.cc:2749] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.151640 32066 raft_consensus.cc:2749] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.157931 31191 leader_election.cc:304] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:12.162803 31873 raft_consensus.cc:493] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:12.163343 31873 raft_consensus.cc:515] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:12.159678 32062 raft_consensus.cc:2749] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.151736 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "374ce202ecd540008cded117a37bfeba" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:12.165155 31216 raft_consensus.cc:1240] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Rejecting Update request from peer 79b10fa125f242419f66b577440e66d0 for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:12.161906 32007 raft_consensus.cc:493] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:12.167279 32007 raft_consensus.cc:515] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:12.169173 32007 leader_election.cc:290] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:12.150892 32022 raft_consensus.cc:2749] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.121076 32052 consensus_queue.cc:1059] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260203 09:18:12.177858 32011 raft_consensus.cc:515] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:12.178771 31964 raft_consensus.cc:2749] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.178835 32062 consensus_queue.cc:1048] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260203 09:18:12.183205 31222 raft_consensus.cc:1240] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Rejecting Update request from peer 79b10fa125f242419f66b577440e66d0 for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:12.172528 31955 raft_consensus.cc:2749] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:18:12.184166 31216 raft_consensus.cc:1275] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Refusing update from remote peer 79b10fa125f242419f66b577440e66d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:12.178020 32052 raft_consensus.cc:3055] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:12.184775 32052 raft_consensus.cc:740] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:12.185698 31218 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9ac7485f9224e0b9a9e95ce8b3c5654" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:12.185577 32052 consensus_queue.cc:260] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:12.186494 31218 raft_consensus.cc:2393] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bf9aa3533b14841a52177c8cc3130ec in current term 1: Already voted for candidate 79b10fa125f242419f66b577440e66d0 in this term.
I20260203 09:18:12.186735 32052 raft_consensus.cc:3060] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:12.187047 32017 consensus_queue.cc:237] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:12.189204 31873 leader_election.cc:290] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
W20260203 09:18:12.203931 31171 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:18:12.213275 31223 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3abbec594ab143a1ade1030741cf9e7d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:12.213775 31220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1d1f5b1c3b64ebaa2824e9136285fbe" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
W20260203 09:18:12.216861 31341 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.68:42099, user_credentials={real_user=slave}} blocked reactor thread for 79221.1us
I20260203 09:18:12.217742 31341 leader_election.cc:304] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.206349 31885 raft_consensus.cc:493] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:12.207224 31300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9ac7485f9224e0b9a9e95ce8b3c5654" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:12.228444 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3abbec594ab143a1ade1030741cf9e7d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:12.211895 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f6fed7d1dca4d4184fd89b136a55ec1" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:12.212540 31445 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1d1f5b1c3b64ebaa2824e9136285fbe" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:12.233484 31295 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06460fafee594578bed03068236ad9f2" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:12.233657 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8dbd55217e2546b5b3361ddf019f01d6" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:12.236166 31218 raft_consensus.cc:1240] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Rejecting Update request from peer 79b10fa125f242419f66b577440e66d0 for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:12.216740 31368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57836 (request call id 157) took 1038 ms. Trace:
I20260203 09:18:12.240829 31416 leader_election.cc:304] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.240988 31341 leader_election.cc:304] T e57c5a8761da4a818b634fda6687de01 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.247134 31341 leader_election.cc:304] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:12.241616 31955 raft_consensus.cc:2749] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.248258 32055 raft_consensus.cc:2749] T e57c5a8761da4a818b634fda6687de01 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.250465 31951 raft_consensus.cc:3060] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 2bf9aa3533b14841a52177c8cc3130ec [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:12.266045 31341 leader_election.cc:304] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:12.261056 32011 leader_election.cc:290] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:12.270916 32075 raft_consensus.cc:2749] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.232916 31885 raft_consensus.cc:515] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:12.286691 32011 raft_consensus.cc:2749] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.295855 31267 leader_election.cc:304] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.299427 31267 leader_election.cc:304] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.295033 31216 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9884e996f0443f2ae2ab5606633ce3c" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:12.299283 31972 raft_consensus.cc:2749] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.288954 31979 consensus_queue.cc:1059] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260203 09:18:12.305088 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee25c6a8d94e49a2a9a5646d493c1bde" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:12.295588 32026 consensus_queue.cc:1048] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260203 09:18:12.294728 32029 consensus_queue.cc:1059] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260203 09:18:12.301904 31366 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a68c16f0da84e9683a5121f63b3f22c" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:12.291050 32075 consensus_queue.cc:1059] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260203 09:18:12.291991 32055 consensus_queue.cc:1059] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260203 09:18:12.313491 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03e1544e85d94310a17e919716a0e5b9" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:12.310284 31972 consensus_queue.cc:1059] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260203 09:18:12.312345 31367 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15d598c8a8514ff5af7a0e48897dffa7" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:12.315680 32029 raft_consensus.cc:3055] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:12.324499 32029 raft_consensus.cc:740] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:12.325320 32029 consensus_queue.cc:260] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:12.326514 32029 raft_consensus.cc:3060] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:12.308059 32054 raft_consensus.cc:2749] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.317903 31191 leader_election.cc:304] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:12.329228 32064 raft_consensus.cc:2749] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.320591 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "420f71f998fb4c24a607beff32960d0d" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:12.321048 31965 raft_consensus.cc:3055] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:12.330425 31965 raft_consensus.cc:740] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:12.331230 31965 consensus_queue.cc:260] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:12.322057 31367 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f617ef4ccf984446b1ab7084a92efe17" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:12.322273 31292 raft_consensus.cc:1240] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Rejecting Update request from peer d44c40c0ed244c4e962a26f9aebea76a for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:12.321091 31225 raft_consensus.cc:1275] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Refusing update from remote peer 79b10fa125f242419f66b577440e66d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:12.310551 31372 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d9139b651d14e5082793499087ed2d4" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:12.245707 31368 rpcz_store.cc:276] 0203 09:18:11.174248 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:18:11.178112 (+ 3864us) service_pool.cc:225] Handling call
0203 09:18:11.189072 (+ 10960us) raft_consensus.cc:1471] Updating replica for 1 ops
0203 09:18:11.949270 (+760198us) raft_consensus.cc:1534] Early marking committed up to index 0
0203 09:18:11.949304 (+ 34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0203 09:18:11.949788 (+ 484us) log.cc:844] Serialized 26 byte log entry
0203 09:18:12.096957 (+147169us) raft_consensus.cc:1645] Marking committed up to 1
0203 09:18:12.162423 (+ 65466us) log.cc:844] Serialized 14 byte log entry
0203 09:18:12.162661 (+ 238us) raft_consensus.cc:1697] Filling consensus response to leader.
0203 09:18:12.180775 (+ 18114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0203 09:18:12.193736 (+ 12961us) raft_consensus.cc:1685] finished
0203 09:18:12.204638 (+ 10902us) raft_consensus.cc:1691] UpdateReplicas() finished
0203 09:18:12.209526 (+ 4888us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":46097,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":4754,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":9982,"spinlock_wait_cycles":32256,"thread_start_us":195910,"threads_started":2,"wal-append.queue_time_us":147170}
W20260203 09:18:12.319741 31415 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:18:12.324102 31961 raft_consensus.cc:3055] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:12.336949 31961 raft_consensus.cc:740] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:12.318570 31370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c17aa1880254f13a38a3c550b0894af" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:12.337253 31999 raft_consensus.cc:3055] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:12.338708 31999 raft_consensus.cc:740] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:12.338863 32017 consensus_queue.cc:1048] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:12.339469 31999 consensus_queue.cc:260] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:12.332496 31965 raft_consensus.cc:3060] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:12.340770 31999 raft_consensus.cc:3060] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:12.341163 31961 consensus_queue.cc:260] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:12.342217 31961 raft_consensus.cc:3060] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:12.337855 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:12.347934 31950 consensus_queue.cc:1059] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:12.349185 32064 raft_consensus.cc:3055] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:12.349323 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03943e5b830f4ab4be9fe0b4e0ca4697" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:12.349592 32064 raft_consensus.cc:740] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:12.350389 32064 consensus_queue.cc:260] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:12.352684 31371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d46f012a03d4d73afb2cffe5d847486" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:12.352572 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "374ce202ecd540008cded117a37bfeba" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:12.353291 31951 raft_consensus.cc:2749] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:12.353011 32064 raft_consensus.cc:3060] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:12.354048 32018 raft_consensus.cc:3055] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:12.354447 32018 raft_consensus.cc:740] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:12.355170 32018 consensus_queue.cc:260] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:12.356313 32018 raft_consensus.cc:3060] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:12.364303 31369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "563e8640cca54f9cab7822a8136fb583" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:12.368131 31118 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60908 (request call id 70) took 1209 ms. Trace:
I20260203 09:18:12.371588 32022 raft_consensus.cc:3055] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:12.372018 32022 raft_consensus.cc:740] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:12.372366 31369 raft_consensus.cc:1240] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Rejecting Update request from peer d44c40c0ed244c4e962a26f9aebea76a for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:12.372782 32022 consensus_queue.cc:260] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:12.373991 32022 raft_consensus.cc:3060] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:12.374477 32066 consensus_queue.cc:1059] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:12.375460 32066 raft_consensus.cc:3055] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:12.375864 32066 raft_consensus.cc:740] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:12.376675 32066 consensus_queue.cc:260] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:12.379776 31885 leader_election.cc:290] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:12.380633 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8301405e2ead406caa7440c0337df77d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:12.377938 32066 raft_consensus.cc:3060] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:12.386166 31371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd838f6bdcba4d728e975023e89894a5" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:12.368551 31118 rpcz_store.cc:276] 0203 09:18:11.159129 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:18:11.159289 (+ 160us) service_pool.cc:225] Handling call
0203 09:18:12.368070 (+1208781us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0203 09:18:11.299176 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0203 09:18:11.299829 (+ 653us) write_op.cc:432] Acquiring schema lock in shared mode
0203 09:18:11.299871 (+ 42us) write_op.cc:435] Acquired schema lock
0203 09:18:11.299899 (+ 28us) tablet.cc:660] Decoding operations
0203 09:18:11.300354 (+ 455us) write_op.cc:620] Acquiring the partition lock for write op
0203 09:18:11.300431 (+ 77us) write_op.cc:641] Partition lock acquired for write op
0203 09:18:11.300455 (+ 24us) tablet.cc:683] Acquiring locks for 2 operations
0203 09:18:11.300833 (+ 378us) tablet.cc:699] Row locks acquired
0203 09:18:11.300853 (+ 20us) write_op.cc:260] PREPARE: finished
0203 09:18:11.301026 (+ 173us) write_op.cc:270] Start()
0203 09:18:11.301153 (+ 127us) write_op.cc:276] Timestamp: P: 1770110291300973 usec, L: 0
0203 09:18:11.301174 (+ 21us) op_driver.cc:348] REPLICATION: starting
0203 09:18:11.326886 (+ 25712us) log.cc:844] Serialized 928 byte log entry
0203 09:18:11.941191 (+614305us) op_driver.cc:464] REPLICATION: finished
0203 09:18:12.234962 (+293771us) write_op.cc:301] APPLY: starting
0203 09:18:12.235059 (+ 97us) tablet.cc:1365] starting BulkCheckPresence
0203 09:18:12.235165 (+ 106us) tablet.cc:1368] finished BulkCheckPresence
0203 09:18:12.235283 (+ 118us) tablet.cc:1370] starting ApplyRowOperation cycle
0203 09:18:12.235651 (+ 368us) tablet.cc:1381] finished ApplyRowOperation cycle
0203 09:18:12.235806 (+ 155us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0203 09:18:12.235847 (+ 41us) write_op.cc:312] APPLY: finished
0203 09:18:12.236028 (+ 181us) log.cc:844] Serialized 28 byte log entry
0203 09:18:12.236219 (+ 191us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:18:12.236305 (+ 86us) write_op.cc:454] Released schema lock
0203 09:18:12.236345 (+ 40us) write_op.cc:341] FINISH: Updating metrics
0203 09:18:12.236692 (+ 347us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:18:12.236719 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":276989,"apply.run_cpu_time_us":1734,"apply.run_wall_time_us":6920,"num_ops":2,"prepare.queue_time_us":96109,"prepare.run_cpu_time_us":12227,"prepare.run_wall_time_us":115550,"raft.queue_time_us":214359,"raft.run_cpu_time_us":30882,"raft.run_wall_time_us":174510,"replication_time_us":639861,"thread_start_us":398188,"threads_started":4,"wal-append.queue_time_us":236486}]]}
I20260203 09:18:12.400564 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70796ace22d548219e05b0c9a86346e7" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:12.400430 31121 catalog_manager.cc:5654] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 0 to 1, leader changed from <none> to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 1 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:12.402223 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "374ce202ecd540008cded117a37bfeba" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:12.405058 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "653756c5b80f438b91b3d00ce86f52bb" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:12.411706 31375 raft_consensus.cc:2468] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 2.
I20260203 09:18:12.414870 31296 raft_consensus.cc:2468] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 2.
I20260203 09:18:12.415266 31373 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f6fed7d1dca4d4184fd89b136a55ec1" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:12.452847 31374 raft_consensus.cc:2468] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 2.
I20260203 09:18:12.456830 31373 raft_consensus.cc:1275] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Refusing update from remote peer 79b10fa125f242419f66b577440e66d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:12.457980 31371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8dbd55217e2546b5b3361ddf019f01d6" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:12.459035 31369 raft_consensus.cc:1240] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Rejecting Update request from peer 79b10fa125f242419f66b577440e66d0 for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:12.460709 31367 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9884e996f0443f2ae2ab5606633ce3c" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:12.463798 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b0e416075b74212b54e341eba13fd78" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:12.466261 31292 raft_consensus.cc:1240] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Rejecting Update request from peer 73bf755165c4487c81c67b5ab44f7104 for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:12.467478 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f94dad823fea42d2976b19da7bc7b258" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:12.471421 31292 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15d598c8a8514ff5af7a0e48897dffa7" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:12.474133 31191 leader_election.cc:304] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:12.475564 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15d598c8a8514ff5af7a0e48897dffa7" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:12.475893 31413 leader_election.cc:304] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.476868 31951 raft_consensus.cc:2749] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:12.477432 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d46f012a03d4d73afb2cffe5d847486" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:12.474932 32064 raft_consensus.cc:2804] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:12.478466 32064 raft_consensus.cc:697] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 2 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:12.479403 32064 consensus_queue.cc:237] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:12.482684 31413 leader_election.cc:304] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.483552 31951 raft_consensus.cc:2749] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.483927 31123 catalog_manager.cc:5654] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 1 to 2, leader changed from d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65) to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 2 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:12.485210 31413 leader_election.cc:304] T 15d598c8a8514ff5af7a0e48897dffa7 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:12.486279 31951 raft_consensus.cc:2749] T 15d598c8a8514ff5af7a0e48897dffa7 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.487030 31216 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b0e416075b74212b54e341eba13fd78" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:12.487918 31219 raft_consensus.cc:1240] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Rejecting Update request from peer 73bf755165c4487c81c67b5ab44f7104 for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:12.488253 31222 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f94dad823fea42d2976b19da7bc7b258" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:12.485518 31123 catalog_manager.cc:5654] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 1 to 2, leader changed from d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65) to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 2 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:12.489233 31218 raft_consensus.cc:1240] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Rejecting Update request from peer 73bf755165c4487c81c67b5ab44f7104 for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:12.489856 31220 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d46f012a03d4d73afb2cffe5d847486" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:12.490180 31216 raft_consensus.cc:1240] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Rejecting Update request from peer 73bf755165c4487c81c67b5ab44f7104 for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:12.493628 31264 leader_election.cc:304] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.497211 31413 leader_election.cc:304] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.498034 31951 raft_consensus.cc:2749] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.498757 31413 leader_election.cc:304] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:12.499970 31413 leader_election.cc:304] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.500349 31951 raft_consensus.cc:2749] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.500896 31216 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "563e8640cca54f9cab7822a8136fb583" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:12.501148 31220 raft_consensus.cc:2468] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 2.
I20260203 09:18:12.500159 32053 raft_consensus.cc:2749] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.508846 31961 raft_consensus.cc:2749] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.511780 31413 leader_election.cc:304] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:12.517268 32052 raft_consensus.cc:2749] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.518422 31413 leader_election.cc:304] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.527794 32052 raft_consensus.cc:2749] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.534874 31413 leader_election.cc:304] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.535722 32052 raft_consensus.cc:2749] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260203 09:18:12.536847 31413 leader_election.cc:304] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:12.536983 31264 leader_election.cc:304] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.537774 32053 raft_consensus.cc:2749] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260203 09:18:12.538506 31338 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260203 09:18:12.538442 32029 consensus_queue.cc:1048] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:18:12.539281 32052 raft_consensus.cc:2749] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.540869 31413 leader_election.cc:304] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.541318 31264 leader_election.cc:304] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:12.541584 32052 raft_consensus.cc:2749] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.542071 32053 raft_consensus.cc:2749] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.542651 32029 consensus_queue.cc:1059] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:12.543155 31413 leader_election.cc:304] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.542771 31264 leader_election.cc:304] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.543671 32029 raft_consensus.cc:3055] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:12.543845 32052 raft_consensus.cc:2749] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.544009 31999 raft_consensus.cc:2749] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.544445 32029 raft_consensus.cc:740] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:12.545279 32029 consensus_queue.cc:260] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:12.547703 32029 raft_consensus.cc:3060] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:12.551751 31123 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60896 (request call id 69) took 1337 ms. Trace:
I20260203 09:18:12.552215 31123 rpcz_store.cc:276] 0203 09:18:11.220788 (+ 0us) service_pool.cc:168] Inserting onto call queue
0203 09:18:11.222055 (+ 1267us) service_pool.cc:225] Handling call
0203 09:18:12.551692 (+1329637us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0203 09:18:12.502902 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0203 09:18:12.503487 (+ 585us) write_op.cc:432] Acquiring schema lock in shared mode
0203 09:18:12.503519 (+ 32us) write_op.cc:435] Acquired schema lock
0203 09:18:12.503531 (+ 12us) tablet.cc:660] Decoding operations
0203 09:18:12.503920 (+ 389us) write_op.cc:620] Acquiring the partition lock for write op
0203 09:18:12.503969 (+ 49us) write_op.cc:641] Partition lock acquired for write op
0203 09:18:12.503999 (+ 30us) tablet.cc:683] Acquiring locks for 2 operations
0203 09:18:12.504335 (+ 336us) tablet.cc:699] Row locks acquired
0203 09:18:12.504348 (+ 13us) write_op.cc:260] PREPARE: finished
0203 09:18:12.504492 (+ 144us) write_op.cc:270] Start()
0203 09:18:12.504619 (+ 127us) write_op.cc:276] Timestamp: P: 1770110292504443 usec, L: 0
0203 09:18:12.504637 (+ 18us) op_driver.cc:348] REPLICATION: starting
0203 09:18:12.505293 (+ 656us) log.cc:844] Serialized 928 byte log entry
0203 09:18:12.519222 (+ 13929us) op_driver.cc:464] REPLICATION: finished
0203 09:18:12.521591 (+ 2369us) write_op.cc:301] APPLY: starting
0203 09:18:12.521668 (+ 77us) tablet.cc:1365] starting BulkCheckPresence
0203 09:18:12.521792 (+ 124us) tablet.cc:1368] finished BulkCheckPresence
0203 09:18:12.521899 (+ 107us) tablet.cc:1370] starting ApplyRowOperation cycle
0203 09:18:12.522229 (+ 330us) tablet.cc:1381] finished ApplyRowOperation cycle
0203 09:18:12.522381 (+ 152us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0203 09:18:12.522425 (+ 44us) write_op.cc:312] APPLY: finished
0203 09:18:12.522617 (+ 192us) log.cc:844] Serialized 28 byte log entry
0203 09:18:12.522780 (+ 163us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:18:12.522872 (+ 92us) write_op.cc:454] Released schema lock
0203 09:18:12.522912 (+ 40us) write_op.cc:341] FINISH: Updating metrics
0203 09:18:12.527144 (+ 4232us) write_op.cc:489] Releasing partition, row and schema locks
0203 09:18:12.527185 (+ 41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23187,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":2176,"apply.run_cpu_time_us":1623,"apply.run_wall_time_us":1623,"num_ops":2,"prepare.queue_time_us":7919,"prepare.run_cpu_time_us":2619,"prepare.run_wall_time_us":24218,"replication_time_us":14407}]]}
I20260203 09:18:12.562157 31121 catalog_manager.cc:5654] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 1 to 2, leader changed from 79b10fa125f242419f66b577440e66d0 (127.26.232.66) to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 2 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:12.553997 31413 leader_election.cc:304] T bd838f6bdcba4d728e975023e89894a5 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:12.569932 31951 raft_consensus.cc:2749] T bd838f6bdcba4d728e975023e89894a5 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.571240 31413 leader_election.cc:304] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.572121 32052 raft_consensus.cc:2804] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:12.572602 32052 raft_consensus.cc:697] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:12.573424 32052 consensus_queue.cc:237] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:12.574982 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "563e8640cca54f9cab7822a8136fb583" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:12.558101 31341 leader_election.cc:304] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.584713 32022 raft_consensus.cc:2749] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.590624 32022 consensus_queue.cc:1059] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:12.591763 32018 raft_consensus.cc:3055] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:12.592111 32018 raft_consensus.cc:740] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:12.592908 32018 consensus_queue.cc:260] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:12.588691 31123 catalog_manager.cc:5654] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 1 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:12.597282 32018 raft_consensus.cc:3060] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:12.606371 31341 leader_election.cc:304] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.611274 32022 raft_consensus.cc:2749] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.623533 31885 consensus_queue.cc:1059] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:12.624907 31885 raft_consensus.cc:3055] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:12.625245 31885 raft_consensus.cc:740] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:12.628795 31885 consensus_queue.cc:260] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:12.630064 31885 raft_consensus.cc:3060] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:12.639357 31341 leader_election.cc:304] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:12.640224 31961 raft_consensus.cc:493] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:12.642861 32022 raft_consensus.cc:2804] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:12.643465 32022 raft_consensus.cc:697] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Becoming Leader. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:12.644374 32022 consensus_queue.cc:237] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:12.647768 31341 leader_election.cc:304] T c2ce342ceda546bbad30e8eff5485a48 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:12.649104 31341 leader_election.cc:304] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.650018 32055 raft_consensus.cc:2749] T c2ce342ceda546bbad30e8eff5485a48 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.648432 32075 consensus_queue.cc:1059] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260203 09:18:12.650543 31873 raft_consensus.cc:2749] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.642899 31961 raft_consensus.cc:515] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:12.658492 31123 catalog_manager.cc:5654] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 1 to 2, leader changed from 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67) to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 2 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:12.649571 32011 consensus_queue.cc:1059] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260203 09:18:12.675087 31341 leader_election.cc:304] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.665797 32055 consensus_queue.cc:1059] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.011s
I20260203 09:18:12.679312 31413 leader_election.cc:304] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.680866 32007 raft_consensus.cc:2804] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:12.681320 32018 raft_consensus.cc:3055] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:12.681726 32018 raft_consensus.cc:740] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:12.679004 32011 raft_consensus.cc:2749] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.682446 32011 raft_consensus.cc:3055] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:12.682808 32011 raft_consensus.cc:740] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:12.682543 32018 consensus_queue.cc:260] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:12.683564 32011 consensus_queue.cc:260] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:12.681331 32007 raft_consensus.cc:697] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:12.685340 32007 consensus_queue.cc:237] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:12.686831 31961 leader_election.cc:290] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:12.689204 31225 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec42a05859cf4d5ebe1e1f268d01b3fc" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a" is_pre_election: true
I20260203 09:18:12.683947 32018 raft_consensus.cc:3060] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:12.690049 31225 raft_consensus.cc:2393] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bf9aa3533b14841a52177c8cc3130ec in current term 2: Already voted for candidate d44c40c0ed244c4e962a26f9aebea76a in this term.
I20260203 09:18:12.691187 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec42a05859cf4d5ebe1e1f268d01b3fc" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:12.691847 31298 raft_consensus.cc:2468] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 2.
I20260203 09:18:12.693289 31416 leader_election.cc:304] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.697438 31341 leader_election.cc:304] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:12.696892 32011 raft_consensus.cc:3060] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:12.702071 31955 raft_consensus.cc:2749] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.709245 31873 raft_consensus.cc:3055] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:12.711323 31873 raft_consensus.cc:740] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:12.712198 31873 consensus_queue.cc:260] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:12.697605 31961 raft_consensus.cc:2804] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:12.714074 31341 leader_election.cc:304] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.717593 31873 raft_consensus.cc:3060] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:12.713244 31961 raft_consensus.cc:493] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:12.719211 31961 raft_consensus.cc:3060] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:12.720067 32093 raft_consensus.cc:2749] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:12.735502 31961 raft_consensus.cc:515] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:12.737323 31961 leader_election.cc:290] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:12.791581 31121 catalog_manager.cc:5654] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 1 to 2, leader changed from d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65) to 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67). New cstate: current_term: 2 leader_uuid: "73bf755165c4487c81c67b5ab44f7104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:12.808713 31216 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec42a05859cf4d5ebe1e1f268d01b3fc" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
I20260203 09:18:12.810354 31216 raft_consensus.cc:2393] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2bf9aa3533b14841a52177c8cc3130ec in current term 2: Already voted for candidate d44c40c0ed244c4e962a26f9aebea76a in this term.
I20260203 09:18:12.813330 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec42a05859cf4d5ebe1e1f268d01b3fc" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:12.870342 32026 consensus_queue.cc:1048] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:12.870675 31121 catalog_manager.cc:5654] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 1 to 2, leader changed from 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67) to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 2 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:12.890416 31999 consensus_queue.cc:1048] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260203 09:18:12.928587 31298 raft_consensus.cc:2468] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 2.
I20260203 09:18:12.930495 31416 leader_election.cc:304] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:12.932404 32097 raft_consensus.cc:2804] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:12.934165 32097 raft_consensus.cc:697] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:12.936108 32097 consensus_queue.cc:237] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:12.949515 31298 raft_consensus.cc:1275] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:12.954849 32066 consensus_queue.cc:1048] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:18:12.966984 31444 raft_consensus.cc:3060] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:12.977726 31444 raft_consensus.cc:1275] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:12.986229 32066 consensus_queue.cc:1048] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:18:13.015435 31123 catalog_manager.cc:5654] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 1 to 2, leader changed from 79b10fa125f242419f66b577440e66d0 (127.26.232.66) to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 2 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:13.035863 31371 raft_consensus.cc:1275] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Refusing update from remote peer 2bf9aa3533b14841a52177c8cc3130ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:13.037567 31961 consensus_queue.cc:1048] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:18:13.054617 31216 raft_consensus.cc:1275] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Refusing update from remote peer 2bf9aa3533b14841a52177c8cc3130ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:13.056785 32097 consensus_queue.cc:1048] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:18:13.061865 27553 tablet_server.cc:178] TabletServer@127.26.232.65:0 shutting down...
W20260203 09:18:13.124217 31267 consensus_peers.cc:597] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:13.129263 31267 consensus_peers.cc:597] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:13.156795 31416 consensus_peers.cc:597] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:13.172103 31267 consensus_peers.cc:597] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:13.192970 31267 consensus_peers.cc:597] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:13.193065 31416 consensus_peers.cc:597] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:13.201519 32018 raft_consensus.cc:493] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
W20260203 09:18:13.206043 31416 consensus_peers.cc:597] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:13.206634 32018 raft_consensus.cc:515] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:13.216495 32018 leader_election.cc:290] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:13.220044 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b4a1f3d804ae39a009a23ea4e90f3" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:13.223338 31296 raft_consensus.cc:2393] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73bf755165c4487c81c67b5ab44f7104 in current term 2: Already voted for candidate 79b10fa125f242419f66b577440e66d0 in this term.
I20260203 09:18:13.232992 31375 raft_consensus.cc:1275] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Refusing update from remote peer 2bf9aa3533b14841a52177c8cc3130ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:13.237727 32097 consensus_queue.cc:1048] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260203 09:18:13.239979 31267 consensus_peers.cc:597] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:13.244275 31267 consensus_peers.cc:597] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:13.263938 31416 consensus_peers.cc:597] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:13.270414 31448 raft_consensus.cc:3060] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
W20260203 09:18:13.271112 31341 leader_election.cc:336] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:18:13.271684 31341 leader_election.cc:304] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:13.272578 32018 raft_consensus.cc:3060] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:13.278820 31448 raft_consensus.cc:1275] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Refusing update from remote peer 73bf755165c4487c81c67b5ab44f7104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260203 09:18:13.293720 31267 consensus_peers.cc:597] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:13.295554 32075 consensus_queue.cc:1048] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260203 09:18:13.300444 31341 consensus_peers.cc:597] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:13.307001 32018 raft_consensus.cc:2749] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 09:18:13.308503 31341 consensus_peers.cc:597] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:13.309629 32029 raft_consensus.cc:493] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:13.310070 32029 raft_consensus.cc:515] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:13.312311 32029 leader_election.cc:290] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:13.313298 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b4a1f3d804ae39a009a23ea4e90f3" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:13.313933 31375 raft_consensus.cc:2468] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 2.
I20260203 09:18:13.315306 31264 leader_election.cc:304] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters:
W20260203 09:18:13.316362 31267 leader_election.cc:336] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:18:13.319416 32029 raft_consensus.cc:2804] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:18:13.323690 32029 raft_consensus.cc:493] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:13.324038 32029 raft_consensus.cc:3060] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:13.347298 27553 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260203 09:18:13.350055 27553 tablet_replica.cc:333] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.360769 32029 raft_consensus.cc:515] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:13.369361 27553 raft_consensus.cc:2243] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:18:13.369556 32029 leader_election.cc:290] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:13.379321 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b4a1f3d804ae39a009a23ea4e90f3" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:13.380028 31374 raft_consensus.cc:3060] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:18:13.381415 31267 leader_election.cc:336] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:18:13.388551 32061 raft_consensus.cc:493] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:13.399689 32061 raft_consensus.cc:515] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:13.415277 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
W20260203 09:18:13.416181 31267 consensus_peers.cc:597] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:13.411005 32061 leader_election.cc:290] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
W20260203 09:18:13.427416 31267 consensus_peers.cc:597] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:13.428097 31267 consensus_peers.cc:597] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:13.428822 31371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:13.429598 31371 raft_consensus.cc:2468] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 3.
I20260203 09:18:13.430886 31188 leader_election.cc:304] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:13.432044 32061 raft_consensus.cc:2804] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:18:13.432448 32061 raft_consensus.cc:493] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:13.432888 32061 raft_consensus.cc:3060] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:18:13.439810 31448 raft_consensus.cc:2468] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 3.
W20260203 09:18:13.440491 31341 consensus_peers.cc:597] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:13.440954 27553 raft_consensus.cc:2272] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.442437 31374 raft_consensus.cc:2468] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 3.
I20260203 09:18:13.443506 31264 leader_election.cc:304] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:13.444870 32029 raft_consensus.cc:2804] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:18:13.445349 32029 raft_consensus.cc:697] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 3 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:13.446225 32029 consensus_queue.cc:237] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:13.450562 27553 tablet_replica.cc:333] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.451608 27553 raft_consensus.cc:2243] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260203 09:18:13.452539 31416 consensus_peers.cc:597] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:13.461040 27553 raft_consensus.cc:2272] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.464190 27553 tablet_replica.cc:333] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.465070 27553 raft_consensus.cc:2243] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.465607 27553 raft_consensus.cc:2272] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.468783 32061 raft_consensus.cc:515] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:13.470966 32061 leader_election.cc:290] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 4 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:13.472968 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:13.473570 31448 raft_consensus.cc:3060] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:18:13.472275 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:13.478302 31374 raft_consensus.cc:3060] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:18:13.479478 31448 raft_consensus.cc:2468] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 4.
I20260203 09:18:13.480379 31296 raft_consensus.cc:1275] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Refusing update from remote peer 2bf9aa3533b14841a52177c8cc3130ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:13.480846 31191 leader_election.cc:304] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:13.481805 32061 raft_consensus.cc:2804] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:18:13.481977 31961 consensus_queue.cc:1048] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:13.482508 32061 raft_consensus.cc:697] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 4 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:13.483583 32061 consensus_queue.cc:237] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:13.485898 31374 raft_consensus.cc:2468] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 4.
I20260203 09:18:13.488847 27553 tablet_replica.cc:333] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.491058 27553 raft_consensus.cc:2243] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.491673 27553 raft_consensus.cc:2272] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.488013 31121 catalog_manager.cc:5654] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 1 to 3, leader changed from d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65) to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 3 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:13.502290 27553 tablet_replica.cc:333] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.503257 27553 raft_consensus.cc:2243] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:18:13.504406 27553 raft_consensus.cc:2272] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.507385 27553 tablet_replica.cc:333] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.509038 27553 raft_consensus.cc:2243] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.509590 27553 raft_consensus.cc:2272] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.512529 27553 tablet_replica.cc:333] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.513451 27553 raft_consensus.cc:2243] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:18:13.515169 27553 raft_consensus.cc:2272] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.523231 27553 tablet_replica.cc:333] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.524250 27553 raft_consensus.cc:2243] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.524938 27553 raft_consensus.cc:2272] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.527849 27553 tablet_replica.cc:333] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.528537 27553 raft_consensus.cc:2243] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.529145 27553 raft_consensus.cc:2272] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.537755 27553 tablet_replica.cc:333] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.538733 27553 raft_consensus.cc:2243] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:18:13.539140 32061 raft_consensus.cc:493] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:13.542691 32061 raft_consensus.cc:515] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:13.541796 31961 raft_consensus.cc:493] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:13.547408 31961 raft_consensus.cc:515] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:13.549165 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1d1f5b1c3b64ebaa2824e9136285fbe" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:13.549480 31961 leader_election.cc:290] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:13.539824 27553 raft_consensus.cc:2272] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.549889 31448 raft_consensus.cc:2468] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 2.
I20260203 09:18:13.551384 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b062505fb476790c4f06d074d67aa" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:13.552290 31191 leader_election.cc:304] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:13.552942 27553 tablet_replica.cc:333] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.553098 32111 raft_consensus.cc:2804] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:13.553539 32111 raft_consensus.cc:493] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:13.553898 27553 raft_consensus.cc:2243] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:18:13.553893 32111 raft_consensus.cc:3060] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:13.556424 27553 raft_consensus.cc:2272] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.560015 27553 tablet_replica.cc:333] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
W20260203 09:18:13.560495 31416 leader_election.cc:336] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:18:13.560984 27553 raft_consensus.cc:2243] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.561090 31416 leader_election.cc:304] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:13.561962 31961 raft_consensus.cc:2749] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:18:13.561648 27553 raft_consensus.cc:2272] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.566309 27553 tablet_replica.cc:333] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.567144 27553 raft_consensus.cc:2243] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.567687 27553 raft_consensus.cc:2272] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.569792 32111 raft_consensus.cc:515] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:13.570467 27553 tablet_replica.cc:333] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
W20260203 09:18:13.570931 31267 consensus_peers.cc:597] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:13.571375 27553 raft_consensus.cc:2243] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.572803 27553 raft_consensus.cc:2272] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.576248 27553 tablet_replica.cc:333] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.577121 27553 raft_consensus.cc:2243] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:13.577628 32061 leader_election.cc:290] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:13.578258 27553 raft_consensus.cc:2272] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.579150 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1d1f5b1c3b64ebaa2824e9136285fbe" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:13.579946 31298 raft_consensus.cc:2393] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d44c40c0ed244c4e962a26f9aebea76a in current term 2: Already voted for candidate 79b10fa125f242419f66b577440e66d0 in this term.
I20260203 09:18:13.580091 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1d1f5b1c3b64ebaa2824e9136285fbe" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:13.581333 27553 tablet_replica.cc:333] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
W20260203 09:18:13.576498 31416 consensus_peers.cc:597] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:13.583426 32066 raft_consensus.cc:493] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:13.583992 32066 raft_consensus.cc:515] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:13.585989 32066 leader_election.cc:290] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:13.587056 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b062505fb476790c4f06d074d67aa" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:13.587406 31448 raft_consensus.cc:2468] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 2.
I20260203 09:18:13.582217 27553 raft_consensus.cc:2243] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.588768 27553 raft_consensus.cc:2272] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.588706 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b062505fb476790c4f06d074d67aa" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:13.589460 31444 raft_consensus.cc:2468] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 2.
I20260203 09:18:13.590728 31191 leader_election.cc:304] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:13.591566 32066 raft_consensus.cc:2804] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:18:13.591995 32066 raft_consensus.cc:493] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:13.592096 27553 tablet_replica.cc:333] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.592468 32066 raft_consensus.cc:3060] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:13.593122 27553 raft_consensus.cc:2243] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.593710 27553 raft_consensus.cc:2272] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.596768 27553 tablet_replica.cc:333] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.597560 27553 raft_consensus.cc:2243] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.598189 27553 raft_consensus.cc:2272] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.599087 31191 leader_election.cc:304] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:13.600968 32057 raft_consensus.cc:2804] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:13.601405 32057 raft_consensus.cc:697] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 2 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:13.602044 27553 tablet_replica.cc:333] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.602243 32057 consensus_queue.cc:237] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:13.607841 27553 raft_consensus.cc:2243] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.608505 27553 raft_consensus.cc:2272] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.611450 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1d1f5b1c3b64ebaa2824e9136285fbe" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:13.612340 31298 raft_consensus.cc:2393] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d44c40c0ed244c4e962a26f9aebea76a in current term 2: Already voted for candidate 79b10fa125f242419f66b577440e66d0 in this term.
I20260203 09:18:13.615330 27553 tablet_replica.cc:333] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.616194 27553 raft_consensus.cc:2243] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.616878 27553 raft_consensus.cc:2272] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.618350 32111 leader_election.cc:290] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:13.620194 27553 tablet_replica.cc:333] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.622012 27553 raft_consensus.cc:2243] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:18:13.623047 27553 raft_consensus.cc:2272] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.625188 32066 raft_consensus.cc:515] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:13.626398 27553 tablet_replica.cc:333] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.627291 27553 raft_consensus.cc:2243] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.627890 27553 pending_rounds.cc:70] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a: Trying to abort 1 pending ops.
I20260203 09:18:13.628130 27553 pending_rounds.cc:77] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7250371758399836160 op_type: NO_OP noop_request { }
I20260203 09:18:13.628495 27553 raft_consensus.cc:2889] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260203 09:18:13.628892 27553 raft_consensus.cc:2272] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.631925 27553 tablet_replica.cc:333] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.632748 27553 raft_consensus.cc:2243] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.633296 27553 raft_consensus.cc:2272] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.633450 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b062505fb476790c4f06d074d67aa" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:13.635991 32066 leader_election.cc:290] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:13.636257 27553 tablet_replica.cc:333] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.637234 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b062505fb476790c4f06d074d67aa" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:13.637830 31448 raft_consensus.cc:3060] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:13.639008 27553 raft_consensus.cc:2243] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.639603 27553 raft_consensus.cc:2272] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.648288 31448 raft_consensus.cc:2468] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 3.
I20260203 09:18:13.649273 27553 tablet_replica.cc:333] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.650326 31191 leader_election.cc:304] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:13.651038 27553 raft_consensus.cc:2243] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.651680 27553 raft_consensus.cc:2272] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.651960 32057 raft_consensus.cc:2804] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:18:13.652500 32057 raft_consensus.cc:697] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 3 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:13.653450 32057 consensus_queue.cc:237] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:13.654374 27553 tablet_replica.cc:333] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.655162 27553 raft_consensus.cc:2243] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.655687 27553 raft_consensus.cc:2272] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.660056 27553 tablet_replica.cc:333] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.678438 27553 raft_consensus.cc:2243] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:18:13.679564 27553 raft_consensus.cc:2272] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.682683 27553 tablet_replica.cc:333] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.683459 27553 raft_consensus.cc:2243] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.684093 27553 raft_consensus.cc:2272] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.688505 32057 raft_consensus.cc:493] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:13.689049 32057 raft_consensus.cc:515] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:13.691000 32057 leader_election.cc:290] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:13.693068 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14fd7c3d313847f591177ebba8df09c4" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:13.693771 31448 raft_consensus.cc:2468] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 2.
I20260203 09:18:13.695289 31191 leader_election.cc:304] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:13.696115 32057 raft_consensus.cc:2804] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:18:13.696518 32057 raft_consensus.cc:493] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:13.698657 32057 raft_consensus.cc:3060] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:13.702790 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14fd7c3d313847f591177ebba8df09c4" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:13.713196 27553 tablet_replica.cc:333] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.714284 27553 raft_consensus.cc:2243] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.714883 27553 raft_consensus.cc:2272] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.715309 32057 raft_consensus.cc:515] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:13.718106 32019 raft_consensus.cc:493] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:13.718312 27553 tablet_replica.cc:333] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.718631 32019 raft_consensus.cc:515] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:13.719267 27553 raft_consensus.cc:2243] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:18:13.720453 27553 raft_consensus.cc:2272] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.728966 27553 tablet_replica.cc:333] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.730501 27553 raft_consensus.cc:2243] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.731240 27553 raft_consensus.cc:2272] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260203 09:18:13.732139 31416 leader_election.cc:336] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:18:13.732956 32019 leader_election.cc:290] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:13.735751 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20dfe4990e0a46ef9b0cf1cdf3dfdb09" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:13.736465 31298 raft_consensus.cc:2468] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 2.
I20260203 09:18:13.737354 27553 tablet_replica.cc:333] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.737999 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14fd7c3d313847f591177ebba8df09c4" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:13.738181 27553 raft_consensus.cc:2243] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:18:13.738978 31416 leader_election.cc:304] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:13.739157 27553 pending_rounds.cc:70] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a: Trying to abort 1 pending ops.
I20260203 09:18:13.739545 27553 pending_rounds.cc:77] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a: Aborting op as it isn't in flight: id { term: 4 index: 2 } timestamp: 7250371762175242240 op_type: NO_OP noop_request { }
I20260203 09:18:13.739882 27553 raft_consensus.cc:2889] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260203 09:18:13.740242 27553 raft_consensus.cc:2272] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.740458 32019 raft_consensus.cc:2804] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:18:13.740976 32019 raft_consensus.cc:493] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:13.741321 32019 raft_consensus.cc:3060] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:13.744014 27553 tablet_replica.cc:333] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.738548 31448 raft_consensus.cc:3060] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:13.745127 27553 raft_consensus.cc:2243] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.745769 27553 raft_consensus.cc:2272] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.749059 27553 tablet_replica.cc:333] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.749835 27553 raft_consensus.cc:2243] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:18:13.750589 27553 pending_rounds.cc:70] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a: Trying to abort 1 pending ops.
I20260203 09:18:13.750836 27553 pending_rounds.cc:77] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a: Aborting op as it isn't in flight: id { term: 3 index: 2 } timestamp: 7250371762882912256 op_type: NO_OP noop_request { }
I20260203 09:18:13.751168 27553 raft_consensus.cc:2889] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260203 09:18:13.751561 27553 raft_consensus.cc:2272] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.754621 27553 tablet_replica.cc:333] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.755349 27553 raft_consensus.cc:2243] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:18:13.756091 31448 raft_consensus.cc:2468] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 3.
I20260203 09:18:13.756475 27553 raft_consensus.cc:2272] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.759033 32066 raft_consensus.cc:493] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:13.759325 27553 tablet_replica.cc:333] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.759524 32066 raft_consensus.cc:515] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:13.759907 32057 leader_election.cc:290] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:13.760425 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14fd7c3d313847f591177ebba8df09c4" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:13.761569 32066 leader_election.cc:290] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:13.762212 27553 raft_consensus.cc:2243] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.762923 27553 raft_consensus.cc:2272] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.763296 31371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b4a1f3d804ae39a009a23ea4e90f3" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:13.764153 31371 raft_consensus.cc:2393] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d44c40c0ed244c4e962a26f9aebea76a in current term 3: Already voted for candidate 79b10fa125f242419f66b577440e66d0 in this term.
I20260203 09:18:13.764499 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84b4a1f3d804ae39a009a23ea4e90f3" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:13.765874 31191 leader_election.cc:304] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44c40c0ed244c4e962a26f9aebea76a; no voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0
I20260203 09:18:13.767859 27553 tablet_replica.cc:333] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.768785 27553 raft_consensus.cc:2243] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:18:13.770288 31191 leader_election.cc:304] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters: 79b10fa125f242419f66b577440e66d0
I20260203 09:18:13.770602 27553 raft_consensus.cc:2272] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.770896 32066 raft_consensus.cc:3060] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:13.771543 32057 raft_consensus.cc:2804] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:18:13.772039 32057 raft_consensus.cc:697] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 3 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:13.772935 32057 consensus_queue.cc:237] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:13.773818 27553 tablet_replica.cc:333] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.774667 27553 raft_consensus.cc:2243] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.775141 31873 raft_consensus.cc:493] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:13.775269 27553 raft_consensus.cc:2272] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.775717 31873 raft_consensus.cc:515] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:13.777928 31873 leader_election.cc:290] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:13.778699 27553 tablet_replica.cc:333] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.779520 27553 raft_consensus.cc:2243] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:18:13.780592 27553 raft_consensus.cc:2272] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260203 09:18:13.782943 31341 leader_election.cc:336] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:18:13.783761 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03e1544e85d94310a17e919716a0e5b9" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:13.784042 27553 tablet_replica.cc:333] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.762908 32019 raft_consensus.cc:515] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:13.784981 27553 raft_consensus.cc:2243] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.778729 32066 raft_consensus.cc:2749] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:18:13.788340 31961 raft_consensus.cc:493] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:13.788488 31341 leader_election.cc:304] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:13.800920 31961 raft_consensus.cc:515] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:13.801892 32019 leader_election.cc:290] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:13.802106 31873 raft_consensus.cc:2749] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:18:13.802947 31961 leader_election.cc:290] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:13.806234 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20dfe4990e0a46ef9b0cf1cdf3dfdb09" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:13.806833 31298 raft_consensus.cc:3060] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:13.809022 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3abbec594ab143a1ade1030741cf9e7d" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:13.809795 31296 raft_consensus.cc:2393] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bf9aa3533b14841a52177c8cc3130ec in current term 2: Already voted for candidate 79b10fa125f242419f66b577440e66d0 in this term.
W20260203 09:18:13.812528 31416 leader_election.cc:336] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260203 09:18:13.813230 31416 leader_election.cc:336] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:18:13.813580 31416 leader_election.cc:304] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:13.814442 27553 raft_consensus.cc:2272] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.814682 32097 raft_consensus.cc:3060] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:13.817063 27553 tablet_replica.cc:333] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.820528 31961 raft_consensus.cc:493] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:13.821257 31961 raft_consensus.cc:515] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:13.825557 27553 raft_consensus.cc:2243] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:13.826570 31961 leader_election.cc:290] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:13.829332 31873 raft_consensus.cc:493] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2bf9aa3533b14841a52177c8cc3130ec)
I20260203 09:18:13.829905 31873 raft_consensus.cc:515] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
W20260203 09:18:13.831595 31267 consensus_peers.cc:597] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:13.831735 31873 leader_election.cc:290] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:13.832718 31873 raft_consensus.cc:493] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:13.833220 31873 raft_consensus.cc:515] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:13.835711 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06460fafee594578bed03068236ad9f2" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:13.836341 31296 raft_consensus.cc:2468] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 2.
I20260203 09:18:13.839923 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b062505fb476790c4f06d074d67aa" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
W20260203 09:18:13.839968 31341 leader_election.cc:336] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:18:13.840692 31448 raft_consensus.cc:2368] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73bf755165c4487c81c67b5ab44f7104 for earlier term 2. Current term is 3.
I20260203 09:18:13.843629 31873 leader_election.cc:290] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
W20260203 09:18:13.844566 31416 leader_election.cc:336] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:18:13.845256 31416 leader_election.cc:304] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:13.847700 32019 raft_consensus.cc:2804] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:13.848091 32019 raft_consensus.cc:493] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79b10fa125f242419f66b577440e66d0)
I20260203 09:18:13.848418 32019 raft_consensus.cc:3060] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:13.849046 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f6fed7d1dca4d4184fd89b136a55ec1" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:13.849902 31296 raft_consensus.cc:2468] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 2.
I20260203 09:18:13.853075 31965 raft_consensus.cc:493] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:13.851375 31341 leader_election.cc:400] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099) with higher term. Message: Invalid argument: T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73bf755165c4487c81c67b5ab44f7104 for earlier term 2. Current term is 3.
I20260203 09:18:13.853581 31341 leader_election.cc:403] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260203 09:18:13.853628 31965 raft_consensus.cc:515] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:13.855227 31341 leader_election.cc:304] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:13.856137 31965 leader_election.cc:290] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:13.857282 31873 raft_consensus.cc:3060] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 3
W20260203 09:18:13.859362 31267 leader_election.cc:336] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:18:13.860229 32018 raft_consensus.cc:2804] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:18:13.860630 32018 raft_consensus.cc:493] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:13.860977 32018 raft_consensus.cc:3060] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:13.868462 32018 raft_consensus.cc:515] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:13.869819 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14fd7c3d313847f591177ebba8df09c4" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:13.870532 31448 raft_consensus.cc:2368] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79b10fa125f242419f66b577440e66d0 for earlier term 2. Current term is 3.
I20260203 09:18:13.871491 27553 pending_rounds.cc:70] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a: Trying to abort 1 pending ops.
I20260203 09:18:13.872262 32066 raft_consensus.cc:493] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:13.873184 31267 leader_election.cc:400] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099) with higher term. Message: Invalid argument: T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79b10fa125f242419f66b577440e66d0 for earlier term 2. Current term is 3.
I20260203 09:18:13.872790 32066 raft_consensus.cc:515] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:13.821578 31298 raft_consensus.cc:2468] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 3.
I20260203 09:18:13.874667 32097 raft_consensus.cc:2749] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:13.873498 31267 leader_election.cc:403] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260203 09:18:13.877346 32029 raft_consensus.cc:3060] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 3
I20260203 09:18:13.881325 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3abbec594ab143a1ade1030741cf9e7d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:13.881989 31448 raft_consensus.cc:2468] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 2.
I20260203 09:18:13.883100 31191 leader_election.cc:304] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:13.874897 32066 leader_election.cc:290] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:13.883857 32057 raft_consensus.cc:2804] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:18:13.884519 32057 raft_consensus.cc:493] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:13.884982 32057 raft_consensus.cc:3060] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:18:13.871084 31341 leader_election.cc:336] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:18:13.889009 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3abbec594ab143a1ade1030741cf9e7d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:13.871768 27553 pending_rounds.cc:77] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7250371762609942528 op_type: NO_OP noop_request { }
I20260203 09:18:13.889689 31298 raft_consensus.cc:2468] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 2.
I20260203 09:18:13.889891 27553 raft_consensus.cc:2889] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260203 09:18:13.890267 27553 raft_consensus.cc:2272] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.890825 31416 leader_election.cc:304] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:13.897527 32019 raft_consensus.cc:515] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:13.894485 32097 raft_consensus.cc:2804] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:18:13.901957 31873 raft_consensus.cc:2749] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099) with higher term. Message: Invalid argument: T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73bf755165c4487c81c67b5ab44f7104 for earlier term 2. Current term is 3.
I20260203 09:18:13.903605 32097 raft_consensus.cc:697] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:13.905299 32097 consensus_queue.cc:237] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:13.909292 32029 raft_consensus.cc:2749] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099) with higher term. Message: Invalid argument: T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79b10fa125f242419f66b577440e66d0 for earlier term 2. Current term is 3.
I20260203 09:18:13.909297 32057 raft_consensus.cc:515] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:13.914855 27553 tablet_replica.cc:333] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.914883 32018 leader_election.cc:290] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 3 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:13.915416 32019 leader_election.cc:290] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:13.915807 27553 raft_consensus.cc:2243] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.917316 27553 raft_consensus.cc:2272] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.920215 27553 tablet_replica.cc:333] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.920976 27553 raft_consensus.cc:2243] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:13.921469 27553 raft_consensus.cc:2272] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.926031 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9f6fed7d1dca4d4184fd89b136a55ec1" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
W20260203 09:18:13.926525 31416 leader_election.cc:336] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:18:13.926577 31296 raft_consensus.cc:3060] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:13.928431 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06460fafee594578bed03068236ad9f2" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:13.933547 31123 catalog_manager.cc:5654] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:13.936224 31298 raft_consensus.cc:2468] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 2.
I20260203 09:18:13.937463 31416 leader_election.cc:304] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:13.939973 32019 raft_consensus.cc:2804] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:13.944679 31296 raft_consensus.cc:2468] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 3.
I20260203 09:18:13.949581 31374 raft_consensus.cc:1275] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Refusing update from remote peer 79b10fa125f242419f66b577440e66d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260203 09:18:13.953545 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3abbec594ab143a1ade1030741cf9e7d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:13.954174 31448 raft_consensus.cc:3060] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:13.956359 31341 leader_election.cc:304] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:13.957880 32119 raft_consensus.cc:2804] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:18:13.959009 32119 raft_consensus.cc:697] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [term 3 LEADER]: Becoming Leader. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:13.959884 32119 consensus_queue.cc:237] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:13.962316 31448 raft_consensus.cc:2468] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 3.
I20260203 09:18:13.963428 31191 leader_election.cc:304] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:13.964253 32066 raft_consensus.cc:2804] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:18:13.964767 32066 raft_consensus.cc:697] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 3 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:13.965617 32066 consensus_queue.cc:237] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:13.973594 32057 leader_election.cc:290] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:13.973747 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3abbec594ab143a1ade1030741cf9e7d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:13.974396 31298 raft_consensus.cc:3060] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:13.977272 27553 tablet_replica.cc:333] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:13.978006 27553 raft_consensus.cc:2243] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:18:13.978731 27553 pending_rounds.cc:70] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a: Trying to abort 1 pending ops.
W20260203 09:18:13.974128 31341 leader_election.cc:336] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:18:13.983505 27553 pending_rounds.cc:77] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a: Aborting op as it isn't in flight: id { term: 3 index: 2 } timestamp: 7250371763350003712 op_type: NO_OP noop_request { }
I20260203 09:18:13.983912 27553 raft_consensus.cc:2889] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260203 09:18:13.984215 31298 raft_consensus.cc:2468] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 3.
I20260203 09:18:13.984251 27553 raft_consensus.cc:2272] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:13.986442 31961 raft_consensus.cc:493] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:13.986981 32019 raft_consensus.cc:697] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:13.986937 31961 raft_consensus.cc:515] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:13.987929 32019 consensus_queue.cc:237] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:13.990336 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8dbd55217e2546b5b3361ddf019f01d6" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:13.991863 31961 leader_election.cc:290] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:13.992780 31298 raft_consensus.cc:2393] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2bf9aa3533b14841a52177c8cc3130ec in current term 2: Already voted for candidate 79b10fa125f242419f66b577440e66d0 in this term.
I20260203 09:18:13.995047 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8dbd55217e2546b5b3361ddf019f01d6" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:13.995781 31374 raft_consensus.cc:2468] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 2.
I20260203 09:18:13.991750 31979 consensus_queue.cc:1048] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260203 09:18:14.009091 31413 leader_election.cc:304] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters: 79b10fa125f242419f66b577440e66d0
I20260203 09:18:14.009656 27553 tablet_replica.cc:333] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a: stopping tablet replica
I20260203 09:18:14.010548 31961 raft_consensus.cc:2804] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:14.010959 31961 raft_consensus.cc:493] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:14.011286 31961 raft_consensus.cc:3060] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:14.017134 27553 raft_consensus.cc:2243] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:18:14.018123 27553 pending_rounds.cc:70] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a: Trying to abort 1 pending ops.
I20260203 09:18:14.033789 27553 pending_rounds.cc:77] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a: Aborting op as it isn't in flight: id { term: 3 index: 2 } timestamp: 7250371764091858944 op_type: NO_OP noop_request { }
I20260203 09:18:14.034266 27553 raft_consensus.cc:2889] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260203 09:18:14.035204 27553 raft_consensus.cc:2272] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:14.032992 31961 raft_consensus.cc:515] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:14.050393 31123 catalog_manager.cc:5654] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 1 to 2, leader changed from 79b10fa125f242419f66b577440e66d0 (127.26.232.66) to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 2 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:14.051256 31121 catalog_manager.cc:5654] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "73bf755165c4487c81c67b5ab44f7104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:14.057559 31979 raft_consensus.cc:493] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:14.058154 31979 raft_consensus.cc:515] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:14.060204 31979 leader_election.cc:290] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:14.062464 31370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "653756c5b80f438b91b3d00ce86f52bb" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:14.063319 31370 raft_consensus.cc:2468] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 2.
I20260203 09:18:14.064571 31264 leader_election.cc:304] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:14.065670 31965 raft_consensus.cc:2804] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:18:14.066040 31965 raft_consensus.cc:493] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:14.066380 31965 raft_consensus.cc:3060] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:14.069074 31961 leader_election.cc:290] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
W20260203 09:18:14.069496 31267 leader_election.cc:336] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:18:14.069705 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8dbd55217e2546b5b3361ddf019f01d6" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:14.078521 31298 raft_consensus.cc:2393] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2bf9aa3533b14841a52177c8cc3130ec in current term 2: Already voted for candidate 79b10fa125f242419f66b577440e66d0 in this term.
I20260203 09:18:14.078058 32121 raft_consensus.cc:493] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:14.080480 32121 raft_consensus.cc:515] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:14.077095 31370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8dbd55217e2546b5b3361ddf019f01d6" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:14.102152 31367 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03e1544e85d94310a17e919716a0e5b9" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:14.104117 31367 raft_consensus.cc:2468] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 2.
I20260203 09:18:14.108978 32121 leader_election.cc:290] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:14.111881 31413 leader_election.cc:304] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters:
I20260203 09:18:14.116976 31961 raft_consensus.cc:2804] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:14.117422 31961 raft_consensus.cc:493] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:14.117784 31961 raft_consensus.cc:3060] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:14.120223 31370 raft_consensus.cc:2468] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 2.
I20260203 09:18:14.121904 31413 leader_election.cc:304] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters: 79b10fa125f242419f66b577440e66d0
I20260203 09:18:14.123015 32121 raft_consensus.cc:2804] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:14.123509 32121 raft_consensus.cc:697] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:14.124365 32121 consensus_queue.cc:237] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
W20260203 09:18:14.134968 31416 leader_election.cc:336] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:18:14.175285 31965 raft_consensus.cc:515] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:14.177431 31961 raft_consensus.cc:515] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
W20260203 09:18:14.180616 31267 leader_election.cc:336] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:18:14.182955 31123 catalog_manager.cc:5654] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 1 to 2, leader changed from 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67) to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 2 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:14.186102 31370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03e1544e85d94310a17e919716a0e5b9" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:14.189451 31367 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "653756c5b80f438b91b3d00ce86f52bb" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:14.190069 31367 raft_consensus.cc:3060] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:14.196480 32019 raft_consensus.cc:493] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:14.197129 32019 raft_consensus.cc:515] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:14.197713 31370 raft_consensus.cc:2468] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 2.
I20260203 09:18:14.200723 31367 raft_consensus.cc:2468] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 3.
I20260203 09:18:14.201505 31961 leader_election.cc:290] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:14.202960 31413 leader_election.cc:304] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters:
I20260203 09:18:14.199132 32019 leader_election.cc:290] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:14.204428 32019 raft_consensus.cc:2804] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election won for term 2
W20260203 09:18:14.204592 31416 leader_election.cc:336] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:18:14.204941 32019 raft_consensus.cc:697] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
W20260203 09:18:14.205524 31416 leader_election.cc:336] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:18:14.205906 32019 consensus_queue.cc:237] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:14.208925 32130 raft_consensus.cc:493] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:14.209615 31264 leader_election.cc:304] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:14.200259 32119 raft_consensus.cc:493] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:14.210258 32119 raft_consensus.cc:515] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:14.210700 32026 raft_consensus.cc:2804] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:18:14.188880 31965 leader_election.cc:290] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:14.211261 32026 raft_consensus.cc:697] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [term 3 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:14.212250 32026 consensus_queue.cc:237] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:14.212262 32119 leader_election.cc:290] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:14.214330 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f94dad823fea42d2976b19da7bc7b258" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:14.214943 31298 raft_consensus.cc:2468] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 2.
I20260203 09:18:14.216315 31341 leader_election.cc:304] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:14.217765 32119 raft_consensus.cc:2804] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:18:14.218111 32119 raft_consensus.cc:493] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:14.218428 32119 raft_consensus.cc:3060] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:18:14.220911 31341 leader_election.cc:336] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260203 09:18:14.225481 32128 raft_consensus.cc:493] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:14.226029 32128 raft_consensus.cc:515] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:14.209412 32130 raft_consensus.cc:515] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:14.230304 32128 leader_election.cc:290] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:14.230974 31367 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8dbd55217e2546b5b3361ddf019f01d6" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:14.232790 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8dbd55217e2546b5b3361ddf019f01d6" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:14.229319 32119 raft_consensus.cc:515] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:14.233632 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1d1f5b1c3b64ebaa2824e9136285fbe" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:14.240816 31449 raft_consensus.cc:2468] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 2.
I20260203 09:18:14.234133 31370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f617ef4ccf984446b1ab7084a92efe17" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:14.241644 32119 leader_election.cc:290] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 3 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:14.241886 31370 raft_consensus.cc:2468] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 2.
I20260203 09:18:14.236261 31367 raft_consensus.cc:2468] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 2.
I20260203 09:18:14.231004 32130 leader_election.cc:290] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:14.234174 31123 catalog_manager.cc:5654] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 1 to 3, leader changed from 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67) to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 3 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:14.260310 31121 catalog_manager.cc:5654] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 1 to 2, leader changed from 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67) to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 2 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:14.273705 31267 leader_election.cc:304] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:14.274901 31965 raft_consensus.cc:2804] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:18:14.275331 31965 raft_consensus.cc:493] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:14.275702 31965 raft_consensus.cc:3060] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:18:14.275986 31267 leader_election.cc:336] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
W20260203 09:18:14.297077 31416 consensus_peers.cc:597] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:14.293651 31965 raft_consensus.cc:515] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:14.307866 31413 leader_election.cc:304] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:14.308211 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f94dad823fea42d2976b19da7bc7b258" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:14.308869 31298 raft_consensus.cc:3060] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:14.308221 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1d1f5b1c3b64ebaa2824e9136285fbe" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:14.309414 32121 raft_consensus.cc:2804] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:14.309868 32121 raft_consensus.cc:493] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader 73bf755165c4487c81c67b5ab44f7104)
I20260203 09:18:14.310319 32121 raft_consensus.cc:3060] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:14.309798 31449 raft_consensus.cc:3060] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:14.316156 31264 leader_election.cc:304] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:14.317013 32130 raft_consensus.cc:2804] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:18:14.317378 32130 raft_consensus.cc:493] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:14.317689 32130 raft_consensus.cc:3060] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:14.322073 31965 leader_election.cc:290] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:14.330910 32121 raft_consensus.cc:515] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:14.335134 32121 leader_election.cc:290] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
W20260203 09:18:14.335731 31267 leader_election.cc:336] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:14.337074 31370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f617ef4ccf984446b1ab7084a92efe17" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:14.344548 32130 raft_consensus.cc:515] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:14.348042 31449 raft_consensus.cc:2468] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 3.
W20260203 09:18:14.351761 31416 leader_election.cc:336] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:14.352066 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8dbd55217e2546b5b3361ddf019f01d6" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:14.347308 31298 raft_consensus.cc:2468] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 3.
I20260203 09:18:14.346139 31370 raft_consensus.cc:2468] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 2.
I20260203 09:18:14.349912 32130 leader_election.cc:290] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
W20260203 09:18:14.350155 31341 leader_election.cc:336] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:14.354836 31267 leader_election.cc:304] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:14.356037 31413 leader_election.cc:304] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:14.356108 31370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8dbd55217e2546b5b3361ddf019f01d6" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:14.356885 31370 raft_consensus.cc:3060] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:14.357367 32121 raft_consensus.cc:2804] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:14.358268 32121 raft_consensus.cc:697] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:14.359781 32130 raft_consensus.cc:2804] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:18:14.360375 32130 raft_consensus.cc:697] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 3 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:14.359179 32121 consensus_queue.cc:237] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:14.364476 31370 raft_consensus.cc:2468] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 3.
I20260203 09:18:14.367322 31341 leader_election.cc:304] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:14.368860 32119 raft_consensus.cc:2804] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:18:14.369345 32119 raft_consensus.cc:697] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [term 3 LEADER]: Becoming Leader. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:14.370222 32119 consensus_queue.cc:237] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:14.373375 31264 leader_election.cc:304] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:14.374203 32026 raft_consensus.cc:2804] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:18:14.374763 32026 raft_consensus.cc:697] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 3 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:14.375663 32026 consensus_queue.cc:237] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:14.364456 32130 consensus_queue.cc:237] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:14.405654 31298 raft_consensus.cc:1275] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Refusing update from remote peer 73bf755165c4487c81c67b5ab44f7104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260203 09:18:14.407315 31123 catalog_manager.cc:5654] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 1 to 2, leader changed from 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67) to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 2 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:14.408056 31121 catalog_manager.cc:5654] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 1 to 3, leader changed from 79b10fa125f242419f66b577440e66d0 (127.26.232.66) to 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67). New cstate: current_term: 3 leader_uuid: "73bf755165c4487c81c67b5ab44f7104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:14.417358 32075 consensus_queue.cc:1048] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260203 09:18:14.428368 31416 consensus_peers.cc:597] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:14.451792 31296 raft_consensus.cc:1275] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Refusing update from remote peer 2bf9aa3533b14841a52177c8cc3130ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260203 09:18:14.454751 32019 consensus_queue.cc:1048] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260203 09:18:14.474004 31341 consensus_peers.cc:597] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:14.485677 31123 catalog_manager.cc:5654] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 1 to 3, leader changed from 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68) to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 3 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:14.528132 31961 raft_consensus.cc:493] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:14.528741 31961 raft_consensus.cc:515] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:14.530674 31961 leader_election.cc:290] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:14.530153 31123 catalog_manager.cc:5654] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 2 to 3, leader changed from 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68) to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 3 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:14.532951 31367 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87ac8c99d77e47c2b1a373820b27c804" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
W20260203 09:18:14.556226 31416 leader_election.cc:336] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:14.556716 31416 leader_election.cc:304] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:14.557395 31961 raft_consensus.cc:2749] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:14.560810 31296 raft_consensus.cc:1275] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Refusing update from remote peer 2bf9aa3533b14841a52177c8cc3130ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:14.565471 32145 consensus_queue.cc:1048] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:14.595893 31367 raft_consensus.cc:1240] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Rejecting Update request from peer 2bf9aa3533b14841a52177c8cc3130ec for earlier term 2. Current term is 3. Ops: []
I20260203 09:18:14.598141 31961 consensus_queue.cc:1059] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:14.598994 32146 raft_consensus.cc:3055] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:18:14.599435 32146 raft_consensus.cc:740] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:14.600276 32146 consensus_queue.cc:260] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:14.603725 32146 raft_consensus.cc:3060] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:18:14.691859 31267 consensus_peers.cc:597] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:14.716122 32145 raft_consensus.cc:493] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:14.716718 32145 raft_consensus.cc:515] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:14.719007 32145 leader_election.cc:290] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:14.721158 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3eab34196fcb483abc69a625b7ca6300" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:14.730171 31367 raft_consensus.cc:1275] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Refusing update from remote peer 2bf9aa3533b14841a52177c8cc3130ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:14.731662 32145 consensus_queue.cc:1048] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:14.733752 32018 raft_consensus.cc:493] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
W20260203 09:18:14.730667 31416 leader_election.cc:336] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:14.734285 32018 raft_consensus.cc:515] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:14.734755 31416 leader_election.cc:304] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:14.736243 32018 leader_election.cc:290] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:14.736501 31961 raft_consensus.cc:2749] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:14.740051 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
W20260203 09:18:14.744596 31341 leader_election.cc:336] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:14.745129 31341 leader_election.cc:304] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:14.745800 32018 raft_consensus.cc:2749] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260203 09:18:14.770385 31341 consensus_peers.cc:597] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:14.778224 31416 consensus_peers.cc:597] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:14.780308 32018 raft_consensus.cc:493] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:14.780969 32018 raft_consensus.cc:515] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:14.783239 32018 leader_election.cc:290] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:14.783847 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "563e8640cca54f9cab7822a8136fb583" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:14.795631 32018 raft_consensus.cc:493] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:14.798694 32018 raft_consensus.cc:515] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:14.800756 32018 leader_election.cc:290] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:14.796876 31374 raft_consensus.cc:1275] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Refusing update from remote peer 79b10fa125f242419f66b577440e66d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260203 09:18:14.797379 31341 leader_election.cc:336] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:14.801636 31341 leader_election.cc:304] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:14.802385 32018 raft_consensus.cc:2749] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:14.804469 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a68c16f0da84e9683a5121f63b3f22c" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:14.806447 32130 consensus_queue.cc:1048] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260203 09:18:14.815912 31341 leader_election.cc:336] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:14.816351 31341 leader_election.cc:304] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:14.817067 32075 raft_consensus.cc:2749] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:14.835470 32130 raft_consensus.cc:493] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:14.836613 32130 raft_consensus.cc:515] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:14.837339 32018 raft_consensus.cc:493] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:14.837909 32018 raft_consensus.cc:515] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:14.838614 32130 leader_election.cc:290] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:14.839851 32018 leader_election.cc:290] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:14.842060 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87ac8c99d77e47c2b1a373820b27c804" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:14.842753 31449 raft_consensus.cc:2468] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 1.
I20260203 09:18:14.843978 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3eab34196fcb483abc69a625b7ca6300" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:14.844518 31449 raft_consensus.cc:2468] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:14.844633 31341 leader_election.cc:304] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters:
I20260203 09:18:14.845441 32018 raft_consensus.cc:2804] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:14.845921 32018 raft_consensus.cc:493] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:14.846271 32018 raft_consensus.cc:3060] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:14.847159 31267 leader_election.cc:304] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:14.849586 32128 raft_consensus.cc:493] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:14.850101 32128 raft_consensus.cc:515] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:14.852260 32128 leader_election.cc:290] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:14.855181 31961 raft_consensus.cc:493] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:14.855751 31370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93cc0a94606149e18c8764e851f4b826" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:14.856422 32121 raft_consensus.cc:493] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:14.856946 32121 raft_consensus.cc:515] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:14.855769 31961 raft_consensus.cc:515] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:14.858969 32121 leader_election.cc:290] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:14.859573 31965 raft_consensus.cc:2804] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:14.859730 31961 leader_election.cc:290] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:14.860024 31965 raft_consensus.cc:493] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:14.862116 31965 raft_consensus.cc:3060] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
W20260203 09:18:14.866418 31416 leader_election.cc:336] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
W20260203 09:18:14.868278 31416 leader_election.cc:336] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:14.862128 32018 raft_consensus.cc:515] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
W20260203 09:18:14.870930 31341 leader_election.cc:336] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:14.872455 32018 leader_election.cc:290] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
W20260203 09:18:14.873854 31267 leader_election.cc:336] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:14.878762 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "87ac8c99d77e47c2b1a373820b27c804" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:14.879330 31449 raft_consensus.cc:3060] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:14.881546 31374 raft_consensus.cc:1275] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Refusing update from remote peer 79b10fa125f242419f66b577440e66d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260203 09:18:14.881862 31371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee25c6a8d94e49a2a9a5646d493c1bde" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:14.883085 31370 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "563e8640cca54f9cab7822a8136fb583" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:14.883735 31370 raft_consensus.cc:2468] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 1.
I20260203 09:18:14.884470 32119 raft_consensus.cc:493] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
W20260203 09:18:14.884896 31267 leader_election.cc:336] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:14.885033 32119 raft_consensus.cc:515] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:14.887234 31449 raft_consensus.cc:2468] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 2.
I20260203 09:18:14.887288 32119 leader_election.cc:290] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:14.887426 32018 raft_consensus.cc:493] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:14.888484 32018 raft_consensus.cc:515] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:14.885358 31267 leader_election.cc:304] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:14.890337 32128 raft_consensus.cc:2749] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:14.890493 32018 leader_election.cc:290] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:14.891777 31965 raft_consensus.cc:515] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:14.893723 31965 leader_election.cc:290] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:14.896102 31413 leader_election.cc:304] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:14.896162 31965 consensus_queue.cc:1048] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:18:14.897344 31961 raft_consensus.cc:2749] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260203 09:18:14.901227 31413 leader_election.cc:304] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:14.902046 32121 raft_consensus.cc:2804] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:14.902406 32121 raft_consensus.cc:493] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:14.902733 32121 raft_consensus.cc:3060] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:14.903092 32018 raft_consensus.cc:493] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:14.903653 32018 raft_consensus.cc:515] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:14.904832 31961 raft_consensus.cc:493] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:14.905586 32018 leader_election.cc:290] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:14.905354 31961 raft_consensus.cc:515] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:14.908329 31961 leader_election.cc:290] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:14.909713 32145 raft_consensus.cc:493] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:14.910202 32145 raft_consensus.cc:515] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:14.912027 32145 leader_election.cc:290] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:14.913357 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c2f90aaa7514d27a5a15b4fd6f90669" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:14.916114 32121 raft_consensus.cc:515] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
W20260203 09:18:14.917976 31416 leader_election.cc:336] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
W20260203 09:18:14.920900 31416 leader_election.cc:336] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:14.921113 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3eab34196fcb483abc69a625b7ca6300" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:14.921577 32128 raft_consensus.cc:493] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:14.921800 31444 raft_consensus.cc:3060] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:14.921695 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c17aa1880254f13a38a3c550b0894af" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:14.922174 32128 raft_consensus.cc:515] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:14.923262 31416 leader_election.cc:304] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:14.923823 31961 raft_consensus.cc:2749] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 09:18:14.924125 31416 consensus_peers.cc:597] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:14.925892 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9884e996f0443f2ae2ab5606633ce3c" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:14.926694 32121 leader_election.cc:290] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:14.927451 31296 raft_consensus.cc:2468] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 1.
I20260203 09:18:14.928576 31444 raft_consensus.cc:2468] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 2.
W20260203 09:18:14.931376 31416 leader_election.cc:336] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:14.933089 31444 raft_consensus.cc:1275] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Refusing update from remote peer 79b10fa125f242419f66b577440e66d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260203 09:18:14.933425 31444 pending_rounds.cc:85] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec: Aborting all ops after (but not including) 1
I20260203 09:18:14.933632 31444 pending_rounds.cc:107] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260203 09:18:14.933851 31444 raft_consensus.cc:2889] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260203 09:18:14.937844 32128 leader_election.cc:290] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
W20260203 09:18:14.938740 31341 leader_election.cc:336] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:14.942729 31267 leader_election.cc:304] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:14.943427 32128 raft_consensus.cc:2804] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:14.943861 31965 consensus_queue.cc:1048] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:14.946148 32128 raft_consensus.cc:697] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [term 2 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:14.947181 32128 consensus_queue.cc:237] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:14.949474 31341 leader_election.cc:304] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters: d44c40c0ed244c4e962a26f9aebea76a
W20260203 09:18:14.952317 31267 leader_election.cc:336] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:14.957798 32119 raft_consensus.cc:2804] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:14.958384 32119 raft_consensus.cc:697] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Becoming Leader. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:14.959234 32119 consensus_queue.cc:237] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
W20260203 09:18:14.968428 31267 consensus_peers.cc:597] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:14.970754 31121 catalog_manager.cc:5654] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 1 to 2, leader changed from d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65) to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 2 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:14.972271 32128 raft_consensus.cc:493] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:14.973035 32128 raft_consensus.cc:515] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:14.975747 32128 leader_election.cc:290] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:14.977088 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9884e996f0443f2ae2ab5606633ce3c" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:14.977699 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee25c6a8d94e49a2a9a5646d493c1bde" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:14.978307 31444 raft_consensus.cc:2468] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 1.
I20260203 09:18:14.977717 31375 raft_consensus.cc:2468] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:14.980013 31296 raft_consensus.cc:1275] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Refusing update from remote peer 73bf755165c4487c81c67b5ab44f7104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260203 09:18:14.981694 31444 raft_consensus.cc:1275] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Refusing update from remote peer 79b10fa125f242419f66b577440e66d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260203 09:18:14.988916 31965 consensus_queue.cc:1048] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260203 09:18:14.990568 31267 leader_election.cc:336] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:14.994040 31341 leader_election.cc:304] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:14.994848 32119 raft_consensus.cc:2804] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:14.995210 32119 raft_consensus.cc:493] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:14.995558 32119 raft_consensus.cc:3060] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:15.004617 32075 consensus_queue.cc:1048] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:18:15.010291 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a68c16f0da84e9683a5121f63b3f22c" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:15.010928 31375 raft_consensus.cc:2468] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 1.
I20260203 09:18:15.012388 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "563e8640cca54f9cab7822a8136fb583" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:15.012938 31375 raft_consensus.cc:3060] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
W20260203 09:18:15.012398 31267 leader_election.cc:336] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:15.017786 32128 raft_consensus.cc:493] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:15.018271 32128 raft_consensus.cc:515] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:14.983724 31123 catalog_manager.cc:5654] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 1 to 2, leader changed from d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65) to 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67). New cstate: current_term: 2 leader_uuid: "73bf755165c4487c81c67b5ab44f7104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:15.020145 32128 leader_election.cc:290] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:15.021406 31375 raft_consensus.cc:2468] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 2.
I20260203 09:18:15.023300 31374 raft_consensus.cc:1275] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Refusing update from remote peer 2bf9aa3533b14841a52177c8cc3130ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:15.025339 32121 raft_consensus.cc:493] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:15.025921 32121 raft_consensus.cc:515] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:15.027026 32119 raft_consensus.cc:515] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:15.027837 32121 leader_election.cc:290] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:15.026144 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:15.036269 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8301405e2ead406caa7440c0337df77d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:15.033414 31375 raft_consensus.cc:2468] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 3.
W20260203 09:18:15.038653 31341 leader_election.cc:336] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:15.041080 31341 leader_election.cc:304] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:15.041805 32075 raft_consensus.cc:2749] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260203 09:18:15.042833 31341 leader_election.cc:336] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:15.040633 32119 leader_election.cc:290] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
W20260203 09:18:15.044080 31416 leader_election.cc:336] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:15.047537 31264 leader_election.cc:304] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:15.048317 31965 raft_consensus.cc:2804] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:15.048691 31965 raft_consensus.cc:493] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:15.049038 31965 raft_consensus.cc:3060] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:15.064713 32121 raft_consensus.cc:493] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:15.065312 32121 raft_consensus.cc:515] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:15.066681 31413 leader_election.cc:304] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:15.067234 32121 leader_election.cc:290] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:15.067812 32121 raft_consensus.cc:2804] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:15.068162 32121 raft_consensus.cc:493] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:15.068502 32121 raft_consensus.cc:3060] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:15.072494 31413 leader_election.cc:304] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters: d44c40c0ed244c4e962a26f9aebea76a
W20260203 09:18:15.073372 31267 leader_election.cc:336] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:15.073720 31961 raft_consensus.cc:2804] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:15.073827 31267 leader_election.cc:304] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:15.074262 31961 raft_consensus.cc:697] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:15.075107 31961 consensus_queue.cc:237] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:15.080243 31341 leader_election.cc:304] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters:
I20260203 09:18:15.082528 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c17aa1880254f13a38a3c550b0894af" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:15.083492 31375 raft_consensus.cc:2468] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 1.
I20260203 09:18:15.081182 32026 raft_consensus.cc:2749] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260203 09:18:15.083698 31264 leader_election.cc:304] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:15.090287 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8301405e2ead406caa7440c0337df77d" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:15.091702 31413 leader_election.cc:304] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:15.082858 32145 consensus_queue.cc:1048] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260203 09:18:15.085780 32119 raft_consensus.cc:2804] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:15.096146 31298 raft_consensus.cc:2468] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 2.
I20260203 09:18:15.097584 31292 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9884e996f0443f2ae2ab5606633ce3c" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:15.077523 31965 raft_consensus.cc:515] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
W20260203 09:18:15.102056 31341 leader_election.cc:336] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:15.094478 32029 raft_consensus.cc:2804] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:18:15.105080 32146 raft_consensus.cc:2804] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:15.105783 31965 leader_election.cc:290] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:15.106726 32121 raft_consensus.cc:515] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:15.112196 32121 leader_election.cc:290] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
W20260203 09:18:15.113041 31267 leader_election.cc:336] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
W20260203 09:18:15.116930 31341 leader_election.cc:336] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:15.118325 32146 raft_consensus.cc:493] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:15.118849 32146 raft_consensus.cc:3060] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:15.109040 31292 raft_consensus.cc:2393] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 73bf755165c4487c81c67b5ab44f7104 in current term 2: Already voted for candidate 79b10fa125f242419f66b577440e66d0 in this term.
I20260203 09:18:15.097945 32119 raft_consensus.cc:493] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:15.122000 32119 raft_consensus.cc:3060] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:15.107738 32029 raft_consensus.cc:493] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:15.124478 32029 raft_consensus.cc:3060] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:18:15.136250 31341 leader_election.cc:304] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:15.140581 32018 raft_consensus.cc:2749] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260203 09:18:15.143152 31264 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.67:41289, user_credentials={real_user=slave}} blocked reactor thread for 51478.3us
I20260203 09:18:15.150844 32029 raft_consensus.cc:515] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:15.151211 32146 raft_consensus.cc:515] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:15.152272 31367 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9884e996f0443f2ae2ab5606633ce3c" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:15.153120 31367 raft_consensus.cc:2393] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 79b10fa125f242419f66b577440e66d0 in current term 2: Already voted for candidate 73bf755165c4487c81c67b5ab44f7104 in this term.
I20260203 09:18:15.153215 32146 leader_election.cc:290] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:15.155664 32026 raft_consensus.cc:493] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:15.156208 32026 raft_consensus.cc:515] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:15.155550 32029 leader_election.cc:290] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 4 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:15.158106 32026 leader_election.cc:290] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:15.158372 32075 raft_consensus.cc:493] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:15.158856 32075 raft_consensus.cc:515] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:15.159822 31264 leader_election.cc:304] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:15.160815 32128 raft_consensus.cc:2749] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:18:15.163192 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93cc0a94606149e18c8764e851f4b826" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
W20260203 09:18:15.143900 31413 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.67:41289, user_credentials={real_user=slave}} blocked reactor thread for 52299.9us
I20260203 09:18:15.163954 31296 raft_consensus.cc:2468] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 1.
I20260203 09:18:15.161337 32075 leader_election.cc:290] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:15.167073 31367 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:15.167698 31367 raft_consensus.cc:3060] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:18:15.171406 31341 leader_election.cc:304] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:15.172292 32075 raft_consensus.cc:2804] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:15.172636 32075 raft_consensus.cc:493] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:15.172992 32075 raft_consensus.cc:3060] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
W20260203 09:18:15.177225 31267 leader_election.cc:336] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
W20260203 09:18:15.177805 31267 leader_election.cc:336] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:15.180073 32119 raft_consensus.cc:515] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:15.182204 32119 leader_election.cc:290] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:15.183265 32075 raft_consensus.cc:515] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:15.187331 31123 catalog_manager.cc:5654] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 1 to 2, leader changed from d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65) to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 2 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:15.190320 31367 raft_consensus.cc:2468] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 4.
W20260203 09:18:15.191143 31416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:45019, user_credentials={real_user=slave}} blocked reactor thread for 101505us
I20260203 09:18:15.192399 32128 raft_consensus.cc:493] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:15.192939 32128 raft_consensus.cc:515] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:15.194793 32128 leader_election.cc:290] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:15.197839 32019 raft_consensus.cc:493] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:15.198393 32019 raft_consensus.cc:515] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:15.200281 32019 leader_election.cc:290] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:15.200938 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c17aa1880254f13a38a3c550b0894af" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:15.201524 31374 raft_consensus.cc:3060] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:15.202817 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c2f90aaa7514d27a5a15b4fd6f90669" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:15.203428 31444 raft_consensus.cc:2468] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:15.206785 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a68c16f0da84e9683a5121f63b3f22c" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:15.207362 31375 raft_consensus.cc:3060] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:15.209685 31374 raft_consensus.cc:2468] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 2.
I20260203 09:18:15.210528 32075 leader_election.cc:290] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:15.210623 31264 leader_election.cc:304] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:15.215034 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee25c6a8d94e49a2a9a5646d493c1bde" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:15.215413 32156 raft_consensus.cc:2804] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:18:15.215673 31444 raft_consensus.cc:3060] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:15.215996 32156 raft_consensus.cc:697] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 4 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:15.216897 32156 consensus_queue.cc:237] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:15.218859 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93cc0a94606149e18c8764e851f4b826" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:15.219431 31296 raft_consensus.cc:3060] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:15.221184 31413 leader_election.cc:304] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters:
I20260203 09:18:15.222076 32157 raft_consensus.cc:2804] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:15.223227 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b92ba54a16143c08cfa7303819aa929" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:15.223850 31449 raft_consensus.cc:2468] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 1.
I20260203 09:18:15.225018 31375 raft_consensus.cc:2468] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 2.
I20260203 09:18:15.226203 31296 raft_consensus.cc:2468] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 2.
I20260203 09:18:15.226506 31444 raft_consensus.cc:2468] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 2.
W20260203 09:18:15.229053 31341 leader_election.cc:336] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:15.232621 31341 leader_election.cc:304] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:15.233150 31413 leader_election.cc:304] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters:
I20260203 09:18:15.223167 31416 leader_election.cc:304] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:15.223970 32157 raft_consensus.cc:697] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
W20260203 09:18:15.233685 31267 leader_election.cc:336] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:15.234697 32075 raft_consensus.cc:2804] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:15.235280 32075 raft_consensus.cc:697] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Becoming Leader. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:15.235077 32157 consensus_queue.cc:237] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:15.236296 32075 consensus_queue.cc:237] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:15.239029 32019 raft_consensus.cc:2804] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:15.239624 32019 raft_consensus.cc:697] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:15.240571 32019 consensus_queue.cc:237] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
W20260203 09:18:15.244481 31341 leader_election.cc:336] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:15.244813 32146 raft_consensus.cc:2804] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260203 09:18:15.245118 31341 leader_election.cc:336] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:15.245376 32146 raft_consensus.cc:493] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting leader election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
W20260203 09:18:15.244978 31416 leader_election.cc:336] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:15.245949 32146 raft_consensus.cc:3060] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:15.246124 31341 leader_election.cc:304] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:15.253121 32119 raft_consensus.cc:2804] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:15.253679 32119 raft_consensus.cc:697] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Becoming Leader. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:15.254592 32119 consensus_queue.cc:237] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
W20260203 09:18:15.258273 27553 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 31247)
I20260203 09:18:15.262460 31118 catalog_manager.cc:5654] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 1 to 2, leader changed from d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65) to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 2 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:15.262463 31123 catalog_manager.cc:5654] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 3 to 4, leader changed from d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65) to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 4 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:15.281924 31267 leader_election.cc:304] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:15.283106 32029 raft_consensus.cc:2804] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:15.283504 32029 raft_consensus.cc:493] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:15.283859 32029 raft_consensus.cc:3060] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:15.291512 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b92ba54a16143c08cfa7303819aa929" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:15.292354 31296 raft_consensus.cc:2468] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 1.
I20260203 09:18:15.294168 32146 raft_consensus.cc:515] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:15.296216 32146 leader_election.cc:290] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
W20260203 09:18:15.300238 31416 leader_election.cc:336] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
W20260203 09:18:15.301414 31416 leader_election.cc:336] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:15.301903 31267 leader_election.cc:304] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:15.303025 32029 raft_consensus.cc:515] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:15.303920 32156 raft_consensus.cc:2804] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:15.310139 32156 raft_consensus.cc:493] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:15.310550 32156 raft_consensus.cc:3060] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:15.311077 31123 catalog_manager.cc:5654] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 1 to 2, leader changed from d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65) to 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67). New cstate: current_term: 2 leader_uuid: "73bf755165c4487c81c67b5ab44f7104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:15.303411 31118 catalog_manager.cc:5654] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 1 to 2, leader changed from d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65) to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 2 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:15.308023 31292 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8301405e2ead406caa7440c0337df77d" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:15.314406 31292 raft_consensus.cc:3060] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:15.318607 32156 raft_consensus.cc:515] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:15.322602 31416 leader_election.cc:304] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:15.324283 32156 leader_election.cc:290] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:15.324997 32157 raft_consensus.cc:2804] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260203 09:18:15.325398 32157 raft_consensus.cc:493] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting leader election (detected failure of leader d44c40c0ed244c4e962a26f9aebea76a)
I20260203 09:18:15.325766 32157 raft_consensus.cc:3060] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:15.328936 32029 leader_election.cc:290] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:15.334035 32157 raft_consensus.cc:515] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:15.338336 31292 raft_consensus.cc:2468] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 3.
W20260203 09:18:15.340085 31416 leader_election.cc:336] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:15.348304 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c2f90aaa7514d27a5a15b4fd6f90669" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:15.348923 31449 raft_consensus.cc:3060] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:15.349342 32157 leader_election.cc:290] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
W20260203 09:18:15.349396 31267 leader_election.cc:336] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:15.350235 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b92ba54a16143c08cfa7303819aa929" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:15.350958 31444 raft_consensus.cc:2393] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 79b10fa125f242419f66b577440e66d0 in current term 2: Already voted for candidate 2bf9aa3533b14841a52177c8cc3130ec in this term.
W20260203 09:18:15.351378 31267 leader_election.cc:336] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:15.353581 31121 catalog_manager.cc:5654] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 1 to 2, leader changed from d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65) to 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67). New cstate: current_term: 2 leader_uuid: "73bf755165c4487c81c67b5ab44f7104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:15.356812 31416 leader_election.cc:304] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:15.357609 32019 raft_consensus.cc:493] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:15.358577 32019 raft_consensus.cc:515] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:15.358949 31449 raft_consensus.cc:2468] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 2.
I20260203 09:18:15.360850 32019 leader_election.cc:290] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:15.362933 32019 raft_consensus.cc:2804] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:18:15.362859 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b062505fb476790c4f06d074d67aa" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:15.364845 31375 raft_consensus.cc:2468] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 3.
I20260203 09:18:15.364984 32019 raft_consensus.cc:697] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [term 3 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:15.365949 31413 leader_election.cc:304] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters:
I20260203 09:18:15.366892 31961 raft_consensus.cc:2804] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:18:15.367218 31961 raft_consensus.cc:493] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:15.367504 31961 raft_consensus.cc:3060] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Advancing to term 4
W20260203 09:18:15.372408 31341 consensus_peers.cc:597] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:15.371248 32019 consensus_queue.cc:237] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:15.377050 31961 raft_consensus.cc:515] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:15.379565 31375 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "247b062505fb476790c4f06d074d67aa" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:15.382579 31375 raft_consensus.cc:3060] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:18:15.393437 31375 raft_consensus.cc:2468] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 4.
I20260203 09:18:15.395627 31413 leader_election.cc:304] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters:
I20260203 09:18:15.397334 32158 raft_consensus.cc:2804] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:18:15.397866 32158 raft_consensus.cc:697] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 4 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:15.398765 32158 consensus_queue.cc:237] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:15.403708 31449 raft_consensus.cc:1275] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Refusing update from remote peer 73bf755165c4487c81c67b5ab44f7104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260203 09:18:15.379427 31416 leader_election.cc:336] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:15.405720 32119 consensus_queue.cc:1048] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:15.382521 31961 leader_election.cc:290] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 4 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:15.418829 31292 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b92ba54a16143c08cfa7303819aa929" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:15.419664 31292 raft_consensus.cc:2393] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2bf9aa3533b14841a52177c8cc3130ec in current term 2: Already voted for candidate 79b10fa125f242419f66b577440e66d0 in this term.
I20260203 09:18:15.433326 31267 leader_election.cc:304] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b10fa125f242419f66b577440e66d0; no voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:15.435111 31444 raft_consensus.cc:1275] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Refusing update from remote peer 79b10fa125f242419f66b577440e66d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:15.435626 31267 leader_election.cc:304] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:15.436811 31965 raft_consensus.cc:2749] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260203 09:18:15.439201 32156 raft_consensus.cc:2804] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:15.435860 31118 catalog_manager.cc:5654] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 2 to 3, leader changed from d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65) to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 3 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:15.439713 32156 raft_consensus.cc:697] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [term 2 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:15.442919 32156 consensus_queue.cc:237] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:15.447894 32029 raft_consensus.cc:493] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:15.450155 32029 raft_consensus.cc:515] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:15.452313 32029 leader_election.cc:290] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:15.468930 31118 catalog_manager.cc:5654] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 1 to 2, leader changed from d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65) to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 2 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:15.471208 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14fd7c3d313847f591177ebba8df09c4" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec" is_pre_election: true
I20260203 09:18:15.471774 31444 raft_consensus.cc:2468] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 3.
W20260203 09:18:15.473548 31267 leader_election.cc:336] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:15.475807 31267 leader_election.cc:304] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:15.477103 31375 raft_consensus.cc:1275] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Refusing update from remote peer 2bf9aa3533b14841a52177c8cc3130ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:15.467901 32156 consensus_queue.cc:1048] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260203 09:18:15.477777 32169 raft_consensus.cc:2804] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:18:15.478170 32169 raft_consensus.cc:493] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:15.477610 31121 catalog_manager.cc:5654] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:15.478472 32169 raft_consensus.cc:3060] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:18:15.480890 32019 consensus_queue.cc:1048] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:18:15.486421 32169 raft_consensus.cc:515] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:15.488536 32169 leader_election.cc:290] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 4 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
W20260203 09:18:15.476430 31416 leader_election.cc:336] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:15.489372 31416 leader_election.cc:304] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec; no voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:15.490039 32158 raft_consensus.cc:2749] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260203 09:18:15.490934 31416 leader_election.cc:336] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
W20260203 09:18:15.495486 31267 leader_election.cc:336] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
W20260203 09:18:15.499895 31416 leader_election.cc:336] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
W20260203 09:18:15.507850 31416 consensus_peers.cc:597] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260203 09:18:15.509538 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14fd7c3d313847f591177ebba8df09c4" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:15.510208 31444 raft_consensus.cc:3060] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:18:15.520917 31444 raft_consensus.cc:2468] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 4.
W20260203 09:18:15.525081 31416 consensus_peers.cc:597] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:15.525888 31267 leader_election.cc:304] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:15.526753 32156 raft_consensus.cc:2804] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:18:15.527249 32156 raft_consensus.cc:697] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 4 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:15.528077 32156 consensus_queue.cc:237] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
W20260203 09:18:15.560920 31267 consensus_peers.cc:597] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:15.561455 31267 consensus_peers.cc:597] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:15.582262 31267 consensus_peers.cc:597] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:15.590503 31416 consensus_peers.cc:597] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260203 09:18:15.592013 31118 catalog_manager.cc:5654] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 1 to 4, leader changed from d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65) to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 4 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } }
W20260203 09:18:15.609117 31341 consensus_peers.cc:597] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:15.624255 31267 consensus_peers.cc:597] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260203 09:18:15.625851 32157 raft_consensus.cc:493] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:15.626412 32157 raft_consensus.cc:515] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:15.627794 31375 raft_consensus.cc:1275] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 4 FOLLOWER]: Refusing update from remote peer 79b10fa125f242419f66b577440e66d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260203 09:18:15.628367 32157 leader_election.cc:290] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:15.629130 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3abbec594ab143a1ade1030741cf9e7d" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:15.629427 32156 consensus_queue.cc:1048] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260203 09:18:15.633970 31416 leader_election.cc:336] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:15.636245 31296 raft_consensus.cc:2468] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 3.
I20260203 09:18:15.637404 31416 leader_election.cc:304] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:15.638144 31961 raft_consensus.cc:2804] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260203 09:18:15.638475 31961 raft_consensus.cc:493] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:15.638739 31961 raft_consensus.cc:3060] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:18:15.645430 31961 raft_consensus.cc:515] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:15.648394 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3abbec594ab143a1ade1030741cf9e7d" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:15.648981 31296 raft_consensus.cc:3060] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:18:15.649303 31961 leader_election.cc:290] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 4 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:15.654147 31367 raft_consensus.cc:1275] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Refusing update from remote peer 2bf9aa3533b14841a52177c8cc3130ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:15.656113 31449 raft_consensus.cc:1275] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Refusing update from remote peer 73bf755165c4487c81c67b5ab44f7104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:15.658532 32075 consensus_queue.cc:1048] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:15.658900 31961 consensus_queue.cc:1048] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260203 09:18:15.659953 31416 leader_election.cc:336] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:15.668977 31296 raft_consensus.cc:2468] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 4.
I20260203 09:18:15.670234 31416 leader_election.cc:304] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:15.670981 31961 raft_consensus.cc:2804] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:18:15.671976 31961 raft_consensus.cc:697] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 4 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:15.672886 31961 consensus_queue.cc:237] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
W20260203 09:18:15.695648 31416 consensus_peers.cc:597] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:15.705739 31341 consensus_peers.cc:597] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:15.716847 31296 raft_consensus.cc:1275] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Refusing update from remote peer 73bf755165c4487c81c67b5ab44f7104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:15.718598 32119 consensus_queue.cc:1048] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260203 09:18:15.726909 31267 consensus_peers.cc:597] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:15.740160 31267 consensus_peers.cc:597] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:15.740700 31267 consensus_peers.cc:597] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:15.763094 31416 consensus_peers.cc:597] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:15.763862 31341 consensus_peers.cc:597] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:15.790210 31375 raft_consensus.cc:1275] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Refusing update from remote peer 2bf9aa3533b14841a52177c8cc3130ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:15.791590 31961 consensus_queue.cc:1048] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:15.811903 31123 catalog_manager.cc:5654] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 1 to 4, leader changed from d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65) to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 4 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } }
W20260203 09:18:15.826649 31416 consensus_peers.cc:597] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:15.833338 31267 consensus_peers.cc:597] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:15.852030 31267 consensus_peers.cc:597] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:15.872354 31416 consensus_peers.cc:597] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:15.879753 31375 raft_consensus.cc:1275] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [term 4 FOLLOWER]: Refusing update from remote peer 2bf9aa3533b14841a52177c8cc3130ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260203 09:18:15.881131 31961 consensus_queue.cc:1048] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260203 09:18:15.887941 31416 consensus_peers.cc:597] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:15.903823 31267 consensus_peers.cc:597] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:15.906980 31416 consensus_peers.cc:597] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260203 09:18:15.907456 31449 raft_consensus.cc:1275] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Refusing update from remote peer 79b10fa125f242419f66b577440e66d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:15.910180 32156 consensus_queue.cc:1048] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:15.925900 31961 raft_consensus.cc:493] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:18:15.925982 31267 consensus_peers.cc:597] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260203 09:18:15.926389 31961 raft_consensus.cc:515] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:15.928120 31961 leader_election.cc:290] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:15.929447 31367 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:15.930104 31367 raft_consensus.cc:2468] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 4.
I20260203 09:18:15.931244 31413 leader_election.cc:304] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters:
I20260203 09:18:15.932107 32157 raft_consensus.cc:2804] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260203 09:18:15.932478 32157 raft_consensus.cc:493] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:15.932804 32157 raft_consensus.cc:3060] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:18:15.942840 32157 raft_consensus.cc:515] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
W20260203 09:18:15.957780 31267 consensus_peers.cc:597] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:15.982749 31267 consensus_peers.cc:597] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:15.973156 31341 consensus_peers.cc:597] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260203 09:18:15.990505 31296 raft_consensus.cc:1275] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Refusing update from remote peer 2bf9aa3533b14841a52177c8cc3130ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:18:15.992517 32157 leader_election.cc:290] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 5 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
W20260203 09:18:15.994006 31416 leader_election.cc:336] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:15.994478 31369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:15.996243 31369 raft_consensus.cc:3060] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:18:16.014858 32158 consensus_queue.cc:1048] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260203 09:18:16.018030 31369 raft_consensus.cc:2468] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 5.
I20260203 09:18:16.020210 31413 leader_election.cc:304] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters:
I20260203 09:18:16.021693 32157 raft_consensus.cc:2804] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 5 FOLLOWER]: Leader election won for term 5
I20260203 09:18:16.022843 32157 raft_consensus.cc:697] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 5 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:16.023702 32157 consensus_queue.cc:237] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
W20260203 09:18:16.039884 31416 leader_election.cc:336] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:16.045065 31118 catalog_manager.cc:5654] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 2 to 5, leader changed from d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65) to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 5 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } }
W20260203 09:18:16.082551 31341 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111) [suppressed 233 similar messages]
I20260203 09:18:16.103765 31448 raft_consensus.cc:1275] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 4 FOLLOWER]: Refusing update from remote peer 79b10fa125f242419f66b577440e66d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260203 09:18:16.105039 31267 consensus_peers.cc:597] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260203 09:18:16.112588 32169 consensus_queue.cc:1048] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260203 09:18:16.118391 31341 consensus_peers.cc:597] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260203 09:18:16.148152 31296 raft_consensus.cc:1275] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 4 FOLLOWER]: Refusing update from remote peer 2bf9aa3533b14841a52177c8cc3130ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260203 09:18:16.149835 32157 consensus_queue.cc:1048] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260203 09:18:16.156805 31267 consensus_peers.cc:597] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:16.189517 31416 consensus_peers.cc:597] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:16.212720 31416 consensus_peers.cc:597] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:16.231007 31267 consensus_peers.cc:597] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:16.258773 27553 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 31247)
W20260203 09:18:16.264626 31416 consensus_peers.cc:597] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260203 09:18:16.580633 31375 raft_consensus.cc:1275] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 5 FOLLOWER]: Refusing update from remote peer 2bf9aa3533b14841a52177c8cc3130ec: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260203 09:18:16.582317 32157 consensus_queue.cc:1048] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260203 09:18:16.648958 31416 consensus_peers.cc:597] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:16.696798 32156 raft_consensus.cc:493] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:16.697351 32156 raft_consensus.cc:515] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:16.702312 31369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9884e996f0443f2ae2ab5606633ce3c" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104" is_pre_election: true
I20260203 09:18:16.703032 31369 raft_consensus.cc:2468] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 2.
I20260203 09:18:16.705768 31264 leader_election.cc:304] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:16.706607 32130 raft_consensus.cc:2804] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:18:16.707000 32130 raft_consensus.cc:493] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:16.707319 32130 raft_consensus.cc:3060] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:18:16.716342 31267 leader_election.cc:336] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:16.726750 32156 leader_election.cc:290] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:16.735265 32130 raft_consensus.cc:515] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:16.738161 32130 leader_election.cc:290] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:16.738407 31369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9884e996f0443f2ae2ab5606633ce3c" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:16.739080 31369 raft_consensus.cc:3060] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:18:16.743460 31267 leader_election.cc:336] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:16.747501 31369 raft_consensus.cc:2468] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 3.
I20260203 09:18:16.748682 31264 leader_election.cc:304] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:16.749810 32130 raft_consensus.cc:2804] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:18:16.750304 32130 raft_consensus.cc:697] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 3 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:16.751118 32130 consensus_queue.cc:237] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:16.769681 31118 catalog_manager.cc:5654] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 1 to 3, leader changed from d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65) to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 3 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } }
W20260203 09:18:16.975977 31416 consensus_peers.cc:597] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:16.978255 31341 consensus_peers.cc:597] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:16.987103 31416 consensus_peers.cc:597] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:17.175263 31267 consensus_peers.cc:597] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:17.182325 31341 consensus_peers.cc:597] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260203 09:18:17.219393 31375 raft_consensus.cc:1275] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Refusing update from remote peer 79b10fa125f242419f66b577440e66d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260203 09:18:17.220561 32156 consensus_queue.cc:1048] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260203 09:18:17.259280 27553 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 31247)
W20260203 09:18:17.310030 32192 log.cc:927] Time spent T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
W20260203 09:18:17.356513 31267 consensus_peers.cc:597] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:17.403548 31416 consensus_peers.cc:597] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:17.407727 31267 consensus_peers.cc:597] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260203 09:18:17.433547 32019 raft_consensus.cc:493] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:17.434087 32019 raft_consensus.cc:515] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:17.437170 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b92ba54a16143c08cfa7303819aa929" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0" is_pre_election: true
I20260203 09:18:17.437826 31296 raft_consensus.cc:2468] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 2.
I20260203 09:18:17.435900 32019 leader_election.cc:290] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:17.440285 31416 leader_election.cc:304] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters:
W20260203 09:18:17.442158 31416 leader_election.cc:336] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
I20260203 09:18:17.443493 32019 raft_consensus.cc:2804] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260203 09:18:17.443948 32019 raft_consensus.cc:493] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:17.444315 32019 raft_consensus.cc:3060] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:17.457772 32019 raft_consensus.cc:515] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:17.499449 32019 leader_election.cc:290] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 election: Requested vote from peers d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:17.502702 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0b92ba54a16143c08cfa7303819aa929" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:17.505201 31296 raft_consensus.cc:3060] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:18:17.504392 31416 leader_election.cc:336] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111)
W20260203 09:18:17.513147 31416 consensus_peers.cc:597] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260203 09:18:17.513839 31296 raft_consensus.cc:2468] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 3.
I20260203 09:18:17.515815 31416 leader_election.cc:304] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters: d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:17.517715 32019 raft_consensus.cc:2804] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:18:17.518460 32019 raft_consensus.cc:697] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:17.519210 32019 consensus_queue.cc:237] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:17.538596 31118 catalog_manager.cc:5654] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 1 to 3, leader changed from d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65) to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 3 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } }
W20260203 09:18:17.756278 31416 consensus_peers.cc:597] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:17.843724 31416 consensus_peers.cc:597] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:17.925802 31416 consensus_peers.cc:597] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:18.002820 31341 consensus_peers.cc:597] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:18.011294 31267 consensus_peers.cc:597] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:18.011953 31416 consensus_peers.cc:597] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:18.026134 31416 consensus_peers.cc:597] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:18.067593 31416 consensus_peers.cc:597] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:18.084614 31267 consensus_peers.cc:597] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260203 09:18:18.107112 31296 raft_consensus.cc:1275] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Refusing update from remote peer 2bf9aa3533b14841a52177c8cc3130ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260203 09:18:18.122931 32198 consensus_queue.cc:1048] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260203 09:18:18.136390 31341 consensus_peers.cc:597] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:18.221045 31267 consensus_peers.cc:597] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:18.224545 31341 consensus_peers.cc:597] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:18.245580 31416 consensus_peers.cc:597] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:18.259797 27553 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 31247)
W20260203 09:18:18.272540 31341 consensus_peers.cc:597] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:18.280831 31416 consensus_peers.cc:597] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:18.304803 31267 consensus_peers.cc:597] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:18.337599 31267 consensus_peers.cc:597] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:18.349959 31267 consensus_peers.cc:597] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:18.380178 31267 consensus_peers.cc:597] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:18.387406 31267 consensus_peers.cc:597] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:18.425899 31267 consensus_peers.cc:597] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:18.473567 31267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.65:45511, user_credentials={real_user=slave}} blocked reactor thread for 47714.6us
W20260203 09:18:18.494365 31267 consensus_peers.cc:597] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:18.496927 31416 consensus_peers.cc:597] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:18.509083 31341 consensus_peers.cc:597] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:18.525923 31416 consensus_peers.cc:597] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:18.538550 31267 consensus_peers.cc:597] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:18.553875 31267 consensus_peers.cc:597] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:18.559609 31267 consensus_peers.cc:597] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:18.588976 31416 consensus_peers.cc:597] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:18.604537 31267 consensus_peers.cc:597] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:18.612911 31267 consensus_peers.cc:597] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:18.657426 31416 consensus_peers.cc:597] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:18.658233 31267 consensus_peers.cc:597] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:18.919916 31341 consensus_peers.cc:597] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:19.052388 31416 consensus_peers.cc:597] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:19.247277 31416 consensus_peers.cc:597] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:19.260339 27553 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 31247)
W20260203 09:18:19.305151 31416 consensus_peers.cc:597] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:19.634748 31416 consensus_peers.cc:597] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:19.638371 31267 consensus_peers.cc:597] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:19.674907 31416 consensus_peers.cc:597] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:19.704473 31341 consensus_peers.cc:597] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:19.712280 31341 consensus_peers.cc:597] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:19.718374 31267 consensus_peers.cc:597] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:19.914748 31267 consensus_peers.cc:597] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:20.221864 31416 consensus_peers.cc:597] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:20.260875 27553 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 31247)
W20260203 09:18:20.325875 31416 consensus_peers.cc:597] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:20.407127 31416 consensus_peers.cc:597] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:20.485576 31416 consensus_peers.cc:597] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:20.537128 31341 consensus_peers.cc:597] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:20.588183 31267 consensus_peers.cc:597] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:20.589335 31416 consensus_peers.cc:597] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:20.606875 31267 consensus_peers.cc:597] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:20.609408 31416 consensus_peers.cc:597] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260203 09:18:20.610047 31416 consensus_peers.cc:597] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:20.616681 31267 consensus_peers.cc:597] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:20.629890 31267 consensus_peers.cc:597] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:20.666513 31341 consensus_peers.cc:597] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:20.681104 31267 consensus_peers.cc:597] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:20.701295 31267 consensus_peers.cc:597] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:20.732527 31267 consensus_peers.cc:597] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:20.825745 31341 consensus_peers.cc:597] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:20.872476 31267 consensus_peers.cc:597] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:20.898178 31416 consensus_peers.cc:597] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:20.910851 31267 consensus_peers.cc:597] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:20.932195 31341 consensus_peers.cc:597] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:20.961778 31341 consensus_peers.cc:597] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:20.971807 31267 consensus_peers.cc:597] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:20.992288 31267 consensus_peers.cc:597] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:21.016111 31416 consensus_peers.cc:597] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:21.080695 31267 consensus_peers.cc:597] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:21.083341 31267 consensus_peers.cc:597] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:21.083807 31416 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111) [suppressed 446 similar messages]
W20260203 09:18:21.086359 31416 consensus_peers.cc:597] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:21.190997 31267 consensus_peers.cc:597] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:21.238996 31267 consensus_peers.cc:597] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:21.254195 31416 consensus_peers.cc:597] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:21.261422 27553 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 31247)
W20260203 09:18:21.271786 31267 consensus_peers.cc:597] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:21.275902 31416 consensus_peers.cc:597] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:21.513927 31341 consensus_peers.cc:597] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:21.633847 31416 consensus_peers.cc:597] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:21.724354 31416 consensus_peers.cc:597] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:21.771625 31416 consensus_peers.cc:597] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:21.777823 31416 consensus_peers.cc:597] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:21.888055 31416 consensus_peers.cc:597] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260203 09:18:22.014535 27553 tablet_server.cc:195] TabletServer@127.26.232.65:0 shutdown complete.
I20260203 09:18:22.096078 27553 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 09:18:22.106477 32224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:18:22.106694 32227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:18:22.107488 32225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:18:22.109351 27553 server_base.cc:1060] running on GCE node
I20260203 09:18:22.113827 27553 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260203 09:18:22.114117 27553 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260203 09:18:22.114329 27553 hybrid_clock.cc:648] HybridClock initialized: now 1770110302114310 us; error 0 us; skew 500 ppm
I20260203 09:18:22.115061 27553 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260203 09:18:22.117954 27553 webserver.cc:492] Webserver started at http://127.26.232.65:37223/ using document root <none> and password file <none>
I20260203 09:18:22.118484 27553 fs_manager.cc:362] Metadata directory not provided
I20260203 09:18:22.118683 27553 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260203 09:18:22.124352 27553 fs_manager.cc:714] Time spent opening directory manager: real 0.005s user 0.006s sys 0.000s
W20260203 09:18:22.130270 31416 consensus_peers.cc:597] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260203 09:18:22.132962 32232 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 09:18:22.133971 27553 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260203 09:18:22.134325 27553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/ts-0-root
uuid: "d44c40c0ed244c4e962a26f9aebea76a"
format_stamp: "Formatted at 2026-02-03 09:17:57 on dist-test-slave-x12j"
W20260203 09:18:22.134773 31341 consensus_peers.cc:597] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260203 09:18:22.134721 27553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1770110140020880-27553-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 09:18:22.158344 27553 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 09:18:22.162235 27553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 09:18:22.164582 27553 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260203 09:18:22.173282 32239 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260203 09:18:22.194312 31267 consensus_peers.cc:597] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260203 09:18:22.203862 31267 consensus_peers.cc:597] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:22.401190 31341 consensus_peers.cc:597] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260203 09:18:22.440593 27553 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260203 09:18:22.441005 27553 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.271s user 0.011s sys 0.000s
I20260203 09:18:22.441293 27553 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260203 09:18:22.447455 32239 tablet_bootstrap.cc:492] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:22.463646 32239 tablet_bootstrap.cc:492] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:22.464365 32239 tablet_bootstrap.cc:492] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:22.464918 32239 ts_tablet_manager.cc:1403] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.018s user 0.017s sys 0.000s
I20260203 09:18:22.466814 32239 raft_consensus.cc:359] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:22.467280 32239 raft_consensus.cc:740] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:22.467799 32239 consensus_queue.cc:260] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:22.470124 32239 ts_tablet_manager.cc:1434] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.005s user 0.001s sys 0.004s
I20260203 09:18:22.470749 32239 tablet_bootstrap.cc:492] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:22.483402 32239 tablet_bootstrap.cc:492] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:22.484295 32239 tablet_bootstrap.cc:492] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:22.484937 32239 ts_tablet_manager.cc:1403] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.004s
I20260203 09:18:22.488365 32239 raft_consensus.cc:359] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:22.489090 32239 raft_consensus.cc:740] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:22.489672 32239 consensus_queue.cc:260] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:22.491691 32239 ts_tablet_manager.cc:1434] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260203 09:18:22.492563 32239 tablet_bootstrap.cc:492] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:22.509407 32239 tablet_bootstrap.cc:492] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:22.510332 32239 tablet_bootstrap.cc:492] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:22.510957 32239 ts_tablet_manager.cc:1403] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.019s user 0.015s sys 0.000s
I20260203 09:18:22.513257 32239 raft_consensus.cc:359] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:22.513918 32239 raft_consensus.cc:740] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:22.514556 32239 consensus_queue.cc:260] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:22.516444 32239 ts_tablet_manager.cc:1434] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260203 09:18:22.517261 32239 tablet_bootstrap.cc:492] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:22.532577 32239 tablet_bootstrap.cc:492] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260203 09:18:22.533615 32239 tablet_bootstrap.cc:492] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:22.534237 32239 ts_tablet_manager.cc:1403] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.017s user 0.015s sys 0.000s
I20260203 09:18:22.536489 32239 raft_consensus.cc:359] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:22.537364 32239 raft_consensus.cc:740] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:22.537974 32239 consensus_queue.cc:260] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:22.539804 32239 ts_tablet_manager.cc:1434] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260203 09:18:22.540583 32239 tablet_bootstrap.cc:492] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:22.554850 32239 tablet_bootstrap.cc:492] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:22.555776 32239 tablet_bootstrap.cc:492] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:22.556506 32239 ts_tablet_manager.cc:1403] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.016s user 0.012s sys 0.000s
I20260203 09:18:22.558770 32239 raft_consensus.cc:359] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:22.559449 32239 raft_consensus.cc:740] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:22.560111 32239 consensus_queue.cc:260] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:22.561731 32239 ts_tablet_manager.cc:1434] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260203 09:18:22.562378 32239 tablet_bootstrap.cc:492] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:22.574649 32239 tablet_bootstrap.cc:492] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:22.575337 32239 tablet_bootstrap.cc:492] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:22.575824 32239 ts_tablet_manager.cc:1403] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.000s
I20260203 09:18:22.577597 32239 raft_consensus.cc:359] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:22.578143 32239 raft_consensus.cc:740] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:22.578725 32239 consensus_queue.cc:260] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:22.580561 32239 ts_tablet_manager.cc:1434] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260203 09:18:22.581347 32239 tablet_bootstrap.cc:492] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:22.596587 32239 tablet_bootstrap.cc:492] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260203 09:18:22.597807 32239 tablet_bootstrap.cc:492] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:22.598456 32239 ts_tablet_manager.cc:1403] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.017s user 0.016s sys 0.000s
I20260203 09:18:22.600760 32239 raft_consensus.cc:359] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:22.601614 32239 raft_consensus.cc:740] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:22.602304 32239 consensus_queue.cc:260] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:22.604337 32239 ts_tablet_manager.cc:1434] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260203 09:18:22.605180 32239 tablet_bootstrap.cc:492] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
W20260203 09:18:22.636161 31267 consensus_peers.cc:597] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:22.637450 31416 consensus_peers.cc:597] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260203 09:18:22.639441 32239 tablet_bootstrap.cc:492] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260203 09:18:22.640439 32239 tablet_bootstrap.cc:492] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:22.641122 32239 ts_tablet_manager.cc:1403] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.036s user 0.024s sys 0.004s
I20260203 09:18:22.643271 32239 raft_consensus.cc:359] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:22.643851 32239 raft_consensus.cc:740] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:22.644300 32239 consensus_queue.cc:260] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:22.645769 32239 ts_tablet_manager.cc:1434] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260203 09:18:22.646389 32239 tablet_bootstrap.cc:492] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:22.657442 32239 tablet_bootstrap.cc:492] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:22.658095 32239 tablet_bootstrap.cc:492] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:22.658567 32239 ts_tablet_manager.cc:1403] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.002s
I20260203 09:18:22.660181 32239 raft_consensus.cc:359] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:22.660682 32239 raft_consensus.cc:740] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:22.661279 32239 consensus_queue.cc:260] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:22.663465 32239 ts_tablet_manager.cc:1434] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.005s user 0.003s sys 0.002s
I20260203 09:18:22.664460 32239 tablet_bootstrap.cc:492] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:22.688545 27553 ts_tablet_manager.cc:616] Registered 45 tablets
I20260203 09:18:22.690140 27553 ts_tablet_manager.cc:595] Time spent register tablets: real 0.249s user 0.231s sys 0.008s
I20260203 09:18:22.694474 32239 tablet_bootstrap.cc:492] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260203 09:18:22.695694 32239 tablet_bootstrap.cc:492] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:22.696450 32239 ts_tablet_manager.cc:1403] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.032s user 0.017s sys 0.012s
I20260203 09:18:22.699056 32239 raft_consensus.cc:359] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:22.700003 32239 raft_consensus.cc:740] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:22.700897 32239 consensus_queue.cc:260] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:22.703329 32239 ts_tablet_manager.cc:1434] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.007s user 0.001s sys 0.004s
I20260203 09:18:22.704281 32239 tablet_bootstrap.cc:492] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:22.760114 32239 tablet_bootstrap.cc:492] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:22.762923 32239 tablet_bootstrap.cc:492] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:22.763703 32239 ts_tablet_manager.cc:1403] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.060s user 0.014s sys 0.008s
I20260203 09:18:22.766342 32239 raft_consensus.cc:359] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:22.767103 32239 raft_consensus.cc:740] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:22.767922 32239 consensus_queue.cc:260] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:22.770478 32239 ts_tablet_manager.cc:1434] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260203 09:18:22.771349 32239 tablet_bootstrap.cc:492] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:22.790305 32239 tablet_bootstrap.cc:492] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:22.792382 32239 tablet_bootstrap.cc:492] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:22.793177 32239 ts_tablet_manager.cc:1403] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.022s user 0.010s sys 0.008s
I20260203 09:18:22.797381 32239 raft_consensus.cc:359] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:22.798130 32239 raft_consensus.cc:740] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:22.798820 32239 consensus_queue.cc:260] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:22.801113 32239 ts_tablet_manager.cc:1434] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260203 09:18:22.802026 32239 tablet_bootstrap.cc:492] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
W20260203 09:18:22.809093 31416 consensus_peers.cc:597] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260203 09:18:22.818042 32239 tablet_bootstrap.cc:492] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:22.819221 32239 tablet_bootstrap.cc:492] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:22.819990 32239 ts_tablet_manager.cc:1403] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.008s
I20260203 09:18:22.822784 32239 raft_consensus.cc:359] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:22.823577 32239 raft_consensus.cc:740] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:22.824373 32239 consensus_queue.cc:260] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:22.827957 32239 ts_tablet_manager.cc:1434] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.008s user 0.001s sys 0.004s
I20260203 09:18:22.828866 32239 tablet_bootstrap.cc:492] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
W20260203 09:18:22.850920 31416 consensus_peers.cc:597] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260203 09:18:22.856513 32239 tablet_bootstrap.cc:492] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:22.857671 32239 tablet_bootstrap.cc:492] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:22.858381 32239 ts_tablet_manager.cc:1403] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.030s user 0.013s sys 0.004s
I20260203 09:18:22.861112 32239 raft_consensus.cc:359] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:22.861792 32239 raft_consensus.cc:740] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:22.862439 32239 consensus_queue.cc:260] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:22.864575 32239 ts_tablet_manager.cc:1434] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260203 09:18:22.865536 32239 tablet_bootstrap.cc:492] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:22.880543 27553 rpc_server.cc:307] RPC server started. Bound to: 127.26.232.65:45511
I20260203 09:18:22.880683 32315 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.232.65:45511 every 8 connection(s)
I20260203 09:18:22.884425 32239 tablet_bootstrap.cc:492] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260203 09:18:22.885517 32239 tablet_bootstrap.cc:492] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:22.886143 32239 ts_tablet_manager.cc:1403] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.021s user 0.017s sys 0.001s
I20260203 09:18:22.888989 32239 raft_consensus.cc:359] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:22.889811 32239 raft_consensus.cc:740] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:22.890463 32239 consensus_queue.cc:260] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:22.892486 32239 ts_tablet_manager.cc:1434] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260203 09:18:22.893355 32239 tablet_bootstrap.cc:492] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:22.912963 32290 raft_consensus.cc:3060] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 3
I20260203 09:18:22.913314 32289 raft_consensus.cc:3060] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:18:22.933763 32289 pending_rounds.cc:85] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a: Aborting all ops after (but not including) 1
I20260203 09:18:22.934239 32289 pending_rounds.cc:107] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260203 09:18:22.934587 32289 raft_consensus.cc:2889] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260203 09:18:22.946897 32288 raft_consensus.cc:3060] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:18:22.949188 32239 tablet_bootstrap.cc:492] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:22.950209 32239 tablet_bootstrap.cc:492] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:22.950913 32239 ts_tablet_manager.cc:1403] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.058s user 0.016s sys 0.000s
I20260203 09:18:22.956827 32288 pending_rounds.cc:85] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a: Aborting all ops after (but not including) 1
I20260203 09:18:22.957371 32288 pending_rounds.cc:107] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260203 09:18:22.957737 32288 raft_consensus.cc:2889] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260203 09:18:22.958253 32239 raft_consensus.cc:359] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:22.959043 32239 raft_consensus.cc:740] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:22.959722 32239 consensus_queue.cc:260] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:22.966421 32239 ts_tablet_manager.cc:1434] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.015s user 0.006s sys 0.001s
I20260203 09:18:22.967268 32239 tablet_bootstrap.cc:492] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:22.982827 32289 raft_consensus.cc:3060] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:22.985699 32239 tablet_bootstrap.cc:492] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:22.986806 32239 tablet_bootstrap.cc:492] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:22.987435 32239 ts_tablet_manager.cc:1403] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.020s user 0.015s sys 0.001s
I20260203 09:18:22.989728 32239 raft_consensus.cc:359] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:22.990409 32239 raft_consensus.cc:740] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:22.991137 32239 consensus_queue.cc:260] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:22.993513 32239 ts_tablet_manager.cc:1434] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260203 09:18:22.994319 32239 tablet_bootstrap.cc:492] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:23.034183 32317 heartbeater.cc:344] Connected to a master server at 127.26.232.126:40067
I20260203 09:18:23.035297 32317 heartbeater.cc:461] Registering TS with master...
I20260203 09:18:23.048094 32317 heartbeater.cc:507] Master 127.26.232.126:40067 requested a full tablet report, sending...
I20260203 09:18:23.092456 32289 raft_consensus.cc:3060] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 3
I20260203 09:18:23.142629 32285 raft_consensus.cc:3060] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:23.149880 32288 raft_consensus.cc:3060] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Advancing to term 3
W20260203 09:18:23.138116 31416 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.26.232.66:45019, user_credentials={real_user=slave}} blocked reactor thread for 80221.9us
W20260203 09:18:23.151961 31267 consensus_peers.cc:597] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
I20260203 09:18:23.181862 32284 raft_consensus.cc:3060] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: Advancing to term 5
W20260203 09:18:23.187459 31267 consensus_peers.cc:597] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
I20260203 09:18:23.190500 32283 raft_consensus.cc:3060] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 3
I20260203 09:18:23.206019 32282 raft_consensus.cc:3060] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:23.218433 32288 pending_rounds.cc:85] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a: Aborting all ops after (but not including) 1
I20260203 09:18:23.221319 32288 pending_rounds.cc:107] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260203 09:18:23.228078 32288 raft_consensus.cc:2889] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260203 09:18:23.244675 31416 consensus_peers.cc:597] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:23.246088 31416 consensus_peers.cc:597] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
W20260203 09:18:23.253770 31416 consensus_peers.cc:597] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
I20260203 09:18:23.269315 32289 raft_consensus.cc:3060] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:18:23.271528 32239 tablet_bootstrap.cc:492] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.273073 32239 tablet_bootstrap.cc:492] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.274308 32239 ts_tablet_manager.cc:1403] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.280s user 0.027s sys 0.046s
I20260203 09:18:23.250314 32284 pending_rounds.cc:85] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a: Aborting all ops after (but not including) 1
I20260203 09:18:23.275341 32284 pending_rounds.cc:107] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260203 09:18:23.279160 32284 raft_consensus.cc:2889] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260203 09:18:23.281741 32289 pending_rounds.cc:85] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a: Aborting all ops after (but not including) 1
I20260203 09:18:23.281251 32239 raft_consensus.cc:359] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:23.285146 32239 raft_consensus.cc:740] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.290127 32239 consensus_queue.cc:260] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:23.293215 32239 ts_tablet_manager.cc:1434] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.019s user 0.007s sys 0.000s
I20260203 09:18:23.294312 32239 tablet_bootstrap.cc:492] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:23.284885 32289 pending_rounds.cc:107] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260203 09:18:23.297335 32289 raft_consensus.cc:2889] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260203 09:18:23.318679 31118 ts_manager.cc:194] Re-registered known tserver with Master: d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511)
I20260203 09:18:23.330394 32239 tablet_bootstrap.cc:492] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.331561 32239 tablet_bootstrap.cc:492] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.332235 32239 ts_tablet_manager.cc:1403] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.038s user 0.014s sys 0.008s
I20260203 09:18:23.334350 32239 raft_consensus.cc:359] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:23.335064 32239 raft_consensus.cc:740] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.336826 32239 consensus_queue.cc:260] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:23.342866 32239 ts_tablet_manager.cc:1434] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.010s user 0.003s sys 0.004s
I20260203 09:18:23.343173 32283 raft_consensus.cc:3060] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:18:23.345105 32239 tablet_bootstrap.cc:492] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
W20260203 09:18:23.345805 31267 consensus_peers.cc:597] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
I20260203 09:18:23.368561 32239 tablet_bootstrap.cc:492] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.369369 32239 tablet_bootstrap.cc:492] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.369895 32239 ts_tablet_manager.cc:1403] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.026s user 0.011s sys 0.012s
I20260203 09:18:23.371909 31118 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50930
I20260203 09:18:23.371845 32239 raft_consensus.cc:359] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:23.372391 32239 raft_consensus.cc:740] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.373001 32239 consensus_queue.cc:260] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:23.374967 32239 ts_tablet_manager.cc:1434] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260203 09:18:23.375603 32239 tablet_bootstrap.cc:492] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:23.376089 32317 heartbeater.cc:499] Master 127.26.232.126:40067 was elected leader, sending a full tablet report...
W20260203 09:18:23.386396 31267 consensus_peers.cc:597] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
I20260203 09:18:23.390853 32239 tablet_bootstrap.cc:492] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.391867 32239 tablet_bootstrap.cc:492] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.392457 32239 ts_tablet_manager.cc:1403] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.017s user 0.013s sys 0.000s
I20260203 09:18:23.394470 32239 raft_consensus.cc:359] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:23.394974 32239 raft_consensus.cc:740] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.395515 32239 consensus_queue.cc:260] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:23.397202 32239 ts_tablet_manager.cc:1434] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260203 09:18:23.397818 32239 tablet_bootstrap.cc:492] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:23.410130 32239 tablet_bootstrap.cc:492] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.411005 32239 tablet_bootstrap.cc:492] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.411633 32239 ts_tablet_manager.cc:1403] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.000s
I20260203 09:18:23.413806 32239 raft_consensus.cc:359] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:23.414269 32239 raft_consensus.cc:740] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.414809 32239 consensus_queue.cc:260] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:23.416468 32239 ts_tablet_manager.cc:1434] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260203 09:18:23.417124 32239 tablet_bootstrap.cc:492] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
W20260203 09:18:23.425655 31267 consensus_peers.cc:597] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
W20260203 09:18:23.430050 31341 consensus_peers.cc:597] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
I20260203 09:18:23.433385 32239 tablet_bootstrap.cc:492] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.434173 32239 tablet_bootstrap.cc:492] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.434845 32239 ts_tablet_manager.cc:1403] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.018s user 0.014s sys 0.000s
I20260203 09:18:23.437060 32239 raft_consensus.cc:359] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:23.437542 32239 raft_consensus.cc:740] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.438146 32239 consensus_queue.cc:260] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:23.439777 32239 ts_tablet_manager.cc:1434] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260203 09:18:23.441193 32239 tablet_bootstrap.cc:492] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:23.454896 32239 tablet_bootstrap.cc:492] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.455906 32239 tablet_bootstrap.cc:492] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.456576 32239 ts_tablet_manager.cc:1403] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.016s user 0.011s sys 0.000s
I20260203 09:18:23.459018 32239 raft_consensus.cc:359] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:23.459707 32239 raft_consensus.cc:740] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.460378 32239 consensus_queue.cc:260] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:23.462567 32239 ts_tablet_manager.cc:1434] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260203 09:18:23.464583 32239 tablet_bootstrap.cc:492] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:23.464948 32283 raft_consensus.cc:3060] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 3
W20260203 09:18:23.473847 31341 consensus_peers.cc:597] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260203 09:18:23.482405 32239 tablet_bootstrap.cc:492] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.483420 32239 tablet_bootstrap.cc:492] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.484344 32239 ts_tablet_manager.cc:1403] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.020s user 0.015s sys 0.003s
W20260203 09:18:23.484613 31267 consensus_peers.cc:597] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
I20260203 09:18:23.487305 32239 raft_consensus.cc:359] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:23.487989 32239 raft_consensus.cc:740] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.488684 32239 consensus_queue.cc:260] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:23.491187 32239 ts_tablet_manager.cc:1434] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260203 09:18:23.493386 32239 tablet_bootstrap.cc:492] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
W20260203 09:18:23.515480 31341 consensus_peers.cc:597] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
I20260203 09:18:23.517343 32239 tablet_bootstrap.cc:492] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.518317 32239 tablet_bootstrap.cc:492] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.518925 32239 ts_tablet_manager.cc:1403] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.026s user 0.017s sys 0.004s
I20260203 09:18:23.521215 32239 raft_consensus.cc:359] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:23.523121 32239 raft_consensus.cc:740] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.523820 32239 consensus_queue.cc:260] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:23.525520 32239 ts_tablet_manager.cc:1434] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260203 09:18:23.526151 32239 tablet_bootstrap.cc:492] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:23.546638 32239 tablet_bootstrap.cc:492] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.547385 32239 tablet_bootstrap.cc:492] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.548051 32239 ts_tablet_manager.cc:1403] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.022s user 0.010s sys 0.004s
I20260203 09:18:23.551132 32239 raft_consensus.cc:359] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:23.551801 32239 raft_consensus.cc:740] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.552531 32239 consensus_queue.cc:260] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:23.554739 32239 ts_tablet_manager.cc:1434] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260203 09:18:23.555891 32239 tablet_bootstrap.cc:492] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:23.579514 32239 tablet_bootstrap.cc:492] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.580530 32239 tablet_bootstrap.cc:492] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.582990 32239 ts_tablet_manager.cc:1403] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.027s user 0.015s sys 0.008s
I20260203 09:18:23.585513 32239 raft_consensus.cc:359] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:23.588960 32239 raft_consensus.cc:740] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.589659 32239 consensus_queue.cc:260] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:23.591825 32239 ts_tablet_manager.cc:1434] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.009s user 0.004s sys 0.000s
I20260203 09:18:23.593542 32239 tablet_bootstrap.cc:492] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
W20260203 09:18:23.609234 31267 consensus_peers.cc:597] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
I20260203 09:18:23.611521 32239 tablet_bootstrap.cc:492] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.612536 32239 tablet_bootstrap.cc:492] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.613217 32239 ts_tablet_manager.cc:1403] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.020s user 0.009s sys 0.007s
I20260203 09:18:23.615653 32239 raft_consensus.cc:359] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:23.616291 32239 raft_consensus.cc:740] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.616906 32239 consensus_queue.cc:260] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:23.619161 32239 ts_tablet_manager.cc:1434] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260203 09:18:23.619956 32239 tablet_bootstrap.cc:492] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:23.633538 32239 tablet_bootstrap.cc:492] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.634466 32239 tablet_bootstrap.cc:492] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.635216 32239 ts_tablet_manager.cc:1403] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.003s
I20260203 09:18:23.637753 32239 raft_consensus.cc:359] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:23.638332 32239 raft_consensus.cc:740] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.638928 32239 consensus_queue.cc:260] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:23.641060 32239 ts_tablet_manager.cc:1434] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.006s user 0.007s sys 0.001s
W20260203 09:18:23.641292 31267 consensus_peers.cc:597] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 21: this message will repeat every 5th retry.
I20260203 09:18:23.642105 32239 tablet_bootstrap.cc:492] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:23.656473 32239 tablet_bootstrap.cc:492] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.657454 32239 tablet_bootstrap.cc:492] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.658073 32239 ts_tablet_manager.cc:1403] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.005s
I20260203 09:18:23.660368 32239 raft_consensus.cc:359] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:23.661057 32239 raft_consensus.cc:740] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.661767 32239 consensus_queue.cc:260] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:23.664013 32239 ts_tablet_manager.cc:1434] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260203 09:18:23.665145 32239 tablet_bootstrap.cc:492] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:23.685303 32239 tablet_bootstrap.cc:492] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.686123 32239 tablet_bootstrap.cc:492] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.686648 32239 ts_tablet_manager.cc:1403] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.022s user 0.014s sys 0.000s
I20260203 09:18:23.689391 32239 raft_consensus.cc:359] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:23.690995 32239 raft_consensus.cc:740] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.691730 32239 consensus_queue.cc:260] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:23.694291 32239 ts_tablet_manager.cc:1434] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260203 09:18:23.695045 32239 tablet_bootstrap.cc:492] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:23.710665 32239 tablet_bootstrap.cc:492] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.711390 32239 tablet_bootstrap.cc:492] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.711992 32239 ts_tablet_manager.cc:1403] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.017s user 0.012s sys 0.000s
I20260203 09:18:23.714442 32239 raft_consensus.cc:359] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:23.715086 32239 raft_consensus.cc:740] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.715745 32239 consensus_queue.cc:260] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:23.718065 32239 ts_tablet_manager.cc:1434] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260203 09:18:23.720950 32239 tablet_bootstrap.cc:492] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:23.734812 32239 tablet_bootstrap.cc:492] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.735812 32239 tablet_bootstrap.cc:492] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.736462 32239 ts_tablet_manager.cc:1403] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.016s user 0.014s sys 0.000s
I20260203 09:18:23.738679 32239 raft_consensus.cc:359] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:23.739326 32239 raft_consensus.cc:740] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.739941 32239 consensus_queue.cc:260] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:23.742132 32239 ts_tablet_manager.cc:1434] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260203 09:18:23.743700 32239 tablet_bootstrap.cc:492] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:23.758824 32239 tablet_bootstrap.cc:492] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.759666 32239 tablet_bootstrap.cc:492] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.760251 32239 ts_tablet_manager.cc:1403] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.003s
I20260203 09:18:23.762457 32239 raft_consensus.cc:359] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:23.763098 32239 raft_consensus.cc:740] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.763721 32239 consensus_queue.cc:260] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:23.765430 32239 ts_tablet_manager.cc:1434] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.005s user 0.004s sys 0.004s
I20260203 09:18:23.772629 32239 tablet_bootstrap.cc:492] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:23.793560 32239 tablet_bootstrap.cc:492] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.794503 32239 tablet_bootstrap.cc:492] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.795152 32239 ts_tablet_manager.cc:1403] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.027s user 0.011s sys 0.004s
I20260203 09:18:23.798573 32239 raft_consensus.cc:359] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:23.799252 32239 raft_consensus.cc:740] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.799912 32239 consensus_queue.cc:260] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:23.803202 32239 ts_tablet_manager.cc:1434] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.008s user 0.006s sys 0.001s
I20260203 09:18:23.804162 32239 tablet_bootstrap.cc:492] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:23.821800 32239 tablet_bootstrap.cc:492] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.822628 32239 tablet_bootstrap.cc:492] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.823196 32239 ts_tablet_manager.cc:1403] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.019s user 0.013s sys 0.000s
I20260203 09:18:23.825138 32239 raft_consensus.cc:359] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:23.825624 32239 raft_consensus.cc:740] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.826151 32239 consensus_queue.cc:260] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:23.827865 32239 ts_tablet_manager.cc:1434] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260203 09:18:23.829182 32239 tablet_bootstrap.cc:492] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:23.856678 32239 tablet_bootstrap.cc:492] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.857728 32239 tablet_bootstrap.cc:492] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.858407 32239 ts_tablet_manager.cc:1403] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.029s user 0.015s sys 0.009s
I20260203 09:18:23.860910 32239 raft_consensus.cc:359] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:23.862162 32239 raft_consensus.cc:740] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.862886 32239 consensus_queue.cc:260] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:23.869565 32239 ts_tablet_manager.cc:1434] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20260203 09:18:23.872730 32239 tablet_bootstrap.cc:492] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:23.888087 32239 tablet_bootstrap.cc:492] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.888934 32239 tablet_bootstrap.cc:492] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.889590 32239 ts_tablet_manager.cc:1403] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.017s user 0.014s sys 0.000s
I20260203 09:18:23.892006 32239 raft_consensus.cc:359] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:23.892704 32239 raft_consensus.cc:740] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.893332 32239 consensus_queue.cc:260] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:23.895823 32239 ts_tablet_manager.cc:1434] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260203 09:18:23.896613 32239 tablet_bootstrap.cc:492] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:23.910466 32239 tablet_bootstrap.cc:492] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.911197 32239 tablet_bootstrap.cc:492] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.911746 32239 ts_tablet_manager.cc:1403] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.003s
I20260203 09:18:23.913506 32239 raft_consensus.cc:359] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:23.913980 32239 raft_consensus.cc:740] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.914470 32239 consensus_queue.cc:260] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:23.916114 32239 ts_tablet_manager.cc:1434] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260203 09:18:23.917392 32239 tablet_bootstrap.cc:492] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:23.920611 32289 raft_consensus.cc:3060] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:23.932260 32239 tablet_bootstrap.cc:492] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.933480 32239 tablet_bootstrap.cc:492] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.934219 32239 ts_tablet_manager.cc:1403] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.017s user 0.014s sys 0.000s
I20260203 09:18:23.936372 32239 raft_consensus.cc:359] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:23.937074 32239 raft_consensus.cc:740] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.937708 32239 consensus_queue.cc:260] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:23.940316 32239 ts_tablet_manager.cc:1434] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260203 09:18:23.940971 32239 tablet_bootstrap.cc:492] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:23.959661 32239 tablet_bootstrap.cc:492] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260203 09:18:23.960680 32239 tablet_bootstrap.cc:492] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.961318 32239 ts_tablet_manager.cc:1403] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.020s user 0.016s sys 0.000s
I20260203 09:18:23.963405 32239 raft_consensus.cc:359] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:23.964027 32239 raft_consensus.cc:740] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.964560 32239 consensus_queue.cc:260] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:23.966238 32239 ts_tablet_manager.cc:1434] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260203 09:18:23.967856 32239 tablet_bootstrap.cc:492] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:23.983980 32239 tablet_bootstrap.cc:492] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:23.984874 32239 tablet_bootstrap.cc:492] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:23.985637 32239 ts_tablet_manager.cc:1403] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.018s user 0.014s sys 0.002s
I20260203 09:18:23.987941 32239 raft_consensus.cc:359] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:23.988996 32239 raft_consensus.cc:740] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:23.989748 32239 consensus_queue.cc:260] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:23.991377 32239 ts_tablet_manager.cc:1434] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260203 09:18:23.992254 32239 tablet_bootstrap.cc:492] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:24.008150 32289 raft_consensus.cc:3060] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:24.020006 32239 tablet_bootstrap.cc:492] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:24.021179 32239 tablet_bootstrap.cc:492] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:24.021991 32239 ts_tablet_manager.cc:1403] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.030s user 0.015s sys 0.010s
I20260203 09:18:24.025086 32239 raft_consensus.cc:359] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:24.025748 32239 raft_consensus.cc:740] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:24.026378 32239 consensus_queue.cc:260] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:24.028848 32239 ts_tablet_manager.cc:1434] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260203 09:18:24.030045 32239 tablet_bootstrap.cc:492] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap starting.
I20260203 09:18:24.041630 32283 raft_consensus.cc:3060] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:24.075986 32288 raft_consensus.cc:3060] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 3
I20260203 09:18:24.082870 32239 tablet_bootstrap.cc:492] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260203 09:18:24.083900 32239 tablet_bootstrap.cc:492] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a: Bootstrap complete.
I20260203 09:18:24.084599 32239 ts_tablet_manager.cc:1403] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a: Time spent bootstrapping tablet: real 0.055s user 0.015s sys 0.013s
I20260203 09:18:24.087124 32239 raft_consensus.cc:359] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:24.087782 32239 raft_consensus.cc:740] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Initialized, Role: FOLLOWER
I20260203 09:18:24.088430 32239 consensus_queue.cc:260] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:24.090098 32239 ts_tablet_manager.cc:1434] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260203 09:18:24.091439 32289 raft_consensus.cc:3060] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:24.130085 32284 raft_consensus.cc:3060] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:24.135751 32282 raft_consensus.cc:3060] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:24.413967 32284 raft_consensus.cc:3060] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 3
I20260203 09:18:32.892858 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:18:32.947173 31448 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "06460fafee594578bed03068236ad9f2"
dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
mode: GRACEFUL
new_leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:41718
I20260203 09:18:32.947685 31448 raft_consensus.cc:606] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Received request to transfer leadership to TS d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:32.949771 31448 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "20dfe4990e0a46ef9b0cf1cdf3dfdb09"
dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
mode: GRACEFUL
new_leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:41718
I20260203 09:18:32.950186 31448 raft_consensus.cc:606] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 LEADER]: Received request to transfer leadership to TS d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:32.952164 31448 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c"
dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
mode: GRACEFUL
new_leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:41718
I20260203 09:18:32.952709 31448 raft_consensus.cc:606] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 5 LEADER]: Received request to transfer leadership to TS d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:32.965945 31292 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d1d1f5b1c3b64ebaa2824e9136285fbe"
dest_uuid: "79b10fa125f242419f66b577440e66d0"
mode: GRACEFUL
new_leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:35564
I20260203 09:18:32.966486 31292 raft_consensus.cc:606] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 3 LEADER]: Received request to transfer leadership to TS d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:32.970835 31449 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "ec42a05859cf4d5ebe1e1f268d01b3fc"
dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
mode: GRACEFUL
new_leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:41718
I20260203 09:18:32.971438 31449 raft_consensus.cc:606] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Received request to transfer leadership to TS d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:32.973425 31449 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "fc8de34393ac472590f28a52d1bf55ff"
dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
mode: GRACEFUL
new_leader_uuid: "73bf755165c4487c81c67b5ab44f7104"
from {username='slave'} at 127.0.0.1:41718
I20260203 09:18:32.973798 31449 raft_consensus.cc:606] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Received request to transfer leadership to TS 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:32.974609 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260203 09:18:32.975783 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:18:32.976696 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:18:33.285145 32421 raft_consensus.cc:993] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec: : Instructing follower d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:33.286268 32421 raft_consensus.cc:1081] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 5 LEADER]: Signalling peer d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:33.292182 32288 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c"
dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:41278
I20260203 09:18:33.293251 32288 raft_consensus.cc:493] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:33.294539 32288 raft_consensus.cc:3060] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:18:33.307057 32406 raft_consensus.cc:993] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec: : Instructing follower d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:33.309227 32420 raft_consensus.cc:993] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0: : Instructing follower d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:33.309219 32409 raft_consensus.cc:1081] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Signalling peer d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:33.309906 32420 raft_consensus.cc:1081] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 3 LEADER]: Signalling peer d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:33.313102 32284 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "06460fafee594578bed03068236ad9f2"
dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:41278
I20260203 09:18:33.314723 32284 raft_consensus.cc:493] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:33.315079 32284 raft_consensus.cc:3060] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:33.315563 32288 raft_consensus.cc:515] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:33.320617 32283 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d1d1f5b1c3b64ebaa2824e9136285fbe"
dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:41292
I20260203 09:18:33.321283 32283 raft_consensus.cc:493] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:33.321622 32283 raft_consensus.cc:3060] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:18:33.325568 32284 raft_consensus.cc:515] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:33.329658 32288 leader_election.cc:290] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 6 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:33.336728 32421 raft_consensus.cc:993] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec: : Instructing follower d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:33.336345 32284 leader_election.cc:290] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:33.337903 32406 raft_consensus.cc:1081] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 LEADER]: Signalling peer d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:33.342080 32284 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "20dfe4990e0a46ef9b0cf1cdf3dfdb09"
dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:41278
I20260203 09:18:33.343782 32284 raft_consensus.cc:493] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:33.334570 32283 raft_consensus.cc:515] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:33.346078 32284 raft_consensus.cc:3060] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:18:33.346793 32283 leader_election.cc:290] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 4 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:33.362447 32284 raft_consensus.cc:515] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:33.364526 32284 leader_election.cc:290] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 4 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:33.373545 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: true dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:33.374392 31374 raft_consensus.cc:3060] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:18:33.379453 31444 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1d1f5b1c3b64ebaa2824e9136285fbe" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:33.380270 31444 raft_consensus.cc:3060] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:18:33.380674 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58d31844d41c408f9fd7f2cbd1270b6c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: true dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:33.381310 31449 raft_consensus.cc:3055] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 5 LEADER]: Stepping down as leader of term 5
I20260203 09:18:33.381599 31449 raft_consensus.cc:740] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:33.382566 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20dfe4990e0a46ef9b0cf1cdf3dfdb09" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:33.382452 31449 consensus_queue.cc:260] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:33.383246 31450 raft_consensus.cc:3055] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:18:33.383548 31450 raft_consensus.cc:740] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:33.384053 31449 raft_consensus.cc:3060] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 5 FOLLOWER]: Advancing to term 6
I20260203 09:18:33.384419 31450 consensus_queue.cc:260] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:33.386096 31450 raft_consensus.cc:3060] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:18:33.390141 31444 raft_consensus.cc:2468] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 4.
I20260203 09:18:33.391485 31292 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06460fafee594578bed03068236ad9f2" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:33.392184 31292 raft_consensus.cc:3060] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:33.392251 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20dfe4990e0a46ef9b0cf1cdf3dfdb09" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:33.392984 31298 raft_consensus.cc:3060] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:18:33.394879 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1d1f5b1c3b64ebaa2824e9136285fbe" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:33.395537 31296 raft_consensus.cc:3055] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:18:33.395830 31296 raft_consensus.cc:740] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:33.396697 31296 consensus_queue.cc:260] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:33.397135 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06460fafee594578bed03068236ad9f2" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:33.397915 31448 raft_consensus.cc:3055] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:18:33.398074 31296 raft_consensus.cc:3060] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:18:33.398280 31448 raft_consensus.cc:740] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:33.402743 31448 consensus_queue.cc:260] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:33.414808 31448 raft_consensus.cc:3060] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:33.403879 31374 raft_consensus.cc:2468] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 6.
I20260203 09:18:33.406136 31298 raft_consensus.cc:2468] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 4.
I20260203 09:18:33.406594 32236 leader_election.cc:304] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:33.407802 31450 raft_consensus.cc:2468] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 4.
I20260203 09:18:33.409386 31296 raft_consensus.cc:2468] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 4.
I20260203 09:18:33.424007 32233 leader_election.cc:304] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:33.412029 31292 raft_consensus.cc:2468] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 3.
I20260203 09:18:33.428125 31448 raft_consensus.cc:2468] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 3.
I20260203 09:18:33.432938 31449 raft_consensus.cc:2468] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 6.
I20260203 09:18:33.435376 32434 raft_consensus.cc:2804] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:18:33.436578 32421 raft_consensus.cc:993] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec: : Instructing follower 73bf755165c4487c81c67b5ab44f7104 to start an election
I20260203 09:18:33.437207 32421 raft_consensus.cc:1081] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Signalling peer 73bf755165c4487c81c67b5ab44f7104 to start an election
I20260203 09:18:33.439328 31374 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "fc8de34393ac472590f28a52d1bf55ff"
dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
from {username='slave'} at 127.0.0.1:57862
I20260203 09:18:33.439859 31374 raft_consensus.cc:493] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:33.440266 31374 raft_consensus.cc:3060] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:33.441177 32434 raft_consensus.cc:697] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 4 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:33.441857 32433 raft_consensus.cc:2804] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 6 FOLLOWER]: Leader election won for term 6
I20260203 09:18:33.442953 32409 raft_consensus.cc:993] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec: : Instructing follower d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:33.443204 32236 leader_election.cc:304] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:33.444120 32427 raft_consensus.cc:1081] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Signalling peer d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:33.445376 32435 raft_consensus.cc:2804] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:18:33.447968 31374 raft_consensus.cc:515] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:33.452176 32435 raft_consensus.cc:697] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 4 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:33.448637 32283 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "ec42a05859cf4d5ebe1e1f268d01b3fc"
dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:41278
I20260203 09:18:33.452823 32283 raft_consensus.cc:493] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:33.453207 32283 raft_consensus.cc:3060] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:33.453492 32435 consensus_queue.cc:237] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:33.455520 31374 leader_election.cc:290] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:33.460784 32283 raft_consensus.cc:515] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:33.451570 32236 leader_election.cc:304] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:33.470162 31292 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc8de34393ac472590f28a52d1bf55ff" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:33.470863 31292 raft_consensus.cc:3060] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:33.474056 32437 raft_consensus.cc:2804] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:18:33.474689 32437 raft_consensus.cc:697] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 3 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:33.463414 31449 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc8de34393ac472590f28a52d1bf55ff" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:33.449251 32434 consensus_queue.cc:237] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:33.476158 31449 raft_consensus.cc:3055] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:33.476508 31449 raft_consensus.cc:740] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:33.461282 32433 raft_consensus.cc:697] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 6 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:33.477317 31449 consensus_queue.cc:260] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:33.478641 31449 raft_consensus.cc:3060] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:33.479300 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec42a05859cf4d5ebe1e1f268d01b3fc" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:33.479897 31296 raft_consensus.cc:3060] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:33.478174 32433 consensus_queue.cc:237] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:33.475301 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec42a05859cf4d5ebe1e1f268d01b3fc" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:33.483208 31448 raft_consensus.cc:3055] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:18:33.483521 31448 raft_consensus.cc:740] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:33.484192 31448 consensus_queue.cc:260] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:33.474689 32283 leader_election.cc:290] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:33.485268 32437 consensus_queue.cc:237] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:33.485452 31448 raft_consensus.cc:3060] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:33.484402 31292 raft_consensus.cc:2468] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 2.
I20260203 09:18:33.492282 31341 leader_election.cc:304] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:33.493211 32426 raft_consensus.cc:2804] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:33.493646 32426 raft_consensus.cc:697] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Becoming Leader. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:33.492857 31449 raft_consensus.cc:2468] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 2.
I20260203 09:18:33.494532 32426 consensus_queue.cc:237] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:33.504019 31296 raft_consensus.cc:2468] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 3.
I20260203 09:18:33.505170 32236 leader_election.cc:304] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:33.505918 32435 raft_consensus.cc:2804] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:18:33.508277 32435 raft_consensus.cc:697] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 3 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:33.510661 32435 consensus_queue.cc:237] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
W20260203 09:18:33.533273 32438 log.cc:927] Time spent T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a: Append to log took a long time: real 0.057s user 0.001s sys 0.000s
I20260203 09:18:33.528374 31448 raft_consensus.cc:2468] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 3.
I20260203 09:18:33.550189 31123 catalog_manager.cc:5654] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 1 to 2, leader changed from 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68) to 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67). New cstate: current_term: 2 leader_uuid: "73bf755165c4487c81c67b5ab44f7104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:33.565675 31121 catalog_manager.cc:5654] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 3 to 4, leader changed from 79b10fa125f242419f66b577440e66d0 (127.26.232.66) to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 4 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:33.567423 31121 catalog_manager.cc:5654] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 5 to 6, leader changed from 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68) to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 6 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:33.592056 31121 catalog_manager.cc:5654] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 2 to 3, leader changed from 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68) to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 3 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:33.593451 31121 catalog_manager.cc:5654] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 3 to 4, leader changed from 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68) to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 4 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:33.594434 31121 catalog_manager.cc:5654] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 2 to 3, leader changed from 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68) to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 3 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:33.887624 31292 raft_consensus.cc:1275] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:18:33.888882 32433 consensus_queue.cc:1048] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:18:33.892350 31374 raft_consensus.cc:1275] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 6 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260203 09:18:33.893719 32433 consensus_queue.cc:1048] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:18:33.905705 31448 raft_consensus.cc:1275] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:18:33.906069 31296 raft_consensus.cc:1275] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [term 4 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260203 09:18:33.907272 32434 consensus_queue.cc:1048] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:18:33.910282 32437 consensus_queue.cc:1048] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260203 09:18:33.913781 31448 raft_consensus.cc:1275] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 4 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260203 09:18:33.923009 32434 consensus_queue.cc:1048] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:18:33.928884 31450 raft_consensus.cc:1275] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 6 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260203 09:18:33.930472 32437 consensus_queue.cc:1048] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:18:34.012568 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:18:34.026784 31296 raft_consensus.cc:1275] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Refusing update from remote peer 73bf755165c4487c81c67b5ab44f7104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:34.028056 32432 consensus_queue.cc:1048] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:34.031180 31448 raft_consensus.cc:1275] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 4 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260203 09:18:34.032840 32437 consensus_queue.cc:1048] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:18:34.050663 31292 raft_consensus.cc:1275] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 4 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260203 09:18:34.052356 32433 consensus_queue.cc:1048] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:18:34.059887 31450 raft_consensus.cc:1275] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Refusing update from remote peer 73bf755165c4487c81c67b5ab44f7104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:34.059064 31448 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "55ce9fa640064a68a12f7f2c60a74bfd"
dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
mode: GRACEFUL
new_leader_uuid: "73bf755165c4487c81c67b5ab44f7104"
from {username='slave'} at 127.0.0.1:41718
I20260203 09:18:34.061542 31448 raft_consensus.cc:606] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Received request to transfer leadership to TS 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:34.065970 32432 consensus_queue.cc:1048] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:18:34.072824 31448 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "70796ace22d548219e05b0c9a86346e7"
dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
mode: GRACEFUL
new_leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:41718
I20260203 09:18:34.073731 31449 raft_consensus.cc:1275] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:18:34.073812 31448 raft_consensus.cc:606] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Received request to transfer leadership to TS d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:34.075975 32433 consensus_queue.cc:1048] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:18:34.080400 31449 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "707a391491654853bba7daefe8451eca"
dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
mode: GRACEFUL
new_leader_uuid: "73bf755165c4487c81c67b5ab44f7104"
from {username='slave'} at 127.0.0.1:41718
I20260203 09:18:34.080962 31449 raft_consensus.cc:606] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Received request to transfer leadership to TS 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:34.085325 31296 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "afe2065ab01641aa86dc384050ab810a"
dest_uuid: "79b10fa125f242419f66b577440e66d0"
mode: GRACEFUL
new_leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:35564
I20260203 09:18:34.085855 31296 raft_consensus.cc:606] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Received request to transfer leadership to TS d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:34.094203 31449 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c43e17bc65f048a9a9fd229bb9c98bfb"
dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
mode: GRACEFUL
new_leader_uuid: "73bf755165c4487c81c67b5ab44f7104"
from {username='slave'} at 127.0.0.1:41718
I20260203 09:18:34.098623 31449 raft_consensus.cc:606] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Received request to transfer leadership to TS 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:34.100503 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260203 09:18:34.102231 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:18:34.103273 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:18:34.111227 31296 raft_consensus.cc:1275] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:18:34.116499 32437 consensus_queue.cc:1048] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:18:34.262027 32421 raft_consensus.cc:993] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec: : Instructing follower 73bf755165c4487c81c67b5ab44f7104 to start an election
I20260203 09:18:34.262435 32427 raft_consensus.cc:1081] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Signalling peer 73bf755165c4487c81c67b5ab44f7104 to start an election
I20260203 09:18:34.264017 31374 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c43e17bc65f048a9a9fd229bb9c98bfb"
dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
from {username='slave'} at 127.0.0.1:57862
I20260203 09:18:34.264490 31374 raft_consensus.cc:493] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:34.264850 31374 raft_consensus.cc:3060] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:34.271827 31374 raft_consensus.cc:515] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:34.273619 31374 leader_election.cc:290] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:34.274278 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c43e17bc65f048a9a9fd229bb9c98bfb" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:34.274899 31296 raft_consensus.cc:3060] T c43e17bc65f048a9a9fd229bb9c98bfb P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:34.274893 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c43e17bc65f048a9a9fd229bb9c98bfb" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:34.275631 31450 raft_consensus.cc:3055] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:34.275924 31450 raft_consensus.cc:740] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:34.276612 31450 consensus_queue.cc:260] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:34.278782 31450 raft_consensus.cc:3060] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:34.284286 31296 raft_consensus.cc:2468] T c43e17bc65f048a9a9fd229bb9c98bfb P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 2.
I20260203 09:18:34.284682 31450 raft_consensus.cc:2468] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 2.
I20260203 09:18:34.285655 31341 leader_election.cc:304] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters:
I20260203 09:18:34.286533 32463 raft_consensus.cc:2804] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:34.286995 32463 raft_consensus.cc:697] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Becoming Leader. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:34.287822 32463 consensus_queue.cc:237] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:34.296239 31118 catalog_manager.cc:5654] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 1 to 2, leader changed from 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68) to 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67). New cstate: current_term: 2 leader_uuid: "73bf755165c4487c81c67b5ab44f7104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:34.414757 32427 raft_consensus.cc:993] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec: : Instructing follower 73bf755165c4487c81c67b5ab44f7104 to start an election
I20260203 09:18:34.415150 32421 raft_consensus.cc:1081] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Signalling peer 73bf755165c4487c81c67b5ab44f7104 to start an election
I20260203 09:18:34.416428 31374 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "707a391491654853bba7daefe8451eca"
dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
from {username='slave'} at 127.0.0.1:57862
I20260203 09:18:34.416903 31374 raft_consensus.cc:493] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:34.417148 31374 raft_consensus.cc:3060] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:34.421531 31374 raft_consensus.cc:515] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:34.423285 31374 leader_election.cc:290] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:34.424300 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "707a391491654853bba7daefe8451eca" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:34.424945 31448 raft_consensus.cc:3055] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:34.425220 31448 raft_consensus.cc:740] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:34.423928 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "707a391491654853bba7daefe8451eca" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:34.425943 31448 consensus_queue.cc:260] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:34.426602 31296 raft_consensus.cc:3060] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:34.427220 31448 raft_consensus.cc:3060] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:34.433787 31296 raft_consensus.cc:2468] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 2.
I20260203 09:18:34.433787 31448 raft_consensus.cc:2468] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 2.
I20260203 09:18:34.435164 31341 leader_election.cc:304] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters:
I20260203 09:18:34.435842 32463 raft_consensus.cc:2804] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:34.436265 32463 raft_consensus.cc:697] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Becoming Leader. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:34.437124 32463 consensus_queue.cc:237] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:34.449410 31118 catalog_manager.cc:5654] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 1 to 2, leader changed from 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68) to 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67). New cstate: current_term: 2 leader_uuid: "73bf755165c4487c81c67b5ab44f7104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:34.466651 32412 raft_consensus.cc:993] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0: : Instructing follower d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:34.467197 32420 raft_consensus.cc:1081] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Signalling peer d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:34.468518 32283 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "afe2065ab01641aa86dc384050ab810a"
dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:41292
I20260203 09:18:34.469087 32283 raft_consensus.cc:493] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:34.469420 32283 raft_consensus.cc:3060] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:34.474887 32283 raft_consensus.cc:515] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:34.477046 32283 leader_election.cc:290] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:34.477496 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "afe2065ab01641aa86dc384050ab810a" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:34.478072 31374 raft_consensus.cc:3060] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:34.479161 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "afe2065ab01641aa86dc384050ab810a" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:34.479645 31296 raft_consensus.cc:3055] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:34.479943 31296 raft_consensus.cc:740] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:34.481215 31296 consensus_queue.cc:260] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:34.482060 31296 raft_consensus.cc:3060] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:34.483984 31374 raft_consensus.cc:2468] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 2.
I20260203 09:18:34.484979 32233 leader_election.cc:304] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:34.485603 32433 raft_consensus.cc:2804] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:34.485950 32433 raft_consensus.cc:697] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [term 2 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:34.486739 31296 raft_consensus.cc:2468] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 2.
I20260203 09:18:34.486640 32433 consensus_queue.cc:237] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:34.497558 31123 catalog_manager.cc:5654] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 1 to 2, leader changed from 79b10fa125f242419f66b577440e66d0 (127.26.232.66) to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 2 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:34.561874 32409 raft_consensus.cc:993] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec: : Instructing follower d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:34.562350 32427 raft_consensus.cc:1081] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Signalling peer d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:34.563067 32409 raft_consensus.cc:993] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec: : Instructing follower 73bf755165c4487c81c67b5ab44f7104 to start an election
I20260203 09:18:34.563540 32427 raft_consensus.cc:1081] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Signalling peer 73bf755165c4487c81c67b5ab44f7104 to start an election
I20260203 09:18:34.563791 32283 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "70796ace22d548219e05b0c9a86346e7"
dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:41278
I20260203 09:18:34.564288 32283 raft_consensus.cc:493] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:34.564608 32283 raft_consensus.cc:3060] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:34.564987 31374 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "55ce9fa640064a68a12f7f2c60a74bfd"
dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
from {username='slave'} at 127.0.0.1:57862
I20260203 09:18:34.565514 31374 raft_consensus.cc:493] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:34.565871 31374 raft_consensus.cc:3060] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:34.571410 32283 raft_consensus.cc:515] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:34.572474 31374 raft_consensus.cc:515] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:34.574332 31369 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70796ace22d548219e05b0c9a86346e7" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:34.574635 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70796ace22d548219e05b0c9a86346e7" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:34.574882 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "55ce9fa640064a68a12f7f2c60a74bfd" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:34.575003 31369 raft_consensus.cc:3060] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:34.575256 31448 raft_consensus.cc:3055] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:18:34.575438 31296 raft_consensus.cc:3060] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:34.576486 31374 leader_election.cc:290] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:34.575692 31448 raft_consensus.cc:740] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:34.577517 31448 consensus_queue.cc:260] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:34.578143 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "55ce9fa640064a68a12f7f2c60a74bfd" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:34.578671 31450 raft_consensus.cc:3055] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:34.578541 31448 raft_consensus.cc:3060] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:34.578982 31450 raft_consensus.cc:740] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:34.579762 31450 consensus_queue.cc:260] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:34.580935 31450 raft_consensus.cc:3060] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:34.583153 31369 raft_consensus.cc:2468] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 3.
I20260203 09:18:34.584369 32233 leader_election.cc:304] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:34.573776 32283 leader_election.cc:290] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:34.585836 32437 raft_consensus.cc:2804] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:18:34.586309 32437 raft_consensus.cc:697] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 3 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:34.587141 32437 consensus_queue.cc:237] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:34.591377 31450 raft_consensus.cc:2468] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 2.
I20260203 09:18:34.592427 31341 leader_election.cc:304] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters:
I20260203 09:18:34.593454 32463 raft_consensus.cc:2804] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:34.589885 31296 raft_consensus.cc:2468] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 2.
I20260203 09:18:34.593926 32463 raft_consensus.cc:697] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Becoming Leader. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:34.596043 32463 consensus_queue.cc:237] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:34.601713 31448 raft_consensus.cc:2468] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 3.
I20260203 09:18:34.610466 31123 catalog_manager.cc:5654] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 2 to 3, leader changed from 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68) to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 3 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:34.619583 31118 catalog_manager.cc:5654] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 1 to 2, leader changed from 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68) to 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67). New cstate: current_term: 2 leader_uuid: "73bf755165c4487c81c67b5ab44f7104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:34.703080 31296 raft_consensus.cc:1275] T c43e17bc65f048a9a9fd229bb9c98bfb P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Refusing update from remote peer 73bf755165c4487c81c67b5ab44f7104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:34.704072 32463 consensus_queue.cc:1048] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:34.713114 31448 raft_consensus.cc:1275] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Refusing update from remote peer 73bf755165c4487c81c67b5ab44f7104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:34.716291 32432 consensus_queue.cc:1048] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:34.871976 31448 raft_consensus.cc:1275] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Refusing update from remote peer 73bf755165c4487c81c67b5ab44f7104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:34.873077 32463 consensus_queue.cc:1048] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:34.888104 31296 raft_consensus.cc:1275] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Refusing update from remote peer 73bf755165c4487c81c67b5ab44f7104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:34.889626 32432 consensus_queue.cc:1048] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:35.054139 31374 raft_consensus.cc:1275] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:18:35.055275 32435 consensus_queue.cc:1048] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:18:35.064136 31292 raft_consensus.cc:1275] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Refusing update from remote peer 73bf755165c4487c81c67b5ab44f7104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:35.067267 31292 raft_consensus.cc:1275] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:35.068670 32435 consensus_queue.cc:1048] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:35.070816 31450 raft_consensus.cc:1275] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:18:35.074784 32437 consensus_queue.cc:1048] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:18:35.079555 32465 consensus_queue.cc:1048] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:18:35.097095 31374 raft_consensus.cc:1275] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:35.098557 32435 consensus_queue.cc:1048] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:35.103531 31450 raft_consensus.cc:1275] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Refusing update from remote peer 73bf755165c4487c81c67b5ab44f7104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:35.112625 32465 consensus_queue.cc:1048] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:35.161523 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:18:35.200615 31296 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "14073202fe424a9b9a72f4c7e6075bdf"
dest_uuid: "79b10fa125f242419f66b577440e66d0"
mode: GRACEFUL
new_leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:35564
I20260203 09:18:35.201211 31296 raft_consensus.cc:606] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 2 LEADER]: Received request to transfer leadership to TS d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:35.203698 31296 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "15d598c8a8514ff5af7a0e48897dffa7"
dest_uuid: "79b10fa125f242419f66b577440e66d0"
mode: GRACEFUL
new_leader_uuid: "73bf755165c4487c81c67b5ab44f7104"
from {username='slave'} at 127.0.0.1:35564
I20260203 09:18:35.204116 31296 raft_consensus.cc:606] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Received request to transfer leadership to TS 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:35.206130 31296 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "4d9139b651d14e5082793499087ed2d4"
dest_uuid: "79b10fa125f242419f66b577440e66d0"
mode: GRACEFUL
new_leader_uuid: "73bf755165c4487c81c67b5ab44f7104"
from {username='slave'} at 127.0.0.1:35564
I20260203 09:18:35.206570 31296 raft_consensus.cc:606] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Received request to transfer leadership to TS 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:35.208384 31296 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "c9884e996f0443f2ae2ab5606633ce3c"
dest_uuid: "79b10fa125f242419f66b577440e66d0"
mode: GRACEFUL
new_leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:35564
I20260203 09:18:35.208803 31296 raft_consensus.cc:606] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 3 LEADER]: Received request to transfer leadership to TS d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:35.211014 31296 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "e4d4fa5c03a74205a7c5fdda5e37cfe4"
dest_uuid: "79b10fa125f242419f66b577440e66d0"
mode: GRACEFUL
new_leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:35564
I20260203 09:18:35.211546 31296 raft_consensus.cc:606] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 2 LEADER]: Received request to transfer leadership to TS d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:35.212535 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260203 09:18:35.213692 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:18:35.214262 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:18:35.406232 32420 raft_consensus.cc:993] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0: : Instructing follower 73bf755165c4487c81c67b5ab44f7104 to start an election
I20260203 09:18:35.406699 32440 raft_consensus.cc:1081] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Signalling peer 73bf755165c4487c81c67b5ab44f7104 to start an election
I20260203 09:18:35.408109 31374 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "4d9139b651d14e5082793499087ed2d4"
dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
from {username='slave'} at 127.0.0.1:57836
I20260203 09:18:35.408794 31374 raft_consensus.cc:493] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:35.409102 31374 raft_consensus.cc:3060] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:35.415609 31374 raft_consensus.cc:515] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:35.417486 31374 leader_election.cc:290] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:35.418466 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d9139b651d14e5082793499087ed2d4" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:35.419016 31296 raft_consensus.cc:3055] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:35.419294 31296 raft_consensus.cc:740] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:35.420028 31296 consensus_queue.cc:260] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:35.421239 31296 raft_consensus.cc:3060] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:35.421554 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d9139b651d14e5082793499087ed2d4" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:35.422369 31450 raft_consensus.cc:3060] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:35.428848 31296 raft_consensus.cc:2468] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 2.
I20260203 09:18:35.430203 31341 leader_election.cc:304] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:35.430735 31450 raft_consensus.cc:2468] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 2.
I20260203 09:18:35.431071 32465 raft_consensus.cc:2804] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:35.437817 32465 raft_consensus.cc:697] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Becoming Leader. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:35.438733 32465 consensus_queue.cc:237] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:35.452991 32420 raft_consensus.cc:993] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0: : Instructing follower 73bf755165c4487c81c67b5ab44f7104 to start an election
I20260203 09:18:35.453434 32440 raft_consensus.cc:1081] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Signalling peer 73bf755165c4487c81c67b5ab44f7104 to start an election
I20260203 09:18:35.454912 31374 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "15d598c8a8514ff5af7a0e48897dffa7"
dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
from {username='slave'} at 127.0.0.1:57836
I20260203 09:18:35.455377 31374 raft_consensus.cc:493] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:35.455931 31374 raft_consensus.cc:3060] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:35.455371 31118 catalog_manager.cc:5654] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 1 to 2, leader changed from 79b10fa125f242419f66b577440e66d0 (127.26.232.66) to 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67). New cstate: current_term: 2 leader_uuid: "73bf755165c4487c81c67b5ab44f7104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:35.462683 31374 raft_consensus.cc:515] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:35.464846 31374 leader_election.cc:290] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:35.465523 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15d598c8a8514ff5af7a0e48897dffa7" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:35.466199 31296 raft_consensus.cc:3055] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:35.466269 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15d598c8a8514ff5af7a0e48897dffa7" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:35.466637 31296 raft_consensus.cc:740] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:35.466931 31450 raft_consensus.cc:3060] T 15d598c8a8514ff5af7a0e48897dffa7 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:35.467442 31296 consensus_queue.cc:260] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:35.468886 31296 raft_consensus.cc:3060] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:35.474143 31450 raft_consensus.cc:2468] T 15d598c8a8514ff5af7a0e48897dffa7 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 2.
I20260203 09:18:35.475205 31341 leader_election.cc:304] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters:
I20260203 09:18:35.475876 31296 raft_consensus.cc:2468] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 2.
I20260203 09:18:35.475970 32465 raft_consensus.cc:2804] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:35.476454 32465 raft_consensus.cc:697] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Becoming Leader. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:35.477285 32465 consensus_queue.cc:237] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:35.487242 31118 catalog_manager.cc:5654] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 1 to 2, leader changed from 79b10fa125f242419f66b577440e66d0 (127.26.232.66) to 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67). New cstate: current_term: 2 leader_uuid: "73bf755165c4487c81c67b5ab44f7104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:35.579632 32420 raft_consensus.cc:993] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0: : Instructing follower d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:35.580166 32440 raft_consensus.cc:1081] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 2 LEADER]: Signalling peer d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:35.581548 32284 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "14073202fe424a9b9a72f4c7e6075bdf"
dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:41292
I20260203 09:18:35.581990 32284 raft_consensus.cc:493] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:35.582329 32284 raft_consensus.cc:3060] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:35.586989 32284 raft_consensus.cc:515] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:35.588379 32284 leader_election.cc:290] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:35.589414 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14073202fe424a9b9a72f4c7e6075bdf" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:35.589629 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14073202fe424a9b9a72f4c7e6075bdf" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:35.590066 31296 raft_consensus.cc:3055] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:18:35.590219 31374 raft_consensus.cc:3060] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:35.590425 31296 raft_consensus.cc:740] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:35.591261 31296 consensus_queue.cc:260] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:35.592303 31296 raft_consensus.cc:3060] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:35.595420 31374 raft_consensus.cc:2468] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 3.
I20260203 09:18:35.596446 32233 leader_election.cc:304] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:35.597198 32490 raft_consensus.cc:2804] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:18:35.597762 32490 raft_consensus.cc:697] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 3 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:35.597281 31296 raft_consensus.cc:2468] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 3.
I20260203 09:18:35.599278 32490 consensus_queue.cc:237] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:35.612831 31118 catalog_manager.cc:5654] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 2 to 3, leader changed from 79b10fa125f242419f66b577440e66d0 (127.26.232.66) to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 3 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:35.622773 32420 raft_consensus.cc:993] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0: : Instructing follower d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:35.623215 32440 raft_consensus.cc:1081] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 2 LEADER]: Signalling peer d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:35.624545 32284 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "e4d4fa5c03a74205a7c5fdda5e37cfe4"
dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:41292
I20260203 09:18:35.625044 32284 raft_consensus.cc:493] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:35.625313 32284 raft_consensus.cc:3060] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:35.630512 32284 raft_consensus.cc:515] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:35.631769 32284 leader_election.cc:290] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 election: Requested vote from peers 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099), 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019)
I20260203 09:18:35.632581 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4d4fa5c03a74205a7c5fdda5e37cfe4" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:35.632759 31296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4d4fa5c03a74205a7c5fdda5e37cfe4" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:35.633109 31450 raft_consensus.cc:3060] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:35.633251 31296 raft_consensus.cc:3055] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:18:35.633571 31296 raft_consensus.cc:740] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:35.634280 31296 consensus_queue.cc:260] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:35.635277 31296 raft_consensus.cc:3060] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:35.639515 32412 raft_consensus.cc:993] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0: : Instructing follower d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:35.639972 32412 raft_consensus.cc:1081] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 3 LEADER]: Signalling peer d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:35.640790 31450 raft_consensus.cc:2468] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 3.
I20260203 09:18:35.641384 32284 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "c9884e996f0443f2ae2ab5606633ce3c"
dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:41292
I20260203 09:18:35.641719 32236 leader_election.cc:304] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:35.644188 32284 raft_consensus.cc:493] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:35.644572 32284 raft_consensus.cc:3060] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:18:35.644488 32490 raft_consensus.cc:2804] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:18:35.645217 32490 raft_consensus.cc:697] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 3 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:35.647228 31296 raft_consensus.cc:2468] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 3.
I20260203 09:18:35.647531 32490 consensus_queue.cc:237] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } }
I20260203 09:18:35.658679 32284 raft_consensus.cc:515] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:35.660956 32284 leader_election.cc:290] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 4 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:35.662410 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9884e996f0443f2ae2ab5606633ce3c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:35.662925 31374 raft_consensus.cc:3060] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:18:35.666278 31292 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9884e996f0443f2ae2ab5606633ce3c" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:35.666909 31292 raft_consensus.cc:3055] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 3 LEADER]: Stepping down as leader of term 3
I20260203 09:18:35.667198 31292 raft_consensus.cc:740] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:35.667944 31292 consensus_queue.cc:260] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:35.669140 31292 raft_consensus.cc:3060] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Advancing to term 4
I20260203 09:18:35.675992 31374 raft_consensus.cc:2468] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 4.
I20260203 09:18:35.678393 32233 leader_election.cc:304] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:35.679277 32433 raft_consensus.cc:2804] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: Leader election won for term 4
I20260203 09:18:35.679778 32433 raft_consensus.cc:697] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 4 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:35.680681 32433 consensus_queue.cc:237] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:35.681581 31292 raft_consensus.cc:2468] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 4.
I20260203 09:18:35.682082 31118 catalog_manager.cc:5654] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 2 to 3, leader changed from 79b10fa125f242419f66b577440e66d0 (127.26.232.66) to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 3 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:35.699672 31118 catalog_manager.cc:5654] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 3 to 4, leader changed from 79b10fa125f242419f66b577440e66d0 (127.26.232.66) to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 4 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:35.855234 31292 raft_consensus.cc:1275] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Refusing update from remote peer 73bf755165c4487c81c67b5ab44f7104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:35.856532 32465 consensus_queue.cc:1048] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:35.867898 31450 raft_consensus.cc:1275] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Refusing update from remote peer 73bf755165c4487c81c67b5ab44f7104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:35.869964 32463 consensus_queue.cc:1048] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:36.030306 31448 raft_consensus.cc:1275] T 15d598c8a8514ff5af7a0e48897dffa7 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Refusing update from remote peer 73bf755165c4487c81c67b5ab44f7104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:36.031352 32465 consensus_queue.cc:1048] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:36.041095 31292 raft_consensus.cc:1275] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Refusing update from remote peer 73bf755165c4487c81c67b5ab44f7104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:36.044402 32463 consensus_queue.cc:1048] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:36.123471 31374 raft_consensus.cc:1275] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 4 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260203 09:18:36.124912 32433 consensus_queue.cc:1048] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:18:36.143128 31298 raft_consensus.cc:1275] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 4 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260203 09:18:36.144418 32511 consensus_queue.cc:1048] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:18:36.145591 31448 raft_consensus.cc:1275] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260203 09:18:36.148710 31374 raft_consensus.cc:1275] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:18:36.149739 32511 consensus_queue.cc:1048] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:36.151386 32511 consensus_queue.cc:1048] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260203 09:18:36.165977 31298 raft_consensus.cc:1275] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:18:36.167214 32490 consensus_queue.cc:1048] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:18:36.191663 31298 raft_consensus.cc:1275] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260203 09:18:36.193836 32511 consensus_queue.cc:1048] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:36.248875 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:18:36.284204 31298 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "03943e5b830f4ab4be9fe0b4e0ca4697"
dest_uuid: "79b10fa125f242419f66b577440e66d0"
mode: GRACEFUL
new_leader_uuid: "73bf755165c4487c81c67b5ab44f7104"
from {username='slave'} at 127.0.0.1:35564
I20260203 09:18:36.284726 31298 raft_consensus.cc:606] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Received request to transfer leadership to TS 73bf755165c4487c81c67b5ab44f7104
I20260203 09:18:36.286954 31298 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "2b0e416075b74212b54e341eba13fd78"
dest_uuid: "79b10fa125f242419f66b577440e66d0"
mode: GRACEFUL
new_leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:35564
I20260203 09:18:36.287353 31298 raft_consensus.cc:606] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Received request to transfer leadership to TS d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:36.289722 31298 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "420f71f998fb4c24a607beff32960d0d"
dest_uuid: "79b10fa125f242419f66b577440e66d0"
mode: GRACEFUL
new_leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
from {username='slave'} at 127.0.0.1:35564
I20260203 09:18:36.290292 31298 raft_consensus.cc:606] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Received request to transfer leadership to TS 2bf9aa3533b14841a52177c8cc3130ec
I20260203 09:18:36.292615 31298 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "dbf01f6b7a2f4b7db0978441f72e138d"
dest_uuid: "79b10fa125f242419f66b577440e66d0"
mode: GRACEFUL
new_leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:35564
I20260203 09:18:36.293155 31298 raft_consensus.cc:606] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Received request to transfer leadership to TS d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:36.294118 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260203 09:18:36.295251 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:18:36.295889 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:18:36.342156 32412 raft_consensus.cc:993] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0: : Instructing follower 73bf755165c4487c81c67b5ab44f7104 to start an election
I20260203 09:18:36.342715 32412 raft_consensus.cc:1081] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Signalling peer 73bf755165c4487c81c67b5ab44f7104 to start an election
I20260203 09:18:36.344175 31371 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "03943e5b830f4ab4be9fe0b4e0ca4697"
dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
from {username='slave'} at 127.0.0.1:57836
I20260203 09:18:36.344600 31371 raft_consensus.cc:493] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:36.344947 31371 raft_consensus.cc:3060] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:36.352013 31371 raft_consensus.cc:515] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:36.354179 31371 leader_election.cc:290] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:36.355679 31450 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03943e5b830f4ab4be9fe0b4e0ca4697" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:36.356261 31450 raft_consensus.cc:3060] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:36.356807 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "03943e5b830f4ab4be9fe0b4e0ca4697" candidate_uuid: "73bf755165c4487c81c67b5ab44f7104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:36.357362 31298 raft_consensus.cc:3055] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:36.357543 31298 raft_consensus.cc:740] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:36.358176 31298 consensus_queue.cc:260] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:36.359270 31298 raft_consensus.cc:3060] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:36.361159 31450 raft_consensus.cc:2468] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 2.
I20260203 09:18:36.362198 31341 leader_election.cc:304] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters:
I20260203 09:18:36.362884 32465 raft_consensus.cc:2804] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:36.363354 32465 raft_consensus.cc:697] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Becoming Leader. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:36.364852 32465 consensus_queue.cc:237] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:36.366058 31298 raft_consensus.cc:2468] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73bf755165c4487c81c67b5ab44f7104 in term 2.
I20260203 09:18:36.374212 31123 catalog_manager.cc:5654] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 reported cstate change: term changed from 1 to 2, leader changed from 79b10fa125f242419f66b577440e66d0 (127.26.232.66) to 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67). New cstate: current_term: 2 leader_uuid: "73bf755165c4487c81c67b5ab44f7104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:36.385847 32440 raft_consensus.cc:993] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0: : Instructing follower 2bf9aa3533b14841a52177c8cc3130ec to start an election
I20260203 09:18:36.386262 32412 raft_consensus.cc:1081] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Signalling peer 2bf9aa3533b14841a52177c8cc3130ec to start an election
I20260203 09:18:36.387784 31450 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "420f71f998fb4c24a607beff32960d0d"
dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
from {username='slave'} at 127.0.0.1:34782
I20260203 09:18:36.388289 31450 raft_consensus.cc:493] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:36.388623 31450 raft_consensus.cc:3060] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:36.394425 31450 raft_consensus.cc:515] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:36.396489 31450 leader_election.cc:290] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:36.397116 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "420f71f998fb4c24a607beff32960d0d" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:36.397394 31371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "420f71f998fb4c24a607beff32960d0d" candidate_uuid: "2bf9aa3533b14841a52177c8cc3130ec" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:36.397621 31298 raft_consensus.cc:3055] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:36.397915 31298 raft_consensus.cc:740] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:36.397912 31371 raft_consensus.cc:3060] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:36.398662 31298 consensus_queue.cc:260] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:36.399853 31298 raft_consensus.cc:3060] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:36.404951 31371 raft_consensus.cc:2468] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 2.
I20260203 09:18:36.406188 31413 leader_election.cc:304] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 73bf755165c4487c81c67b5ab44f7104; no voters:
I20260203 09:18:36.406234 31298 raft_consensus.cc:2468] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2bf9aa3533b14841a52177c8cc3130ec in term 2.
I20260203 09:18:36.407233 32427 raft_consensus.cc:2804] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:36.407974 32427 raft_consensus.cc:697] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Becoming Leader. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:36.408865 32427 consensus_queue.cc:237] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:36.419256 31123 catalog_manager.cc:5654] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec reported cstate change: term changed from 1 to 2, leader changed from 79b10fa125f242419f66b577440e66d0 (127.26.232.66) to 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68). New cstate: current_term: 2 leader_uuid: "2bf9aa3533b14841a52177c8cc3130ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:36.645393 32440 raft_consensus.cc:993] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0: : Instructing follower d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:36.645879 32412 raft_consensus.cc:1081] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Signalling peer d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:36.647181 32284 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "dbf01f6b7a2f4b7db0978441f72e138d"
dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:41292
I20260203 09:18:36.647591 32284 raft_consensus.cc:493] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:36.647907 32284 raft_consensus.cc:3060] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:36.652916 32284 raft_consensus.cc:515] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:36.654659 32284 leader_election.cc:290] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:36.655234 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbf01f6b7a2f4b7db0978441f72e138d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:36.655714 31298 raft_consensus.cc:3055] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:36.655916 31298 raft_consensus.cc:740] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:36.656497 31298 consensus_queue.cc:260] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:36.657538 31298 raft_consensus.cc:3060] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:36.661247 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dbf01f6b7a2f4b7db0978441f72e138d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:36.661852 31374 raft_consensus.cc:3060] T dbf01f6b7a2f4b7db0978441f72e138d P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:36.668533 32440 raft_consensus.cc:993] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0: : Instructing follower d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:36.669094 32412 raft_consensus.cc:1081] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Signalling peer d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:36.670235 31374 raft_consensus.cc:2468] T dbf01f6b7a2f4b7db0978441f72e138d P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 2.
I20260203 09:18:36.670552 32284 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "2b0e416075b74212b54e341eba13fd78"
dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:41292
I20260203 09:18:36.671119 32284 raft_consensus.cc:493] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:36.671222 32233 leader_election.cc:304] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:36.671500 32284 raft_consensus.cc:3060] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:36.671960 32433 raft_consensus.cc:2804] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:36.672125 31298 raft_consensus.cc:2468] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 2.
I20260203 09:18:36.672367 32433 raft_consensus.cc:697] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [term 2 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:36.673341 32433 consensus_queue.cc:237] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:36.677830 32284 raft_consensus.cc:515] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:36.679384 32284 leader_election.cc:290] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:36.680352 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b0e416075b74212b54e341eba13fd78" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:36.680377 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b0e416075b74212b54e341eba13fd78" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:36.681106 31298 raft_consensus.cc:3055] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:36.681336 31298 raft_consensus.cc:740] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:36.682065 31298 consensus_queue.cc:260] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:36.683199 31298 raft_consensus.cc:3060] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:36.683082 31123 catalog_manager.cc:5654] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 1 to 2, leader changed from 79b10fa125f242419f66b577440e66d0 (127.26.232.66) to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 2 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:36.684860 31374 raft_consensus.cc:3060] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:36.689105 31298 raft_consensus.cc:2468] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 2.
I20260203 09:18:36.690266 31374 raft_consensus.cc:2468] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 2.
I20260203 09:18:36.690810 32236 leader_election.cc:304] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79b10fa125f242419f66b577440e66d0, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:36.691642 32433 raft_consensus.cc:2804] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:36.692142 32433 raft_consensus.cc:697] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [term 2 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:36.694238 32433 consensus_queue.cc:237] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:36.703166 31123 catalog_manager.cc:5654] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 1 to 2, leader changed from 79b10fa125f242419f66b577440e66d0 (127.26.232.66) to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 2 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:36.901226 31298 raft_consensus.cc:1275] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Refusing update from remote peer 73bf755165c4487c81c67b5ab44f7104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:36.902302 32465 consensus_queue.cc:1048] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:36.914698 31448 raft_consensus.cc:1275] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Refusing update from remote peer 73bf755165c4487c81c67b5ab44f7104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:36.917255 32432 consensus_queue.cc:1048] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:36.932521 31298 raft_consensus.cc:1275] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Refusing update from remote peer 2bf9aa3533b14841a52177c8cc3130ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:36.934170 32522 consensus_queue.cc:1048] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:36.952376 31374 raft_consensus.cc:1275] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Refusing update from remote peer 2bf9aa3533b14841a52177c8cc3130ec: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:36.957229 32427 consensus_queue.cc:1048] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:37.122529 31292 raft_consensus.cc:1275] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:37.123809 32433 consensus_queue.cc:1048] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:37.134832 31371 raft_consensus.cc:1275] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:37.136435 32523 consensus_queue.cc:1048] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:37.210561 31292 raft_consensus.cc:1275] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:37.211589 32490 consensus_queue.cc:1048] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:37.222138 31374 raft_consensus.cc:1275] T dbf01f6b7a2f4b7db0978441f72e138d P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:37.223423 32523 consensus_queue.cc:1048] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:37.330256 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:18:37.368762 31450 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "2a5ca73a494b4d7389eec90025653337"
dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
mode: GRACEFUL
new_leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:41718
I20260203 09:18:37.369258 31450 raft_consensus.cc:606] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Received request to transfer leadership to TS d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:37.386250 31371 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "707a391491654853bba7daefe8451eca"
dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
mode: GRACEFUL
new_leader_uuid: "79b10fa125f242419f66b577440e66d0"
from {username='slave'} at 127.0.0.1:42440
I20260203 09:18:37.386859 31371 raft_consensus.cc:606] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Received request to transfer leadership to TS 79b10fa125f242419f66b577440e66d0
I20260203 09:18:37.388043 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260203 09:18:37.389707 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:18:37.390434 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:18:37.520623 32409 raft_consensus.cc:993] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec: : Instructing follower d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:37.521075 32427 raft_consensus.cc:1081] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Signalling peer d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:37.522704 32288 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "2a5ca73a494b4d7389eec90025653337"
dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:41278
I20260203 09:18:37.523202 32288 raft_consensus.cc:493] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:37.523447 32288 raft_consensus.cc:3060] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:37.529366 32288 raft_consensus.cc:515] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:37.532215 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a5ca73a494b4d7389eec90025653337" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:37.532835 31448 raft_consensus.cc:3055] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:37.533144 31448 raft_consensus.cc:740] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2bf9aa3533b14841a52177c8cc3130ec, State: Running, Role: LEADER
I20260203 09:18:37.532402 32288 leader_election.cc:290] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:37.533833 31448 consensus_queue.cc:260] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:37.534881 31448 raft_consensus.cc:3060] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:37.534965 31371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a5ca73a494b4d7389eec90025653337" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:37.535578 31371 raft_consensus.cc:3060] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:37.541823 31448 raft_consensus.cc:2468] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 2.
I20260203 09:18:37.542797 31371 raft_consensus.cc:2468] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 2.
I20260203 09:18:37.543255 32236 leader_election.cc:304] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:37.544090 32490 raft_consensus.cc:2804] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:37.544509 32490 raft_consensus.cc:697] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [term 2 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:37.545279 32490 consensus_queue.cc:237] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } }
I20260203 09:18:37.555330 31123 catalog_manager.cc:5654] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 1 to 2, leader changed from 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68) to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 2 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:37.620296 32465 raft_consensus.cc:993] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104: : Instructing follower 79b10fa125f242419f66b577440e66d0 to start an election
I20260203 09:18:37.620734 32463 raft_consensus.cc:1081] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Signalling peer 79b10fa125f242419f66b577440e66d0 to start an election
I20260203 09:18:37.622169 31292 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "707a391491654853bba7daefe8451eca"
dest_uuid: "79b10fa125f242419f66b577440e66d0"
from {username='slave'} at 127.0.0.1:47172
I20260203 09:18:37.622661 31292 raft_consensus.cc:493] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:37.623003 31292 raft_consensus.cc:3060] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:37.627795 31292 raft_consensus.cc:515] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:37.629606 31292 leader_election.cc:290] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 election: Requested vote from peers 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289), 2bf9aa3533b14841a52177c8cc3130ec (127.26.232.68:42099)
I20260203 09:18:37.630498 31448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "707a391491654853bba7daefe8451eca" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2bf9aa3533b14841a52177c8cc3130ec"
I20260203 09:18:37.630498 31371 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "707a391491654853bba7daefe8451eca" candidate_uuid: "79b10fa125f242419f66b577440e66d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:37.631292 31448 raft_consensus.cc:3060] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:37.631338 31371 raft_consensus.cc:3055] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Stepping down as leader of term 2
I20260203 09:18:37.631768 31371 raft_consensus.cc:740] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73bf755165c4487c81c67b5ab44f7104, State: Running, Role: LEADER
I20260203 09:18:37.632476 31371 consensus_queue.cc:260] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:37.633675 31371 raft_consensus.cc:3060] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Advancing to term 3
I20260203 09:18:37.638355 31448 raft_consensus.cc:2468] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 3.
I20260203 09:18:37.639657 31267 leader_election.cc:304] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2bf9aa3533b14841a52177c8cc3130ec, 79b10fa125f242419f66b577440e66d0; no voters:
I20260203 09:18:37.639984 31371 raft_consensus.cc:2468] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b10fa125f242419f66b577440e66d0 in term 3.
I20260203 09:18:37.640280 32440 raft_consensus.cc:2804] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260203 09:18:37.640764 32440 raft_consensus.cc:697] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [term 3 LEADER]: Becoming Leader. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:37.641417 32440 consensus_queue.cc:237] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } }
I20260203 09:18:37.651337 31123 catalog_manager.cc:5654] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 reported cstate change: term changed from 2 to 3, leader changed from 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67) to 79b10fa125f242419f66b577440e66d0 (127.26.232.66). New cstate: current_term: 3 leader_uuid: "79b10fa125f242419f66b577440e66d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:38.008477 31371 raft_consensus.cc:1275] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:38.009526 32433 consensus_queue.cc:1048] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:38.021946 31450 raft_consensus.cc:1275] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:38.023241 32490 consensus_queue.cc:1048] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:38.130707 31371 raft_consensus.cc:1275] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Refusing update from remote peer 79b10fa125f242419f66b577440e66d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:18:38.131739 32555 consensus_queue.cc:1048] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:18:38.141765 31450 raft_consensus.cc:1275] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Refusing update from remote peer 79b10fa125f242419f66b577440e66d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260203 09:18:38.142879 32440 consensus_queue.cc:1048] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bf9aa3533b14841a52177c8cc3130ec" member_type: VOTER last_known_addr { host: "127.26.232.68" port: 42099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260203 09:18:38.432325 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:18:38.472419 31292 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d"
dest_uuid: "79b10fa125f242419f66b577440e66d0"
mode: GRACEFUL
new_leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:35564
I20260203 09:18:38.472966 31292 raft_consensus.cc:606] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 4 LEADER]: Received request to transfer leadership to TS d44c40c0ed244c4e962a26f9aebea76a
I20260203 09:18:38.474607 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260203 09:18:38.476186 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:18:38.476794 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:18:38.807046 32412 raft_consensus.cc:993] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0: : Instructing follower d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:38.807471 32412 raft_consensus.cc:1081] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 4 LEADER]: Signalling peer d44c40c0ed244c4e962a26f9aebea76a to start an election
I20260203 09:18:38.808660 32288 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d"
dest_uuid: "d44c40c0ed244c4e962a26f9aebea76a"
from {username='slave'} at 127.0.0.1:41292
I20260203 09:18:38.809072 32288 raft_consensus.cc:493] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:38.809335 32288 raft_consensus.cc:3060] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:18:38.813805 32288 raft_consensus.cc:515] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:38.815233 32288 leader_election.cc:290] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 5 election: Requested vote from peers 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019), 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289)
I20260203 09:18:38.815933 31298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "79b10fa125f242419f66b577440e66d0"
I20260203 09:18:38.816162 31374 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e02dfb7bfdec4c3db78522766f8f710d" candidate_uuid: "d44c40c0ed244c4e962a26f9aebea76a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "73bf755165c4487c81c67b5ab44f7104"
I20260203 09:18:38.816470 31298 raft_consensus.cc:3055] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 4 LEADER]: Stepping down as leader of term 4
I20260203 09:18:38.816716 31374 raft_consensus.cc:3060] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:18:38.816825 31298 raft_consensus.cc:740] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79b10fa125f242419f66b577440e66d0, State: Running, Role: LEADER
I20260203 09:18:38.817488 31298 consensus_queue.cc:260] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:38.818359 31298 raft_consensus.cc:3060] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 4 FOLLOWER]: Advancing to term 5
I20260203 09:18:38.821676 31374 raft_consensus.cc:2468] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 5.
I20260203 09:18:38.822736 32233 leader_election.cc:304] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73bf755165c4487c81c67b5ab44f7104, d44c40c0ed244c4e962a26f9aebea76a; no voters:
I20260203 09:18:38.823940 32490 raft_consensus.cc:2804] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 5 FOLLOWER]: Leader election won for term 5
I20260203 09:18:38.823856 31298 raft_consensus.cc:2468] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44c40c0ed244c4e962a26f9aebea76a in term 5.
I20260203 09:18:38.824577 32490 raft_consensus.cc:697] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 5 LEADER]: Becoming Leader. State: Replica: d44c40c0ed244c4e962a26f9aebea76a, State: Running, Role: LEADER
I20260203 09:18:38.825484 32490 consensus_queue.cc:237] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } }
I20260203 09:18:38.840469 31121 catalog_manager.cc:5654] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a reported cstate change: term changed from 4 to 5, leader changed from 79b10fa125f242419f66b577440e66d0 (127.26.232.66) to d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65). New cstate: current_term: 5 leader_uuid: "d44c40c0ed244c4e962a26f9aebea76a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d44c40c0ed244c4e962a26f9aebea76a" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 45511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:39.250308 31298 raft_consensus.cc:1275] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 5 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260203 09:18:39.251686 32490 consensus_queue.cc:1048] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b10fa125f242419f66b577440e66d0" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 45019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:18:39.262776 31374 raft_consensus.cc:1275] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 5 FOLLOWER]: Refusing update from remote peer d44c40c0ed244c4e962a26f9aebea76a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260203 09:18:39.264258 32490 consensus_queue.cc:1048] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73bf755165c4487c81c67b5ab44f7104" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260203 09:18:39.511873 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:18:39.562623 27553 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260203 09:18:39.564146 27553 auto_leader_rebalancer.cc:451] All tables' leader rebalancing finished this round
I20260203 09:18:39.564774 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:18:39.597880 27553 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260203 09:18:39.631505 27553 tablet_server.cc:178] TabletServer@127.26.232.65:45511 shutting down...
W20260203 09:18:39.652632 31416 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 159 similar messages]
W20260203 09:18:39.662967 31416 consensus_peers.cc:597] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:39.663461 27553 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260203 09:18:39.666122 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.667186 27553 raft_consensus.cc:2243] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.667650 27553 raft_consensus.cc:2272] T 9adae0a7f8a243ad9a35cb7a2047f472 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260203 09:18:39.669636 31416 consensus_peers.cc:597] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:39.670454 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.671370 27553 raft_consensus.cc:2243] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.671867 27553 raft_consensus.cc:2272] T 9e9201a8d64c4b45982d775e4406a3fd P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.674486 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.675128 27553 raft_consensus.cc:2243] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.675534 27553 raft_consensus.cc:2272] T ee25c6a8d94e49a2a9a5646d493c1bde P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.678658 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.680176 27553 raft_consensus.cc:2243] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.680862 27553 raft_consensus.cc:2272] T 563e8640cca54f9cab7822a8136fb583 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.684398 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.685884 27553 raft_consensus.cc:2243] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:18:39.687186 27553 raft_consensus.cc:2272] T c9884e996f0443f2ae2ab5606633ce3c P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: Raft consensus is shut down!
W20260203 09:18:39.687219 31341 consensus_peers.cc:597] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:39.689570 31267 consensus_peers.cc:597] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:39.690549 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.691548 27553 raft_consensus.cc:2243] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.692108 27553 raft_consensus.cc:2272] T e9ac7485f9224e0b9a9e95ce8b3c5654 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260203 09:18:39.692749 31341 consensus_peers.cc:597] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:39.695398 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.696364 27553 raft_consensus.cc:2243] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:39.697399 27553 raft_consensus.cc:2272] T dbf01f6b7a2f4b7db0978441f72e138d P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.700616 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.701746 27553 raft_consensus.cc:2243] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.702385 27553 raft_consensus.cc:2272] T 3eab34196fcb483abc69a625b7ca6300 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.705303 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.706163 27553 raft_consensus.cc:2243] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.706761 27553 raft_consensus.cc:2272] T 5c17aa1880254f13a38a3c550b0894af P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.709746 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.710515 27553 raft_consensus.cc:2243] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:18:39.711493 27553 raft_consensus.cc:2272] T ec42a05859cf4d5ebe1e1f268d01b3fc P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.714221 27553 tablet_replica.cc:333] stopping tablet replica
W20260203 09:18:39.714951 31267 consensus_peers.cc:597] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:39.715031 27553 raft_consensus.cc:2243] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.716544 27553 raft_consensus.cc:2272] T 653756c5b80f438b91b3d00ce86f52bb P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260203 09:18:39.716683 31267 consensus_peers.cc:597] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:39.717304 31267 consensus_peers.cc:597] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:39.719125 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.719843 27553 raft_consensus.cc:2243] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.720268 27553 raft_consensus.cc:2272] T 2a68c16f0da84e9683a5121f63b3f22c P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.723389 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.723996 27553 raft_consensus.cc:2243] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.724391 27553 raft_consensus.cc:2272] T 93cc0a94606149e18c8764e851f4b826 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.726366 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.726939 27553 raft_consensus.cc:2243] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:18:39.727640 27553 raft_consensus.cc:2272] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.729611 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.730268 27553 raft_consensus.cc:2243] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.730759 27553 raft_consensus.cc:2272] T 9f6fed7d1dca4d4184fd89b136a55ec1 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.733340 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.733886 27553 raft_consensus.cc:2243] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.734226 27553 raft_consensus.cc:2272] T defda4c9fc6a4d0ba46ec287eb2f08d1 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.736776 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.737514 27553 raft_consensus.cc:2243] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.738032 27553 raft_consensus.cc:2272] T f617ef4ccf984446b1ab7084a92efe17 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260203 09:18:39.738080 31267 consensus_peers.cc:597] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:39.740376 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.741108 27553 raft_consensus.cc:2243] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.742233 27553 raft_consensus.cc:2272] T 730e665d69354cad93df20607e256d58 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.744457 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.745097 27553 raft_consensus.cc:2243] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:18:39.746002 27553 raft_consensus.cc:2272] T 70796ace22d548219e05b0c9a86346e7 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.748314 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.748947 27553 raft_consensus.cc:2243] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.749307 27553 raft_consensus.cc:2272] T a9e063333ea146ed9efb0110b67e9520 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.751121 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.751645 27553 raft_consensus.cc:2243] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:39.752368 27553 raft_consensus.cc:2272] T 2a5ca73a494b4d7389eec90025653337 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.754189 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.754689 27553 raft_consensus.cc:2243] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.755095 27553 raft_consensus.cc:2272] T 8301405e2ead406caa7440c0337df77d P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.757055 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.757565 27553 raft_consensus.cc:2243] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.757965 27553 raft_consensus.cc:2272] T e57c5a8761da4a818b634fda6687de01 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.759729 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.760247 27553 raft_consensus.cc:2243] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:18:39.761036 27553 raft_consensus.cc:2272] T d1d1f5b1c3b64ebaa2824e9136285fbe P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.763371 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.763908 27553 raft_consensus.cc:2243] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.764299 27553 raft_consensus.cc:2272] T 92861fb258ec44228e1c191bee2fee0b P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.766175 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.766687 27553 raft_consensus.cc:2243] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.767096 27553 raft_consensus.cc:2272] T 4d46f012a03d4d73afb2cffe5d847486 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.769347 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.770058 27553 raft_consensus.cc:2243] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.770623 27553 raft_consensus.cc:2272] T f94dad823fea42d2976b19da7bc7b258 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260203 09:18:39.771281 31416 consensus_peers.cc:597] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:39.772964 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.773731 27553 raft_consensus.cc:2243] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:18:39.774632 27553 raft_consensus.cc:2272] T 14073202fe424a9b9a72f4c7e6075bdf P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260203 09:18:39.775625 31267 consensus_peers.cc:597] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:39.776975 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.777571 27553 raft_consensus.cc:2243] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:39.778527 27553 raft_consensus.cc:2272] T 2b0e416075b74212b54e341eba13fd78 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.781203 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.781919 27553 raft_consensus.cc:2243] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260203 09:18:39.782124 31341 consensus_peers.cc:597] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:39.782392 27553 raft_consensus.cc:2272] T f5ccddc8d332443c97a92e59957dfa69 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.784487 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.785204 27553 raft_consensus.cc:2243] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 6 LEADER]: Raft consensus shutting down.
I20260203 09:18:39.786136 27553 raft_consensus.cc:2272] T 58d31844d41c408f9fd7f2cbd1270b6c P d44c40c0ed244c4e962a26f9aebea76a [term 6 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.788843 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.789644 27553 raft_consensus.cc:2243] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.790146 27553 raft_consensus.cc:2272] T 2975d753fec1406eadec135c189d3ec3 P d44c40c0ed244c4e962a26f9aebea76a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.792871 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.793596 27553 raft_consensus.cc:2243] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.794126 27553 raft_consensus.cc:2272] T 5c2f90aaa7514d27a5a15b4fd6f90669 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.796785 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.797550 27553 raft_consensus.cc:2243] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.798064 27553 raft_consensus.cc:2272] T c84b4a1f3d804ae39a009a23ea4e90f3 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.800791 27553 tablet_replica.cc:333] stopping tablet replica
W20260203 09:18:39.801925 31267 consensus_peers.cc:597] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:39.802385 27553 raft_consensus.cc:2243] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.802868 27553 raft_consensus.cc:2272] T 14fd7c3d313847f591177ebba8df09c4 P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.804888 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.805444 27553 raft_consensus.cc:2243] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.805823 27553 raft_consensus.cc:2272] T 3abbec594ab143a1ade1030741cf9e7d P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.808182 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.808887 27553 raft_consensus.cc:2243] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:18:39.809621 27553 raft_consensus.cc:2272] T 06460fafee594578bed03068236ad9f2 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.811390 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.811864 27553 raft_consensus.cc:2243] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.812229 27553 raft_consensus.cc:2272] T 0b92ba54a16143c08cfa7303819aa929 P d44c40c0ed244c4e962a26f9aebea76a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.814124 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.814601 27553 raft_consensus.cc:2243] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.814963 27553 raft_consensus.cc:2272] T 03e1544e85d94310a17e919716a0e5b9 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.816860 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.817473 27553 raft_consensus.cc:2243] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:18:39.818392 27553 raft_consensus.cc:2272] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.820724 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.821260 27553 raft_consensus.cc:2243] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:39.821907 27553 raft_consensus.cc:2272] T afe2065ab01641aa86dc384050ab810a P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.823722 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.824189 27553 raft_consensus.cc:2243] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.824538 27553 raft_consensus.cc:2272] T 87ac8c99d77e47c2b1a373820b27c804 P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.826498 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.826999 27553 raft_consensus.cc:2243] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.827383 27553 raft_consensus.cc:2272] T 247b062505fb476790c4f06d074d67aa P d44c40c0ed244c4e962a26f9aebea76a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.829317 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.829782 27553 raft_consensus.cc:2243] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:39.830130 27553 raft_consensus.cc:2272] T 374ce202ecd540008cded117a37bfeba P d44c40c0ed244c4e962a26f9aebea76a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:39.831966 27553 tablet_replica.cc:333] stopping tablet replica
I20260203 09:18:39.832392 27553 raft_consensus.cc:2243] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 5 LEADER]: Raft consensus shutting down.
I20260203 09:18:39.833165 27553 raft_consensus.cc:2272] T e02dfb7bfdec4c3db78522766f8f710d P d44c40c0ed244c4e962a26f9aebea76a [term 5 FOLLOWER]: Raft consensus is shut down!
W20260203 09:18:39.858724 31416 consensus_peers.cc:597] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:39.863487 31416 consensus_peers.cc:597] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:39.881036 31341 consensus_peers.cc:597] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:39.882498 31341 consensus_peers.cc:597] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:39.886088 31416 consensus_peers.cc:597] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:39.907473 27553 tablet_server.cc:195] TabletServer@127.26.232.65:45511 shutdown complete.
W20260203 09:18:39.946214 31341 consensus_peers.cc:597] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:39.955392 31416 consensus_peers.cc:597] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:39.958118 31341 consensus_peers.cc:597] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:39.992511 31267 consensus_peers.cc:597] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.001044 27553 tablet_server.cc:178] TabletServer@127.26.232.66:0 shutting down...
W20260203 09:18:40.013064 31416 consensus_peers.cc:597] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Couldn't send request to peer 79b10fa125f242419f66b577440e66d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:40.050387 31267 consensus_peers.cc:597] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:40.057574 31416 consensus_peers.cc:597] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.057574 27553 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260203 09:18:40.059500 27553 tablet_replica.cc:333] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.060400 27553 raft_consensus.cc:2243] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.061276 27553 raft_consensus.cc:2272] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.063462 27553 tablet_replica.cc:333] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.064119 27553 raft_consensus.cc:2243] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.064560 27553 raft_consensus.cc:2272] T ec42a05859cf4d5ebe1e1f268d01b3fc P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.067421 27553 tablet_replica.cc:333] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.068022 27553 raft_consensus.cc:2243] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.069021 27553 raft_consensus.cc:2272] T 9adae0a7f8a243ad9a35cb7a2047f472 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260203 09:18:40.070278 31416 consensus_peers.cc:597] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.071557 27553 tablet_replica.cc:333] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.072351 27553 raft_consensus.cc:2243] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.072865 27553 raft_consensus.cc:2272] T 4d9139b651d14e5082793499087ed2d4 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260203 09:18:40.074299 31341 consensus_peers.cc:597] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 -> Peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Couldn't send request to peer 79b10fa125f242419f66b577440e66d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.075027 27553 tablet_replica.cc:333] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.075779 27553 raft_consensus.cc:2243] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.076586 27553 raft_consensus.cc:2272] T a9e063333ea146ed9efb0110b67e9520 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260203 09:18:40.078742 31416 consensus_peers.cc:597] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec -> Peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Couldn't send request to peer 79b10fa125f242419f66b577440e66d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.079077 27553 tablet_replica.cc:333] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.079704 27553 raft_consensus.cc:2243] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.080132 27553 raft_consensus.cc:2272] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 79b10fa125f242419f66b577440e66d0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.082401 27553 tablet_replica.cc:333] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.083155 27553 raft_consensus.cc:2243] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.083578 27553 raft_consensus.cc:2272] T f94dad823fea42d2976b19da7bc7b258 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.086593 27553 tablet_replica.cc:333] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.087319 27553 raft_consensus.cc:2243] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Raft consensus shutting down.
W20260203 09:18:40.087741 31341 consensus_peers.cc:597] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 -> Peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Couldn't send request to peer 79b10fa125f242419f66b577440e66d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.088196 27553 raft_consensus.cc:2272] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260203 09:18:40.088958 31416 consensus_peers.cc:597] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec -> Peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Couldn't send request to peer 79b10fa125f242419f66b577440e66d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.090384 27553 tablet_replica.cc:333] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.091044 27553 raft_consensus.cc:2243] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.091446 27553 raft_consensus.cc:2272] T c9884e996f0443f2ae2ab5606633ce3c P 79b10fa125f242419f66b577440e66d0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.093263 27553 tablet_replica.cc:333] T c2ce342ceda546bbad30e8eff5485a48 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.093827 27553 raft_consensus.cc:2243] T c2ce342ceda546bbad30e8eff5485a48 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.094214 27553 raft_consensus.cc:2272] T c2ce342ceda546bbad30e8eff5485a48 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.096138 27553 tablet_replica.cc:333] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.096802 27553 raft_consensus.cc:2243] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.097337 27553 raft_consensus.cc:2272] T 2b0e416075b74212b54e341eba13fd78 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.099833 27553 tablet_replica.cc:333] T f5ccddc8d332443c97a92e59957dfa69 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.100458 27553 raft_consensus.cc:2243] T f5ccddc8d332443c97a92e59957dfa69 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.100998 27553 raft_consensus.cc:2272] T f5ccddc8d332443c97a92e59957dfa69 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260203 09:18:40.101238 31341 consensus_peers.cc:597] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 -> Peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Couldn't send request to peer 79b10fa125f242419f66b577440e66d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:40.102180 31341 consensus_peers.cc:597] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 -> Peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Couldn't send request to peer 79b10fa125f242419f66b577440e66d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.103163 27553 tablet_replica.cc:333] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.103773 27553 raft_consensus.cc:2243] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.104156 27553 raft_consensus.cc:2272] T 14073202fe424a9b9a72f4c7e6075bdf P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.106212 27553 tablet_replica.cc:333] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.106832 27553 raft_consensus.cc:2243] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.107685 27553 raft_consensus.cc:2272] T f0a785c5c3bf4846b008f0bc6de21607 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.110411 27553 tablet_replica.cc:333] T c43e17bc65f048a9a9fd229bb9c98bfb P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.111035 27553 raft_consensus.cc:2243] T c43e17bc65f048a9a9fd229bb9c98bfb P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260203 09:18:40.111368 31341 consensus_peers.cc:597] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.111521 27553 raft_consensus.cc:2272] T c43e17bc65f048a9a9fd229bb9c98bfb P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260203 09:18:40.113348 31267 consensus_peers.cc:597] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.113615 27553 tablet_replica.cc:333] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.114284 27553 raft_consensus.cc:2243] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.115234 27553 raft_consensus.cc:2272] T 3eab34196fcb483abc69a625b7ca6300 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.118042 27553 tablet_replica.cc:333] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
W20260203 09:18:40.118320 31416 consensus_peers.cc:597] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.118844 27553 raft_consensus.cc:2243] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.119366 27553 raft_consensus.cc:2272] T dbf01f6b7a2f4b7db0978441f72e138d P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.121623 27553 tablet_replica.cc:333] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
W20260203 09:18:40.122219 31416 consensus_peers.cc:597] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.122345 27553 raft_consensus.cc:2243] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.122877 27553 raft_consensus.cc:2272] T 8301405e2ead406caa7440c0337df77d P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.124624 27553 tablet_replica.cc:333] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.125213 27553 raft_consensus.cc:2243] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.125609 27553 raft_consensus.cc:2272] T 06460fafee594578bed03068236ad9f2 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.127911 27553 tablet_replica.cc:333] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.128630 27553 raft_consensus.cc:2243] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.129541 27553 raft_consensus.cc:2272] T 8dbd55217e2546b5b3361ddf019f01d6 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.131600 27553 tablet_replica.cc:333] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.132215 27553 raft_consensus.cc:2243] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.132800 27553 raft_consensus.cc:2272] T 0b92ba54a16143c08cfa7303819aa929 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.134737 27553 tablet_replica.cc:333] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.135314 27553 raft_consensus.cc:2243] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.136034 27553 raft_consensus.cc:2272] T 707a391491654853bba7daefe8451eca P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.137941 27553 tablet_replica.cc:333] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.138574 27553 raft_consensus.cc:2243] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.139509 27553 raft_consensus.cc:2272] T 730e665d69354cad93df20607e256d58 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.141515 27553 tablet_replica.cc:333] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.142046 27553 raft_consensus.cc:2243] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.142432 27553 raft_consensus.cc:2272] T d1d1f5b1c3b64ebaa2824e9136285fbe P 79b10fa125f242419f66b577440e66d0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.144523 27553 tablet_replica.cc:333] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.145179 27553 raft_consensus.cc:2243] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.146065 27553 raft_consensus.cc:2272] T 653756c5b80f438b91b3d00ce86f52bb P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260203 09:18:40.147567 31341 consensus_peers.cc:597] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 -> Peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Couldn't send request to peer 79b10fa125f242419f66b577440e66d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.148377 27553 tablet_replica.cc:333] T bd838f6bdcba4d728e975023e89894a5 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.149056 27553 raft_consensus.cc:2243] T bd838f6bdcba4d728e975023e89894a5 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.149469 27553 raft_consensus.cc:2272] T bd838f6bdcba4d728e975023e89894a5 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.151579 27553 tablet_replica.cc:333] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.152125 27553 raft_consensus.cc:2243] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.152470 27553 raft_consensus.cc:2272] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.154290 27553 tablet_replica.cc:333] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.155000 27553 raft_consensus.cc:2243] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.155457 27553 raft_consensus.cc:2272] T e02dfb7bfdec4c3db78522766f8f710d P 79b10fa125f242419f66b577440e66d0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.158424 27553 tablet_replica.cc:333] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.159150 27553 raft_consensus.cc:2243] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.160166 27553 raft_consensus.cc:2272] T 92861fb258ec44228e1c191bee2fee0b P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.162685 27553 tablet_replica.cc:333] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.163357 27553 raft_consensus.cc:2243] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.163844 27553 raft_consensus.cc:2272] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.166214 27553 tablet_replica.cc:333] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.166746 27553 raft_consensus.cc:2243] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.167126 27553 raft_consensus.cc:2272] T afe2065ab01641aa86dc384050ab810a P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.169305 27553 tablet_replica.cc:333] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.169960 27553 raft_consensus.cc:2243] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.170848 27553 raft_consensus.cc:2272] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.172927 27553 tablet_replica.cc:333] T 2975d753fec1406eadec135c189d3ec3 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
W20260203 09:18:40.173254 31341 consensus_peers.cc:597] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 -> Peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Couldn't send request to peer 79b10fa125f242419f66b577440e66d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.173547 27553 raft_consensus.cc:2243] T 2975d753fec1406eadec135c189d3ec3 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.174067 27553 raft_consensus.cc:2272] T 2975d753fec1406eadec135c189d3ec3 P 79b10fa125f242419f66b577440e66d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.175976 27553 tablet_replica.cc:333] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.176494 27553 raft_consensus.cc:2243] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.176930 27553 raft_consensus.cc:2272] T fc8de34393ac472590f28a52d1bf55ff P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.178668 27553 tablet_replica.cc:333] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.179282 27553 raft_consensus.cc:2243] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.179697 27553 raft_consensus.cc:2272] T 93cc0a94606149e18c8764e851f4b826 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.181504 27553 tablet_replica.cc:333] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.182066 27553 raft_consensus.cc:2243] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.182789 27553 raft_consensus.cc:2272] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.184592 27553 tablet_replica.cc:333] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.185160 27553 raft_consensus.cc:2243] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.185515 27553 raft_consensus.cc:2272] T 55ce9fa640064a68a12f7f2c60a74bfd P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.187460 27553 tablet_replica.cc:333] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.187966 27553 raft_consensus.cc:2243] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.188755 27553 raft_consensus.cc:2272] T c84b4a1f3d804ae39a009a23ea4e90f3 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.190541 27553 tablet_replica.cc:333] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.191038 27553 raft_consensus.cc:2243] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.191740 27553 raft_consensus.cc:2272] T 14fd7c3d313847f591177ebba8df09c4 P 79b10fa125f242419f66b577440e66d0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.193859 27553 tablet_replica.cc:333] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.194504 27553 raft_consensus.cc:2243] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.194926 27553 raft_consensus.cc:2272] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.196763 27553 tablet_replica.cc:333] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.197249 27553 raft_consensus.cc:2243] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.197626 27553 raft_consensus.cc:2272] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 79b10fa125f242419f66b577440e66d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.199362 27553 tablet_replica.cc:333] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.199828 27553 raft_consensus.cc:2243] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.200205 27553 raft_consensus.cc:2272] T 420f71f998fb4c24a607beff32960d0d P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.202064 27553 tablet_replica.cc:333] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.202512 27553 raft_consensus.cc:2243] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.202883 27553 raft_consensus.cc:2272] T 15d598c8a8514ff5af7a0e48897dffa7 P 79b10fa125f242419f66b577440e66d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.204519 27553 tablet_replica.cc:333] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0: stopping tablet replica
I20260203 09:18:40.204979 27553 raft_consensus.cc:2243] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.205402 27553 raft_consensus.cc:2272] T 3abbec594ab143a1ade1030741cf9e7d P 79b10fa125f242419f66b577440e66d0 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260203 09:18:40.214257 31416 consensus_peers.cc:597] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer d44c40c0ed244c4e962a26f9aebea76a (127.26.232.65:45511): Couldn't send request to peer d44c40c0ed244c4e962a26f9aebea76a. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.65:45511: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:40.275980 31341 consensus_peers.cc:597] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 -> Peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Couldn't send request to peer 79b10fa125f242419f66b577440e66d0. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.66:45019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.283385 27553 tablet_server.cc:195] TabletServer@127.26.232.66:0 shutdown complete.
W20260203 09:18:40.288414 31341 consensus_peers.cc:597] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104 -> Peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Couldn't send request to peer 79b10fa125f242419f66b577440e66d0. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.66:45019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.355279 27553 tablet_server.cc:178] TabletServer@127.26.232.67:0 shutting down...
W20260203 09:18:40.387985 31341 consensus_peers.cc:597] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104 -> Peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Couldn't send request to peer 79b10fa125f242419f66b577440e66d0. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.66:45019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.400553 27553 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260203 09:18:40.401542 27553 tablet_replica.cc:333] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.402257 27553 raft_consensus.cc:2243] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.402765 27553 raft_consensus.cc:2272] T 563e8640cca54f9cab7822a8136fb583 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.405179 27553 tablet_replica.cc:333] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.405791 27553 raft_consensus.cc:2243] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.406520 27553 raft_consensus.cc:2272] T 15d598c8a8514ff5af7a0e48897dffa7 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260203 09:18:40.406822 31416 consensus_peers.cc:597] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec -> Peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Couldn't send request to peer 79b10fa125f242419f66b577440e66d0. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.66:45019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.408597 27553 tablet_replica.cc:333] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.409369 27553 raft_consensus.cc:2243] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.410262 27553 raft_consensus.cc:2272] T ee25c6a8d94e49a2a9a5646d493c1bde P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260203 09:18:40.410982 31416 consensus_peers.cc:597] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec -> Peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Couldn't send request to peer 79b10fa125f242419f66b577440e66d0. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.66:45019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.412364 27553 tablet_replica.cc:333] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.413030 27553 raft_consensus.cc:2243] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.413735 27553 raft_consensus.cc:2272] T 4d9139b651d14e5082793499087ed2d4 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.416041 27553 tablet_replica.cc:333] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.416887 27553 raft_consensus.cc:2243] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.417609 27553 raft_consensus.cc:2272] T f94dad823fea42d2976b19da7bc7b258 P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.419576 27553 tablet_replica.cc:333] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.420132 27553 raft_consensus.cc:2243] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.420516 27553 raft_consensus.cc:2272] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.422308 27553 tablet_replica.cc:333] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.422817 27553 raft_consensus.cc:2243] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.423586 27553 raft_consensus.cc:2272] T 4d46f012a03d4d73afb2cffe5d847486 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.425498 27553 tablet_replica.cc:333] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.426033 27553 raft_consensus.cc:2243] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.426406 27553 raft_consensus.cc:2272] T 2a5ca73a494b4d7389eec90025653337 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.428110 27553 tablet_replica.cc:333] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.429384 27553 raft_consensus.cc:2243] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.430321 27553 raft_consensus.cc:2272] T 87ac8c99d77e47c2b1a373820b27c804 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.432807 27553 tablet_replica.cc:333] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.433594 27553 raft_consensus.cc:2243] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.434134 27553 raft_consensus.cc:2272] T c9884e996f0443f2ae2ab5606633ce3c P 73bf755165c4487c81c67b5ab44f7104 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.436419 27553 tablet_replica.cc:333] T f0a785c5c3bf4846b008f0bc6de21607 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.437122 27553 raft_consensus.cc:2243] T f0a785c5c3bf4846b008f0bc6de21607 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.437664 27553 raft_consensus.cc:2272] T f0a785c5c3bf4846b008f0bc6de21607 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.440450 27553 tablet_replica.cc:333] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.441251 27553 raft_consensus.cc:2243] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.442260 27553 raft_consensus.cc:2272] T 9f6fed7d1dca4d4184fd89b136a55ec1 P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.444746 27553 tablet_replica.cc:333] T c2ce342ceda546bbad30e8eff5485a48 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.445457 27553 raft_consensus.cc:2243] T c2ce342ceda546bbad30e8eff5485a48 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.445884 27553 raft_consensus.cc:2272] T c2ce342ceda546bbad30e8eff5485a48 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.448032 27553 tablet_replica.cc:333] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.448776 27553 raft_consensus.cc:2243] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.449208 27553 raft_consensus.cc:2272] T 14073202fe424a9b9a72f4c7e6075bdf P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.451386 27553 tablet_replica.cc:333] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.452101 27553 raft_consensus.cc:2243] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.452612 27553 raft_consensus.cc:2272] T 2b0e416075b74212b54e341eba13fd78 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.454484 27553 tablet_replica.cc:333] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.455178 27553 raft_consensus.cc:2243] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.456112 27553 raft_consensus.cc:2272] T f5ccddc8d332443c97a92e59957dfa69 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.458391 27553 tablet_replica.cc:333] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.459160 27553 raft_consensus.cc:2243] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.459666 27553 raft_consensus.cc:2272] T c84b4a1f3d804ae39a009a23ea4e90f3 P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.462023 27553 tablet_replica.cc:333] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.462761 27553 raft_consensus.cc:2243] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260203 09:18:40.462785 31413 consensus_peers.cc:597] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec -> Peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Couldn't send request to peer 73bf755165c4487c81c67b5ab44f7104. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.463996 27553 raft_consensus.cc:2272] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.466022 27553 tablet_replica.cc:333] T 9e9201a8d64c4b45982d775e4406a3fd P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.466619 27553 raft_consensus.cc:2243] T 9e9201a8d64c4b45982d775e4406a3fd P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.467033 27553 raft_consensus.cc:2272] T 9e9201a8d64c4b45982d775e4406a3fd P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.468966 27553 tablet_replica.cc:333] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.469580 27553 raft_consensus.cc:2243] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.470121 27553 raft_consensus.cc:2272] T 03e1544e85d94310a17e919716a0e5b9 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260203 09:18:40.471221 31416 consensus_peers.cc:597] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Couldn't send request to peer 79b10fa125f242419f66b577440e66d0. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.66:45019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.472596 27553 tablet_replica.cc:333] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.473403 27553 raft_consensus.cc:2243] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.473871 27553 raft_consensus.cc:2272] T f617ef4ccf984446b1ab7084a92efe17 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.475685 27553 tablet_replica.cc:333] T 730e665d69354cad93df20607e256d58 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.476277 27553 raft_consensus.cc:2243] T 730e665d69354cad93df20607e256d58 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.476701 27553 raft_consensus.cc:2272] T 730e665d69354cad93df20607e256d58 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.478579 27553 tablet_replica.cc:333] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.479121 27553 raft_consensus.cc:2243] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.479516 27553 raft_consensus.cc:2272] T 70796ace22d548219e05b0c9a86346e7 P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.481221 27553 tablet_replica.cc:333] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.481731 27553 raft_consensus.cc:2243] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.482458 27553 raft_consensus.cc:2272] T 93cc0a94606149e18c8764e851f4b826 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.484315 27553 tablet_replica.cc:333] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.484891 27553 raft_consensus.cc:2243] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.485265 27553 raft_consensus.cc:2272] T defda4c9fc6a4d0ba46ec287eb2f08d1 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.486994 27553 tablet_replica.cc:333] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.487504 27553 raft_consensus.cc:2243] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.487890 27553 raft_consensus.cc:2272] T 707a391491654853bba7daefe8451eca P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.489768 27553 tablet_replica.cc:333] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.490325 27553 raft_consensus.cc:2243] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.490837 27553 raft_consensus.cc:2272] T 8dbd55217e2546b5b3361ddf019f01d6 P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.493230 27553 tablet_replica.cc:333] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.493892 27553 raft_consensus.cc:2243] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.494371 27553 raft_consensus.cc:2272] T e02dfb7bfdec4c3db78522766f8f710d P 73bf755165c4487c81c67b5ab44f7104 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260203 09:18:40.494968 31341 consensus_peers.cc:597] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 -> Peer 79b10fa125f242419f66b577440e66d0 (127.26.232.66:45019): Couldn't send request to peer 79b10fa125f242419f66b577440e66d0. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.66:45019: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.496274 27553 tablet_replica.cc:333] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.496909 27553 raft_consensus.cc:2243] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.497321 27553 raft_consensus.cc:2272] T 374ce202ecd540008cded117a37bfeba P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.499150 27553 tablet_replica.cc:333] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.499655 27553 raft_consensus.cc:2243] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.500422 27553 raft_consensus.cc:2272] T 2975d753fec1406eadec135c189d3ec3 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.502305 27553 tablet_replica.cc:333] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.502781 27553 raft_consensus.cc:2243] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.503511 27553 raft_consensus.cc:2272] T fc8de34393ac472590f28a52d1bf55ff P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.505291 27553 tablet_replica.cc:333] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.505904 27553 raft_consensus.cc:2243] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.506381 27553 raft_consensus.cc:2272] T 5c17aa1880254f13a38a3c550b0894af P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.508689 27553 tablet_replica.cc:333] T e57c5a8761da4a818b634fda6687de01 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
W20260203 09:18:40.508772 31413 consensus_peers.cc:597] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Couldn't send request to peer 73bf755165c4487c81c67b5ab44f7104. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.509398 27553 raft_consensus.cc:2243] T e57c5a8761da4a818b634fda6687de01 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.509794 27553 raft_consensus.cc:2272] T e57c5a8761da4a818b634fda6687de01 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.511812 27553 tablet_replica.cc:333] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.512359 27553 raft_consensus.cc:2243] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104 [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.513125 27553 raft_consensus.cc:2272] T bd838f6bdcba4d728e975023e89894a5 P 73bf755165c4487c81c67b5ab44f7104 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.515523 27553 tablet_replica.cc:333] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.516059 27553 raft_consensus.cc:2243] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.516456 27553 raft_consensus.cc:2272] T 653756c5b80f438b91b3d00ce86f52bb P 73bf755165c4487c81c67b5ab44f7104 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.518335 27553 tablet_replica.cc:333] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.518946 27553 raft_consensus.cc:2243] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.519328 27553 raft_consensus.cc:2272] T 2a68c16f0da84e9683a5121f63b3f22c P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.521152 27553 tablet_replica.cc:333] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.521641 27553 raft_consensus.cc:2243] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.522328 27553 raft_consensus.cc:2272] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.524914 27553 tablet_replica.cc:333] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.525540 27553 raft_consensus.cc:2243] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.526044 27553 raft_consensus.cc:2272] T 420f71f998fb4c24a607beff32960d0d P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.528169 27553 tablet_replica.cc:333] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.528685 27553 raft_consensus.cc:2243] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.529150 27553 raft_consensus.cc:2272] T 247b062505fb476790c4f06d074d67aa P 73bf755165c4487c81c67b5ab44f7104 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.531219 27553 tablet_replica.cc:333] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.531777 27553 raft_consensus.cc:2243] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.532467 27553 raft_consensus.cc:2272] T 55ce9fa640064a68a12f7f2c60a74bfd P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.534143 27553 tablet_replica.cc:333] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.534617 27553 raft_consensus.cc:2243] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.535338 27553 raft_consensus.cc:2272] T c43e17bc65f048a9a9fd229bb9c98bfb P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.537130 27553 tablet_replica.cc:333] T dbf01f6b7a2f4b7db0978441f72e138d P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.537580 27553 raft_consensus.cc:2243] T dbf01f6b7a2f4b7db0978441f72e138d P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.537971 27553 raft_consensus.cc:2272] T dbf01f6b7a2f4b7db0978441f72e138d P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.539597 27553 tablet_replica.cc:333] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.540047 27553 raft_consensus.cc:2243] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.540423 27553 raft_consensus.cc:2272] T 58d31844d41c408f9fd7f2cbd1270b6c P 73bf755165c4487c81c67b5ab44f7104 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.542353 27553 tablet_replica.cc:333] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104: stopping tablet replica
I20260203 09:18:40.542922 27553 raft_consensus.cc:2243] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.543324 27553 raft_consensus.cc:2272] T afe2065ab01641aa86dc384050ab810a P 73bf755165c4487c81c67b5ab44f7104 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260203 09:18:40.548611 31413 consensus_peers.cc:597] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec -> Peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Couldn't send request to peer 73bf755165c4487c81c67b5ab44f7104. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:40.593998 31413 consensus_peers.cc:597] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec -> Peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Couldn't send request to peer 73bf755165c4487c81c67b5ab44f7104. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:40.633767 31413 consensus_peers.cc:597] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec -> Peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Couldn't send request to peer 73bf755165c4487c81c67b5ab44f7104. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.67:41289: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:40.641599 31413 consensus_peers.cc:597] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Couldn't send request to peer 73bf755165c4487c81c67b5ab44f7104. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.67:41289: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.643633 27553 tablet_server.cc:195] TabletServer@127.26.232.67:0 shutdown complete.
W20260203 09:18:40.683432 31413 consensus_peers.cc:597] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec -> Peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Couldn't send request to peer 73bf755165c4487c81c67b5ab44f7104. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.67:41289: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260203 09:18:40.691107 31413 consensus_peers.cc:597] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec -> Peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Couldn't send request to peer 73bf755165c4487c81c67b5ab44f7104. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.67:41289: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.717351 27553 tablet_server.cc:178] TabletServer@127.26.232.68:0 shutting down...
W20260203 09:18:40.730316 31413 consensus_peers.cc:597] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec -> Peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Couldn't send request to peer 73bf755165c4487c81c67b5ab44f7104. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.67:41289: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.759305 27553 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260203 09:18:40.760286 27553 tablet_replica.cc:333] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.761332 27553 raft_consensus.cc:2243] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.761889 27553 raft_consensus.cc:2272] T e9ac7485f9224e0b9a9e95ce8b3c5654 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.764181 27553 tablet_replica.cc:333] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.764786 27553 raft_consensus.cc:2243] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.765268 27553 raft_consensus.cc:2272] T ee25c6a8d94e49a2a9a5646d493c1bde P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.767407 27553 tablet_replica.cc:333] T a9e063333ea146ed9efb0110b67e9520 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.767937 27553 raft_consensus.cc:2243] T a9e063333ea146ed9efb0110b67e9520 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.768303 27553 raft_consensus.cc:2272] T a9e063333ea146ed9efb0110b67e9520 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.769997 27553 tablet_replica.cc:333] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.770512 27553 raft_consensus.cc:2243] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.771184 27553 raft_consensus.cc:2272] T 563e8640cca54f9cab7822a8136fb583 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.772902 27553 tablet_replica.cc:333] T 9adae0a7f8a243ad9a35cb7a2047f472 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.773391 27553 raft_consensus.cc:2243] T 9adae0a7f8a243ad9a35cb7a2047f472 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.773729 27553 raft_consensus.cc:2272] T 9adae0a7f8a243ad9a35cb7a2047f472 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.775444 27553 tablet_replica.cc:333] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.775962 27553 raft_consensus.cc:2243] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.776306 27553 raft_consensus.cc:2272] T 4d9139b651d14e5082793499087ed2d4 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.777876 27553 tablet_replica.cc:333] T f0a785c5c3bf4846b008f0bc6de21607 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.778393 27553 raft_consensus.cc:2243] T f0a785c5c3bf4846b008f0bc6de21607 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.778772 27553 raft_consensus.cc:2272] T f0a785c5c3bf4846b008f0bc6de21607 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.780498 27553 tablet_replica.cc:333] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.781014 27553 raft_consensus.cc:2243] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.781383 27553 raft_consensus.cc:2272] T 4d46f012a03d4d73afb2cffe5d847486 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.783123 27553 tablet_replica.cc:333] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.783598 27553 raft_consensus.cc:2243] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.783943 27553 raft_consensus.cc:2272] T a3cb6ffb2d8d4a528e8f6108d59adb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.785625 27553 tablet_replica.cc:333] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.786114 27553 raft_consensus.cc:2243] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.786448 27553 raft_consensus.cc:2272] T c43e17bc65f048a9a9fd229bb9c98bfb P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.788122 27553 tablet_replica.cc:333] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.788597 27553 raft_consensus.cc:2243] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.788995 27553 raft_consensus.cc:2272] T 3eab34196fcb483abc69a625b7ca6300 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.791162 27553 tablet_replica.cc:333] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.791847 27553 raft_consensus.cc:2243] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.792629 27553 raft_consensus.cc:2272] T c2ce342ceda546bbad30e8eff5485a48 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.794639 27553 tablet_replica.cc:333] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.795145 27553 raft_consensus.cc:2243] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.795487 27553 raft_consensus.cc:2272] T e4d4fa5c03a74205a7c5fdda5e37cfe4 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.797199 27553 tablet_replica.cc:333] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.797670 27553 raft_consensus.cc:2243] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.798347 27553 raft_consensus.cc:2272] T f617ef4ccf984446b1ab7084a92efe17 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.800064 27553 tablet_replica.cc:333] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.800544 27553 raft_consensus.cc:2243] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.801017 27553 raft_consensus.cc:2272] T 70796ace22d548219e05b0c9a86346e7 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.803260 27553 tablet_replica.cc:333] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.803844 27553 raft_consensus.cc:2243] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.804240 27553 raft_consensus.cc:2272] T 06460fafee594578bed03068236ad9f2 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.806003 27553 tablet_replica.cc:333] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.806629 27553 raft_consensus.cc:2243] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.807440 27553 raft_consensus.cc:2272] T 0b92ba54a16143c08cfa7303819aa929 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.809396 27553 tablet_replica.cc:333] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.809898 27553 raft_consensus.cc:2243] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Raft consensus shutting down.
W20260203 09:18:40.810189 31413 consensus_peers.cc:597] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec -> Peer 73bf755165c4487c81c67b5ab44f7104 (127.26.232.67:41289): Couldn't send request to peer 73bf755165c4487c81c67b5ab44f7104. Status: Network error: Client connection negotiation failed: client connection to 127.26.232.67:41289: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260203 09:18:40.810297 27553 raft_consensus.cc:2272] T 707a391491654853bba7daefe8451eca P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.812096 27553 tablet_replica.cc:333] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.812683 27553 raft_consensus.cc:2243] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.813113 27553 raft_consensus.cc:2272] T 8dbd55217e2546b5b3361ddf019f01d6 P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.814833 27553 tablet_replica.cc:333] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.815361 27553 raft_consensus.cc:2243] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.816069 27553 raft_consensus.cc:2272] T 374ce202ecd540008cded117a37bfeba P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.817907 27553 tablet_replica.cc:333] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.818427 27553 raft_consensus.cc:2243] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.819139 27553 raft_consensus.cc:2272] T 9e9201a8d64c4b45982d775e4406a3fd P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.821051 27553 tablet_replica.cc:333] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.821570 27553 raft_consensus.cc:2243] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.822293 27553 raft_consensus.cc:2272] T a8fd0dd8dc8d432b8e8bb19f4f3448cc P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.824157 27553 tablet_replica.cc:333] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.824702 27553 raft_consensus.cc:2243] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [term 3 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.825379 27553 raft_consensus.cc:2272] T 8301405e2ead406caa7440c0337df77d P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.827085 27553 tablet_replica.cc:333] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.827564 27553 raft_consensus.cc:2243] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.827927 27553 raft_consensus.cc:2272] T 2a5ca73a494b4d7389eec90025653337 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.829650 27553 tablet_replica.cc:333] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.830152 27553 raft_consensus.cc:2243] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 6 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.830521 27553 raft_consensus.cc:2272] T 58d31844d41c408f9fd7f2cbd1270b6c P 2bf9aa3533b14841a52177c8cc3130ec [term 6 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.832198 27553 tablet_replica.cc:333] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.832729 27553 raft_consensus.cc:2243] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.833089 27553 raft_consensus.cc:2272] T ec42a05859cf4d5ebe1e1f268d01b3fc P 2bf9aa3533b14841a52177c8cc3130ec [term 3 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.834772 27553 tablet_replica.cc:333] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.835258 27553 raft_consensus.cc:2243] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.835964 27553 raft_consensus.cc:2272] T 5c17aa1880254f13a38a3c550b0894af P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.837738 27553 tablet_replica.cc:333] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.838255 27553 raft_consensus.cc:2243] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.838629 27553 raft_consensus.cc:2272] T d1d1f5b1c3b64ebaa2824e9136285fbe P 2bf9aa3533b14841a52177c8cc3130ec [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.840263 27553 tablet_replica.cc:333] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.840785 27553 raft_consensus.cc:2243] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.841508 27553 raft_consensus.cc:2272] T e57c5a8761da4a818b634fda6687de01 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.843274 27553 tablet_replica.cc:333] T bd838f6bdcba4d728e975023e89894a5 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.843744 27553 raft_consensus.cc:2243] T bd838f6bdcba4d728e975023e89894a5 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.844125 27553 raft_consensus.cc:2272] T bd838f6bdcba4d728e975023e89894a5 P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.845835 27553 tablet_replica.cc:333] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.846349 27553 raft_consensus.cc:2243] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.847046 27553 raft_consensus.cc:2272] T 2a68c16f0da84e9683a5121f63b3f22c P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.848786 27553 tablet_replica.cc:333] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.849368 27553 raft_consensus.cc:2243] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.849786 27553 raft_consensus.cc:2272] T 03943e5b830f4ab4be9fe0b4e0ca4697 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.852008 27553 tablet_replica.cc:333] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.852615 27553 raft_consensus.cc:2243] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.853130 27553 raft_consensus.cc:2272] T 5c2f90aaa7514d27a5a15b4fd6f90669 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.855041 27553 tablet_replica.cc:333] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.855551 27553 raft_consensus.cc:2243] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.855944 27553 raft_consensus.cc:2272] T fc8de34393ac472590f28a52d1bf55ff P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.857697 27553 tablet_replica.cc:333] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.858174 27553 raft_consensus.cc:2243] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.858533 27553 raft_consensus.cc:2272] T 87ac8c99d77e47c2b1a373820b27c804 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.860157 27553 tablet_replica.cc:333] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.860668 27553 raft_consensus.cc:2243] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.861394 27553 raft_consensus.cc:2272] T 247b062505fb476790c4f06d074d67aa P 2bf9aa3533b14841a52177c8cc3130ec [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.863096 27553 tablet_replica.cc:333] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.863631 27553 raft_consensus.cc:2243] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.864009 27553 raft_consensus.cc:2272] T 55ce9fa640064a68a12f7f2c60a74bfd P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.865756 27553 tablet_replica.cc:333] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.866245 27553 raft_consensus.cc:2243] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.866600 27553 raft_consensus.cc:2272] T 14fd7c3d313847f591177ebba8df09c4 P 2bf9aa3533b14841a52177c8cc3130ec [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.868340 27553 tablet_replica.cc:333] T 15d598c8a8514ff5af7a0e48897dffa7 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.868871 27553 raft_consensus.cc:2243] T 15d598c8a8514ff5af7a0e48897dffa7 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.869259 27553 raft_consensus.cc:2272] T 15d598c8a8514ff5af7a0e48897dffa7 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.870966 27553 tablet_replica.cc:333] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.871440 27553 raft_consensus.cc:2243] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 4 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.872129 27553 raft_consensus.cc:2272] T 3abbec594ab143a1ade1030741cf9e7d P 2bf9aa3533b14841a52177c8cc3130ec [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.873975 27553 tablet_replica.cc:333] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.874430 27553 raft_consensus.cc:2243] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.875140 27553 raft_consensus.cc:2272] T 420f71f998fb4c24a607beff32960d0d P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.876888 27553 tablet_replica.cc:333] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.877351 27553 raft_consensus.cc:2243] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 4 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.877729 27553 raft_consensus.cc:2272] T 20dfe4990e0a46ef9b0cf1cdf3dfdb09 P 2bf9aa3533b14841a52177c8cc3130ec [term 4 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.879464 27553 tablet_replica.cc:333] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.879906 27553 raft_consensus.cc:2243] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 LEADER]: Raft consensus shutting down.
I20260203 09:18:40.880611 27553 raft_consensus.cc:2272] T 03e1544e85d94310a17e919716a0e5b9 P 2bf9aa3533b14841a52177c8cc3130ec [term 2 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.882486 27553 tablet_replica.cc:333] T 92861fb258ec44228e1c191bee2fee0b P 2bf9aa3533b14841a52177c8cc3130ec: stopping tablet replica
I20260203 09:18:40.882925 27553 raft_consensus.cc:2243] T 92861fb258ec44228e1c191bee2fee0b P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260203 09:18:40.883311 27553 raft_consensus.cc:2272] T 92861fb258ec44228e1c191bee2fee0b P 2bf9aa3533b14841a52177c8cc3130ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:40.949328 27553 tablet_server.cc:195] TabletServer@127.26.232.68:0 shutdown complete.
I20260203 09:18:41.007134 27553 master.cc:561] Master@127.26.232.126:40067 shutting down...
I20260203 09:18:41.031059 27553 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723 [term 1 LEADER]: Raft consensus shutting down.
I20260203 09:18:41.031587 27553 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260203 09:18:41.031865 27553 tablet_replica.cc:333] T 00000000000000000000000000000000 P 91c47e3417a14e65bbb34ee9fc8e3723: stopping tablet replica
I20260203 09:18:41.078713 27553 master.cc:583] Master@127.26.232.126:40067 shutdown complete.
[ OK ] LeaderRebalancerTest.RestartTserver (43699 ms)
[ RUN ] LeaderRebalancerTest.TestMaintenanceMode
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/auto_leader_rebalancer-test.cc:475: Skipped
test is skipped; set KUDU_ALLOW_SLOW_TESTS=1 to run
[ SKIPPED ] LeaderRebalancerTest.TestMaintenanceMode (7 ms)
[----------] 5 tests from LeaderRebalancerTest (180975 ms total)
[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260203 09:18:41.173991 27553 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.26.232.126:37521
I20260203 09:18:41.175185 27553 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 09:18:41.180552 32581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:18:41.180832 32582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:18:41.182062 32584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:18:41.183157 27553 server_base.cc:1060] running on GCE node
I20260203 09:18:41.184355 27553 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260203 09:18:41.184551 27553 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260203 09:18:41.185029 27553 hybrid_clock.cc:648] HybridClock initialized: now 1770110321185008 us; error 0 us; skew 500 ppm
I20260203 09:18:41.185544 27553 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260203 09:18:41.187839 27553 webserver.cc:492] Webserver started at http://127.26.232.126:38753/ using document root <none> and password file <none>
I20260203 09:18:41.188325 27553 fs_manager.cc:362] Metadata directory not provided
I20260203 09:18:41.188488 27553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 09:18:41.188738 27553 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 09:18:41.189795 27553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1770110140020880-27553-0/minicluster-data/master-0-root/instance:
uuid: "8c854f7e22a541a1ad74ce07a44b997d"
format_stamp: "Formatted at 2026-02-03 09:18:41 on dist-test-slave-x12j"
I20260203 09:18:41.194064 27553 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260203 09:18:41.197384 32589 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 09:18:41.198196 27553 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260203 09:18:41.198467 27553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1770110140020880-27553-0/minicluster-data/master-0-root
uuid: "8c854f7e22a541a1ad74ce07a44b997d"
format_stamp: "Formatted at 2026-02-03 09:18:41 on dist-test-slave-x12j"
I20260203 09:18:41.198706 27553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1770110140020880-27553-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1770110140020880-27553-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1770110140020880-27553-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 09:18:41.210408 27553 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 09:18:41.211596 27553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 09:18:41.249341 27553 rpc_server.cc:307] RPC server started. Bound to: 127.26.232.126:37521
I20260203 09:18:41.249454 32641 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.232.126:37521 every 8 connection(s)
I20260203 09:18:41.253101 32642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.263763 32642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c854f7e22a541a1ad74ce07a44b997d: Bootstrap starting.
I20260203 09:18:41.269222 32642 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c854f7e22a541a1ad74ce07a44b997d: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:41.273635 32642 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c854f7e22a541a1ad74ce07a44b997d: No bootstrap required, opened a new log
I20260203 09:18:41.276247 32642 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8c854f7e22a541a1ad74ce07a44b997d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c854f7e22a541a1ad74ce07a44b997d" member_type: VOTER }
I20260203 09:18:41.276664 32642 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8c854f7e22a541a1ad74ce07a44b997d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:41.276906 32642 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8c854f7e22a541a1ad74ce07a44b997d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c854f7e22a541a1ad74ce07a44b997d, State: Initialized, Role: FOLLOWER
I20260203 09:18:41.277465 32642 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c854f7e22a541a1ad74ce07a44b997d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c854f7e22a541a1ad74ce07a44b997d" member_type: VOTER }
I20260203 09:18:41.277884 32642 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8c854f7e22a541a1ad74ce07a44b997d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260203 09:18:41.278101 32642 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8c854f7e22a541a1ad74ce07a44b997d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260203 09:18:41.278363 32642 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8c854f7e22a541a1ad74ce07a44b997d [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:41.283493 32642 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8c854f7e22a541a1ad74ce07a44b997d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c854f7e22a541a1ad74ce07a44b997d" member_type: VOTER }
I20260203 09:18:41.284044 32642 leader_election.cc:304] T 00000000000000000000000000000000 P 8c854f7e22a541a1ad74ce07a44b997d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c854f7e22a541a1ad74ce07a44b997d; no voters:
I20260203 09:18:41.285231 32642 leader_election.cc:290] T 00000000000000000000000000000000 P 8c854f7e22a541a1ad74ce07a44b997d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260203 09:18:41.285617 32645 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8c854f7e22a541a1ad74ce07a44b997d [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:41.286892 32645 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8c854f7e22a541a1ad74ce07a44b997d [term 1 LEADER]: Becoming Leader. State: Replica: 8c854f7e22a541a1ad74ce07a44b997d, State: Running, Role: LEADER
I20260203 09:18:41.287557 32645 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c854f7e22a541a1ad74ce07a44b997d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c854f7e22a541a1ad74ce07a44b997d" member_type: VOTER }
I20260203 09:18:41.288097 32642 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8c854f7e22a541a1ad74ce07a44b997d [sys.catalog]: configured and running, proceeding with master startup.
I20260203 09:18:41.291654 32646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c854f7e22a541a1ad74ce07a44b997d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8c854f7e22a541a1ad74ce07a44b997d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c854f7e22a541a1ad74ce07a44b997d" member_type: VOTER } }
I20260203 09:18:41.292285 32646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c854f7e22a541a1ad74ce07a44b997d [sys.catalog]: This master's current role is: LEADER
I20260203 09:18:41.292454 32647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c854f7e22a541a1ad74ce07a44b997d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c854f7e22a541a1ad74ce07a44b997d. Latest consensus state: current_term: 1 leader_uuid: "8c854f7e22a541a1ad74ce07a44b997d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c854f7e22a541a1ad74ce07a44b997d" member_type: VOTER } }
I20260203 09:18:41.293033 32647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c854f7e22a541a1ad74ce07a44b997d [sys.catalog]: This master's current role is: LEADER
I20260203 09:18:41.295012 32651 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260203 09:18:41.299733 32651 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260203 09:18:41.302745 27553 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260203 09:18:41.308596 32651 catalog_manager.cc:1357] Generated new cluster ID: 90ea0b5b59e34e2d8f3145b055b2fe71
I20260203 09:18:41.308938 32651 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260203 09:18:41.327478 32651 catalog_manager.cc:1380] Generated new certificate authority record
I20260203 09:18:41.329020 32651 catalog_manager.cc:1514] Loading token signing keys...
I20260203 09:18:41.340039 32651 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 8c854f7e22a541a1ad74ce07a44b997d: Generated new TSK 0
I20260203 09:18:41.340605 32651 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260203 09:18:41.369953 27553 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 09:18:41.375771 32663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:18:41.377035 32664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:18:41.378465 32666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:18:41.379413 27553 server_base.cc:1060] running on GCE node
I20260203 09:18:41.380596 27553 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260203 09:18:41.380821 27553 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260203 09:18:41.380998 27553 hybrid_clock.cc:648] HybridClock initialized: now 1770110321380979 us; error 0 us; skew 500 ppm
I20260203 09:18:41.381502 27553 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260203 09:18:41.383754 27553 webserver.cc:492] Webserver started at http://127.26.232.65:33423/ using document root <none> and password file <none>
I20260203 09:18:41.384264 27553 fs_manager.cc:362] Metadata directory not provided
I20260203 09:18:41.384434 27553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 09:18:41.384714 27553 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 09:18:41.385779 27553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1770110140020880-27553-0/minicluster-data/ts-0-root/instance:
uuid: "1a4d6aa056f44fb995225297c3cae89c"
format_stamp: "Formatted at 2026-02-03 09:18:41 on dist-test-slave-x12j"
I20260203 09:18:41.390213 27553 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260203 09:18:41.393464 32671 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 09:18:41.394359 27553 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260203 09:18:41.394646 27553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1770110140020880-27553-0/minicluster-data/ts-0-root
uuid: "1a4d6aa056f44fb995225297c3cae89c"
format_stamp: "Formatted at 2026-02-03 09:18:41 on dist-test-slave-x12j"
I20260203 09:18:41.394948 27553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1770110140020880-27553-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1770110140020880-27553-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1770110140020880-27553-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 09:18:41.413303 27553 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 09:18:41.414536 27553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 09:18:41.415946 27553 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260203 09:18:41.418267 27553 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260203 09:18:41.418467 27553 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260203 09:18:41.418687 27553 ts_tablet_manager.cc:616] Registered 0 tablets
I20260203 09:18:41.418833 27553 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260203 09:18:41.459053 27553 rpc_server.cc:307] RPC server started. Bound to: 127.26.232.65:39083
I20260203 09:18:41.459133 32733 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.232.65:39083 every 8 connection(s)
I20260203 09:18:41.464099 27553 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 09:18:41.472218 32738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:18:41.475481 27553 server_base.cc:1060] running on GCE node
W20260203 09:18:41.475591 32741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:18:41.475742 32739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:18:41.477550 27553 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260203 09:18:41.477773 27553 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260203 09:18:41.477999 27553 hybrid_clock.cc:648] HybridClock initialized: now 1770110321477973 us; error 0 us; skew 500 ppm
I20260203 09:18:41.478438 32734 heartbeater.cc:344] Connected to a master server at 127.26.232.126:37521
I20260203 09:18:41.478617 27553 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260203 09:18:41.478826 32734 heartbeater.cc:461] Registering TS with master...
I20260203 09:18:41.479650 32734 heartbeater.cc:507] Master 127.26.232.126:37521 requested a full tablet report, sending...
I20260203 09:18:41.481359 27553 webserver.cc:492] Webserver started at http://127.26.232.66:36989/ using document root <none> and password file <none>
I20260203 09:18:41.481730 32606 ts_manager.cc:194] Registered new tserver with Master: 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083)
I20260203 09:18:41.481920 27553 fs_manager.cc:362] Metadata directory not provided
I20260203 09:18:41.482203 27553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 09:18:41.482447 27553 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 09:18:41.483515 32606 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52658
I20260203 09:18:41.483526 27553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1770110140020880-27553-0/minicluster-data/ts-1-root/instance:
uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
format_stamp: "Formatted at 2026-02-03 09:18:41 on dist-test-slave-x12j"
I20260203 09:18:41.488183 27553 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260203 09:18:41.491972 32746 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 09:18:41.492828 27553 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260203 09:18:41.493124 27553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1770110140020880-27553-0/minicluster-data/ts-1-root
uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
format_stamp: "Formatted at 2026-02-03 09:18:41 on dist-test-slave-x12j"
I20260203 09:18:41.493414 27553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1770110140020880-27553-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1770110140020880-27553-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1770110140020880-27553-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 09:18:41.512509 27553 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 09:18:41.514067 27553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 09:18:41.515584 27553 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260203 09:18:41.517846 27553 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260203 09:18:41.518054 27553 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260203 09:18:41.518272 27553 ts_tablet_manager.cc:616] Registered 0 tablets
I20260203 09:18:41.518417 27553 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260203 09:18:41.558825 27553 rpc_server.cc:307] RPC server started. Bound to: 127.26.232.66:40595
I20260203 09:18:41.558944 341 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.232.66:40595 every 8 connection(s)
I20260203 09:18:41.563444 27553 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260203 09:18:41.569609 345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:18:41.571379 346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260203 09:18:41.572970 348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260203 09:18:41.573849 27553 server_base.cc:1060] running on GCE node
I20260203 09:18:41.574837 27553 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260203 09:18:41.575053 27553 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260203 09:18:41.575212 27553 hybrid_clock.cc:648] HybridClock initialized: now 1770110321575195 us; error 0 us; skew 500 ppm
I20260203 09:18:41.575444 342 heartbeater.cc:344] Connected to a master server at 127.26.232.126:37521
I20260203 09:18:41.575785 27553 server_base.cc:860] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260203 09:18:41.575816 342 heartbeater.cc:461] Registering TS with master...
I20260203 09:18:41.576714 342 heartbeater.cc:507] Master 127.26.232.126:37521 requested a full tablet report, sending...
I20260203 09:18:41.578502 27553 webserver.cc:492] Webserver started at http://127.26.232.67:33335/ using document root <none> and password file <none>
I20260203 09:18:41.578830 32606 ts_manager.cc:194] Registered new tserver with Master: e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595)
I20260203 09:18:41.579210 27553 fs_manager.cc:362] Metadata directory not provided
I20260203 09:18:41.579494 27553 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260203 09:18:41.579803 27553 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260203 09:18:41.580698 32606 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52668
I20260203 09:18:41.581418 27553 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1770110140020880-27553-0/minicluster-data/ts-2-root/instance:
uuid: "680bfc8acebf4aaf91e4794096f34c2f"
format_stamp: "Formatted at 2026-02-03 09:18:41 on dist-test-slave-x12j"
I20260203 09:18:41.585999 27553 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260203 09:18:41.589286 353 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260203 09:18:41.590090 27553 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260203 09:18:41.590368 27553 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1770110140020880-27553-0/minicluster-data/ts-2-root
uuid: "680bfc8acebf4aaf91e4794096f34c2f"
format_stamp: "Formatted at 2026-02-03 09:18:41 on dist-test-slave-x12j"
I20260203 09:18:41.590632 27553 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1770110140020880-27553-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1770110140020880-27553-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task_GAGRY/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1770110140020880-27553-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260203 09:18:41.606424 27553 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260203 09:18:41.607620 27553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260203 09:18:41.609122 27553 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260203 09:18:41.611295 27553 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260203 09:18:41.611497 27553 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260203 09:18:41.611711 27553 ts_tablet_manager.cc:616] Registered 0 tablets
I20260203 09:18:41.611858 27553 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260203 09:18:41.651680 27553 rpc_server.cc:307] RPC server started. Bound to: 127.26.232.67:42635
I20260203 09:18:41.651784 415 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.26.232.67:42635 every 8 connection(s)
I20260203 09:18:41.666625 416 heartbeater.cc:344] Connected to a master server at 127.26.232.126:37521
I20260203 09:18:41.667171 416 heartbeater.cc:461] Registering TS with master...
I20260203 09:18:41.668110 416 heartbeater.cc:507] Master 127.26.232.126:37521 requested a full tablet report, sending...
I20260203 09:18:41.670534 32606 ts_manager.cc:194] Registered new tserver with Master: 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:41.671458 27553 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016715489s
I20260203 09:18:41.672142 32606 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52672
I20260203 09:18:41.696817 32606 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52676:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260203 09:18:41.700613 32606 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260203 09:18:41.775274 32698 tablet_service.cc:1505] Processing CreateTablet for tablet df3afc76dc2c433085206e027f693862 (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260203 09:18:41.777921 32697 tablet_service.cc:1505] Processing CreateTablet for tablet 3b9758e8663e49aaa5ecaf5f8e3da6d2 (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260203 09:18:41.780385 32696 tablet_service.cc:1505] Processing CreateTablet for tablet 805a3fc418794c95890ee9ed803b3f00 (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260203 09:18:41.782864 32695 tablet_service.cc:1505] Processing CreateTablet for tablet 6a2c729bc0f147799a4b75e98082559c (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260203 09:18:41.785523 32699 tablet_service.cc:1505] Processing CreateTablet for tablet a05059935c4c436984c601aeb649fd70 (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260203 09:18:41.788753 32694 tablet_service.cc:1505] Processing CreateTablet for tablet d1c0b217cc424f539d0a9281cda6a9ce (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260203 09:18:41.791213 32693 tablet_service.cc:1505] Processing CreateTablet for tablet 67a1e7ee026e45abbc27e3b1db8c3f0c (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260203 09:18:41.794834 32698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df3afc76dc2c433085206e027f693862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.794438 32692 tablet_service.cc:1505] Processing CreateTablet for tablet 15672473fef9443f99c480d08fd50796 (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260203 09:18:41.795563 32694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1c0b217cc424f539d0a9281cda6a9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.796188 32692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15672473fef9443f99c480d08fd50796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.796948 32697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b9758e8663e49aaa5ecaf5f8e3da6d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.797571 32699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a05059935c4c436984c601aeb649fd70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.799799 32693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a1e7ee026e45abbc27e3b1db8c3f0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.801926 32695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a2c729bc0f147799a4b75e98082559c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.803490 32696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 805a3fc418794c95890ee9ed803b3f00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.818341 32691 tablet_service.cc:1505] Processing CreateTablet for tablet 804a15921c66442aa7512680adfd955e (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260203 09:18:41.819721 32691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 804a15921c66442aa7512680adfd955e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.870240 431 tablet_bootstrap.cc:492] T d1c0b217cc424f539d0a9281cda6a9ce P 1a4d6aa056f44fb995225297c3cae89c: Bootstrap starting.
I20260203 09:18:41.875138 306 tablet_service.cc:1505] Processing CreateTablet for tablet a05059935c4c436984c601aeb649fd70 (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260203 09:18:41.876752 306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a05059935c4c436984c601aeb649fd70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.877028 304 tablet_service.cc:1505] Processing CreateTablet for tablet 3b9758e8663e49aaa5ecaf5f8e3da6d2 (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260203 09:18:41.878607 304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b9758e8663e49aaa5ecaf5f8e3da6d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.878866 301 tablet_service.cc:1505] Processing CreateTablet for tablet d1c0b217cc424f539d0a9281cda6a9ce (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260203 09:18:41.880165 301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1c0b217cc424f539d0a9281cda6a9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.880873 303 tablet_service.cc:1505] Processing CreateTablet for tablet 805a3fc418794c95890ee9ed803b3f00 (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260203 09:18:41.882203 303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 805a3fc418794c95890ee9ed803b3f00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.875594 305 tablet_service.cc:1505] Processing CreateTablet for tablet df3afc76dc2c433085206e027f693862 (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260203 09:18:41.884099 380 tablet_service.cc:1505] Processing CreateTablet for tablet df3afc76dc2c433085206e027f693862 (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260203 09:18:41.885304 305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df3afc76dc2c433085206e027f693862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.885524 380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df3afc76dc2c433085206e027f693862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.885839 300 tablet_service.cc:1505] Processing CreateTablet for tablet 67a1e7ee026e45abbc27e3b1db8c3f0c (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260203 09:18:41.887125 300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a1e7ee026e45abbc27e3b1db8c3f0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.889705 32767 tablet_service.cc:1505] Processing CreateTablet for tablet 15672473fef9443f99c480d08fd50796 (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260203 09:18:41.891070 32767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15672473fef9443f99c480d08fd50796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.890933 378 tablet_service.cc:1505] Processing CreateTablet for tablet 805a3fc418794c95890ee9ed803b3f00 (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260203 09:18:41.892346 378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 805a3fc418794c95890ee9ed803b3f00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.877103 302 tablet_service.cc:1505] Processing CreateTablet for tablet 6a2c729bc0f147799a4b75e98082559c (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260203 09:18:41.895437 302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a2c729bc0f147799a4b75e98082559c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.895763 374 tablet_service.cc:1505] Processing CreateTablet for tablet 15672473fef9443f99c480d08fd50796 (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260203 09:18:41.896733 376 tablet_service.cc:1505] Processing CreateTablet for tablet d1c0b217cc424f539d0a9281cda6a9ce (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260203 09:18:41.898464 377 tablet_service.cc:1505] Processing CreateTablet for tablet 6a2c729bc0f147799a4b75e98082559c (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260203 09:18:41.898785 32766 tablet_service.cc:1505] Processing CreateTablet for tablet 804a15921c66442aa7512680adfd955e (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260203 09:18:41.895777 381 tablet_service.cc:1505] Processing CreateTablet for tablet a05059935c4c436984c601aeb649fd70 (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260203 09:18:41.901672 373 tablet_service.cc:1505] Processing CreateTablet for tablet 804a15921c66442aa7512680adfd955e (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260203 09:18:41.903539 375 tablet_service.cc:1505] Processing CreateTablet for tablet 67a1e7ee026e45abbc27e3b1db8c3f0c (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260203 09:18:41.889549 379 tablet_service.cc:1505] Processing CreateTablet for tablet 3b9758e8663e49aaa5ecaf5f8e3da6d2 (DEFAULT_TABLE table=test-workload [id=ca7866a3180d40ebae333baacc414328]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260203 09:18:41.900454 32766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 804a15921c66442aa7512680adfd955e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.906636 376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1c0b217cc424f539d0a9281cda6a9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.908043 377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a2c729bc0f147799a4b75e98082559c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.913295 381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a05059935c4c436984c601aeb649fd70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.917284 373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 804a15921c66442aa7512680adfd955e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.877058 431 tablet_bootstrap.cc:654] T d1c0b217cc424f539d0a9281cda6a9ce P 1a4d6aa056f44fb995225297c3cae89c: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:41.921154 375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67a1e7ee026e45abbc27e3b1db8c3f0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.924856 374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15672473fef9443f99c480d08fd50796. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.926398 379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b9758e8663e49aaa5ecaf5f8e3da6d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:41.962981 431 tablet_bootstrap.cc:492] T d1c0b217cc424f539d0a9281cda6a9ce P 1a4d6aa056f44fb995225297c3cae89c: No bootstrap required, opened a new log
I20260203 09:18:41.963840 431 ts_tablet_manager.cc:1403] T d1c0b217cc424f539d0a9281cda6a9ce P 1a4d6aa056f44fb995225297c3cae89c: Time spent bootstrapping tablet: real 0.094s user 0.012s sys 0.000s
I20260203 09:18:41.966944 431 raft_consensus.cc:359] T d1c0b217cc424f539d0a9281cda6a9ce P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:41.967804 431 raft_consensus.cc:385] T d1c0b217cc424f539d0a9281cda6a9ce P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:41.968252 431 raft_consensus.cc:740] T d1c0b217cc424f539d0a9281cda6a9ce P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Initialized, Role: FOLLOWER
I20260203 09:18:41.969197 431 consensus_queue.cc:260] T d1c0b217cc424f539d0a9281cda6a9ce P 1a4d6aa056f44fb995225297c3cae89c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:41.979744 432 tablet_bootstrap.cc:492] T a05059935c4c436984c601aeb649fd70 P e1394f30f39e4553a7328aa2d0a6e6dd: Bootstrap starting.
I20260203 09:18:41.988942 432 tablet_bootstrap.cc:654] T a05059935c4c436984c601aeb649fd70 P e1394f30f39e4553a7328aa2d0a6e6dd: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:41.990170 32734 heartbeater.cc:499] Master 127.26.232.126:37521 was elected leader, sending a full tablet report...
I20260203 09:18:41.994134 431 ts_tablet_manager.cc:1434] T d1c0b217cc424f539d0a9281cda6a9ce P 1a4d6aa056f44fb995225297c3cae89c: Time spent starting tablet: real 0.030s user 0.007s sys 0.000s
I20260203 09:18:41.995267 431 tablet_bootstrap.cc:492] T df3afc76dc2c433085206e027f693862 P 1a4d6aa056f44fb995225297c3cae89c: Bootstrap starting.
I20260203 09:18:42.001706 431 tablet_bootstrap.cc:654] T df3afc76dc2c433085206e027f693862 P 1a4d6aa056f44fb995225297c3cae89c: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:41.989804 435 tablet_bootstrap.cc:492] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f: Bootstrap starting.
I20260203 09:18:42.024523 435 tablet_bootstrap.cc:654] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:42.027107 431 tablet_bootstrap.cc:492] T df3afc76dc2c433085206e027f693862 P 1a4d6aa056f44fb995225297c3cae89c: No bootstrap required, opened a new log
I20260203 09:18:42.027107 432 tablet_bootstrap.cc:492] T a05059935c4c436984c601aeb649fd70 P e1394f30f39e4553a7328aa2d0a6e6dd: No bootstrap required, opened a new log
I20260203 09:18:42.027881 432 ts_tablet_manager.cc:1403] T a05059935c4c436984c601aeb649fd70 P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent bootstrapping tablet: real 0.048s user 0.005s sys 0.016s
I20260203 09:18:42.027891 431 ts_tablet_manager.cc:1403] T df3afc76dc2c433085206e027f693862 P 1a4d6aa056f44fb995225297c3cae89c: Time spent bootstrapping tablet: real 0.033s user 0.011s sys 0.015s
I20260203 09:18:42.030831 431 raft_consensus.cc:359] T df3afc76dc2c433085206e027f693862 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.030993 432 raft_consensus.cc:359] T a05059935c4c436984c601aeb649fd70 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } }
I20260203 09:18:42.031605 431 raft_consensus.cc:385] T df3afc76dc2c433085206e027f693862 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.031730 432 raft_consensus.cc:385] T a05059935c4c436984c601aeb649fd70 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.032001 431 raft_consensus.cc:740] T df3afc76dc2c433085206e027f693862 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.032047 432 raft_consensus.cc:740] T a05059935c4c436984c601aeb649fd70 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1394f30f39e4553a7328aa2d0a6e6dd, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.032876 431 consensus_queue.cc:260] T df3afc76dc2c433085206e027f693862 P 1a4d6aa056f44fb995225297c3cae89c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.032991 432 consensus_queue.cc:260] T a05059935c4c436984c601aeb649fd70 P e1394f30f39e4553a7328aa2d0a6e6dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } }
I20260203 09:18:42.033830 435 tablet_bootstrap.cc:492] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f: No bootstrap required, opened a new log
I20260203 09:18:42.034299 435 ts_tablet_manager.cc:1403] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f: Time spent bootstrapping tablet: real 0.045s user 0.006s sys 0.003s
I20260203 09:18:42.035343 431 ts_tablet_manager.cc:1434] T df3afc76dc2c433085206e027f693862 P 1a4d6aa056f44fb995225297c3cae89c: Time spent starting tablet: real 0.007s user 0.002s sys 0.003s
I20260203 09:18:42.036469 431 tablet_bootstrap.cc:492] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c: Bootstrap starting.
I20260203 09:18:42.037174 435 raft_consensus.cc:359] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.037974 435 raft_consensus.cc:385] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.038269 435 raft_consensus.cc:740] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.039108 435 consensus_queue.cc:260] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.043778 431 tablet_bootstrap.cc:654] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:42.048336 435 ts_tablet_manager.cc:1434] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f: Time spent starting tablet: real 0.014s user 0.007s sys 0.007s
I20260203 09:18:42.050225 435 tablet_bootstrap.cc:492] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f: Bootstrap starting.
I20260203 09:18:42.051545 416 heartbeater.cc:499] Master 127.26.232.126:37521 was elected leader, sending a full tablet report...
I20260203 09:18:42.051798 432 ts_tablet_manager.cc:1434] T a05059935c4c436984c601aeb649fd70 P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent starting tablet: real 0.023s user 0.016s sys 0.005s
I20260203 09:18:42.052119 342 heartbeater.cc:499] Master 127.26.232.126:37521 was elected leader, sending a full tablet report...
I20260203 09:18:42.053400 432 tablet_bootstrap.cc:492] T df3afc76dc2c433085206e027f693862 P e1394f30f39e4553a7328aa2d0a6e6dd: Bootstrap starting.
I20260203 09:18:42.055433 431 tablet_bootstrap.cc:492] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c: No bootstrap required, opened a new log
I20260203 09:18:42.056079 431 ts_tablet_manager.cc:1403] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.012s
I20260203 09:18:42.057503 435 tablet_bootstrap.cc:654] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:42.058902 431 raft_consensus.cc:359] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.059747 431 raft_consensus.cc:385] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.060089 431 raft_consensus.cc:740] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.060506 432 tablet_bootstrap.cc:654] T df3afc76dc2c433085206e027f693862 P e1394f30f39e4553a7328aa2d0a6e6dd: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:42.061019 431 consensus_queue.cc:260] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
W20260203 09:18:42.063009 343 tablet.cc:2378] T a05059935c4c436984c601aeb649fd70 P e1394f30f39e4553a7328aa2d0a6e6dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260203 09:18:42.064822 431 ts_tablet_manager.cc:1434] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c: Time spent starting tablet: real 0.008s user 0.002s sys 0.004s
I20260203 09:18:42.065945 431 tablet_bootstrap.cc:492] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c: Bootstrap starting.
I20260203 09:18:42.072283 431 tablet_bootstrap.cc:654] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:42.074230 435 tablet_bootstrap.cc:492] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f: No bootstrap required, opened a new log
I20260203 09:18:42.074867 435 ts_tablet_manager.cc:1403] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f: Time spent bootstrapping tablet: real 0.025s user 0.012s sys 0.004s
I20260203 09:18:42.078266 435 raft_consensus.cc:359] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.079075 435 raft_consensus.cc:385] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.079571 435 raft_consensus.cc:740] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.080407 435 consensus_queue.cc:260] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.083061 435 ts_tablet_manager.cc:1434] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260203 09:18:42.084162 435 tablet_bootstrap.cc:492] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f: Bootstrap starting.
I20260203 09:18:42.091156 435 tablet_bootstrap.cc:654] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:42.103617 435 tablet_bootstrap.cc:492] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f: No bootstrap required, opened a new log
I20260203 09:18:42.104225 435 ts_tablet_manager.cc:1403] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f: Time spent bootstrapping tablet: real 0.020s user 0.013s sys 0.003s
I20260203 09:18:42.107302 435 raft_consensus.cc:359] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.108376 435 raft_consensus.cc:385] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.108724 435 raft_consensus.cc:740] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.109515 435 consensus_queue.cc:260] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.112529 435 ts_tablet_manager.cc:1434] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f: Time spent starting tablet: real 0.008s user 0.005s sys 0.004s
I20260203 09:18:42.113780 435 tablet_bootstrap.cc:492] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f: Bootstrap starting.
I20260203 09:18:42.114207 440 raft_consensus.cc:493] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:42.114845 440 raft_consensus.cc:515] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.121083 435 tablet_bootstrap.cc:654] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:42.134481 435 tablet_bootstrap.cc:492] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f: No bootstrap required, opened a new log
I20260203 09:18:42.134750 32709 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df3afc76dc2c433085206e027f693862" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c" is_pre_election: true
I20260203 09:18:42.135093 435 ts_tablet_manager.cc:1403] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f: Time spent bootstrapping tablet: real 0.022s user 0.013s sys 0.004s
I20260203 09:18:42.135641 32709 raft_consensus.cc:2468] T df3afc76dc2c433085206e027f693862 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 0.
I20260203 09:18:42.136852 434 raft_consensus.cc:493] T d1c0b217cc424f539d0a9281cda6a9ce P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:42.137434 434 raft_consensus.cc:515] T d1c0b217cc424f539d0a9281cda6a9ce P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.138500 435 raft_consensus.cc:359] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.139343 435 raft_consensus.cc:385] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.139644 435 raft_consensus.cc:740] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.140568 435 consensus_queue.cc:260] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.142740 434 leader_election.cc:290] T d1c0b217cc424f539d0a9281cda6a9ce P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:42.144122 355 leader_election.cc:304] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, 680bfc8acebf4aaf91e4794096f34c2f; no voters:
I20260203 09:18:42.149392 448 raft_consensus.cc:2804] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:42.149868 448 raft_consensus.cc:493] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:42.150210 448 raft_consensus.cc:3060] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.154076 440 leader_election.cc:290] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595)
I20260203 09:18:42.158341 435 ts_tablet_manager.cc:1434] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f: Time spent starting tablet: real 0.023s user 0.008s sys 0.004s
I20260203 09:18:42.159611 435 tablet_bootstrap.cc:492] T 15672473fef9443f99c480d08fd50796 P 680bfc8acebf4aaf91e4794096f34c2f: Bootstrap starting.
I20260203 09:18:42.166589 435 tablet_bootstrap.cc:654] T 15672473fef9443f99c480d08fd50796 P 680bfc8acebf4aaf91e4794096f34c2f: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:42.170692 448 raft_consensus.cc:515] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.175853 448 leader_election.cc:290] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 election: Requested vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595)
I20260203 09:18:42.182570 435 tablet_bootstrap.cc:492] T 15672473fef9443f99c480d08fd50796 P 680bfc8acebf4aaf91e4794096f34c2f: No bootstrap required, opened a new log
I20260203 09:18:42.183291 435 ts_tablet_manager.cc:1403] T 15672473fef9443f99c480d08fd50796 P 680bfc8acebf4aaf91e4794096f34c2f: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.010s
I20260203 09:18:42.186388 435 raft_consensus.cc:359] T 15672473fef9443f99c480d08fd50796 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.187369 435 raft_consensus.cc:385] T 15672473fef9443f99c480d08fd50796 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.187693 435 raft_consensus.cc:740] T 15672473fef9443f99c480d08fd50796 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.189046 435 consensus_queue.cc:260] T 15672473fef9443f99c480d08fd50796 P 680bfc8acebf4aaf91e4794096f34c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.194216 435 ts_tablet_manager.cc:1434] T 15672473fef9443f99c480d08fd50796 P 680bfc8acebf4aaf91e4794096f34c2f: Time spent starting tablet: real 0.011s user 0.007s sys 0.002s
I20260203 09:18:42.195632 435 tablet_bootstrap.cc:492] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 680bfc8acebf4aaf91e4794096f34c2f: Bootstrap starting.
I20260203 09:18:42.202883 435 tablet_bootstrap.cc:654] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 680bfc8acebf4aaf91e4794096f34c2f: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:42.214882 435 tablet_bootstrap.cc:492] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 680bfc8acebf4aaf91e4794096f34c2f: No bootstrap required, opened a new log
I20260203 09:18:42.215480 435 ts_tablet_manager.cc:1403] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 680bfc8acebf4aaf91e4794096f34c2f: Time spent bootstrapping tablet: real 0.020s user 0.011s sys 0.005s
I20260203 09:18:42.218200 435 raft_consensus.cc:359] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.218888 435 raft_consensus.cc:385] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.218925 432 tablet_bootstrap.cc:492] T df3afc76dc2c433085206e027f693862 P e1394f30f39e4553a7328aa2d0a6e6dd: No bootstrap required, opened a new log
I20260203 09:18:42.219174 316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df3afc76dc2c433085206e027f693862" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" is_pre_election: true
I20260203 09:18:42.219569 432 ts_tablet_manager.cc:1403] T df3afc76dc2c433085206e027f693862 P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent bootstrapping tablet: real 0.167s user 0.065s sys 0.098s
I20260203 09:18:42.219265 435 raft_consensus.cc:740] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.220520 435 consensus_queue.cc:260] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 680bfc8acebf4aaf91e4794096f34c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
W20260203 09:18:42.220846 354 leader_election.cc:343] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:42.220783 315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df3afc76dc2c433085206e027f693862" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
W20260203 09:18:42.222452 354 leader_election.cc:343] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:42.222508 432 raft_consensus.cc:359] T df3afc76dc2c433085206e027f693862 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.223331 432 raft_consensus.cc:385] T df3afc76dc2c433085206e027f693862 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.223628 432 raft_consensus.cc:740] T df3afc76dc2c433085206e027f693862 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1394f30f39e4553a7328aa2d0a6e6dd, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.224321 432 consensus_queue.cc:260] T df3afc76dc2c433085206e027f693862 P e1394f30f39e4553a7328aa2d0a6e6dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.225075 435 ts_tablet_manager.cc:1434] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 680bfc8acebf4aaf91e4794096f34c2f: Time spent starting tablet: real 0.009s user 0.009s sys 0.000s
I20260203 09:18:42.226161 435 tablet_bootstrap.cc:492] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f: Bootstrap starting.
I20260203 09:18:42.232339 435 tablet_bootstrap.cc:654] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:42.233027 432 ts_tablet_manager.cc:1434] T df3afc76dc2c433085206e027f693862 P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent starting tablet: real 0.013s user 0.007s sys 0.000s
I20260203 09:18:42.236799 432 tablet_bootstrap.cc:492] T 805a3fc418794c95890ee9ed803b3f00 P e1394f30f39e4553a7328aa2d0a6e6dd: Bootstrap starting.
I20260203 09:18:42.243054 431 tablet_bootstrap.cc:492] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c: No bootstrap required, opened a new log
I20260203 09:18:42.243291 432 tablet_bootstrap.cc:654] T 805a3fc418794c95890ee9ed803b3f00 P e1394f30f39e4553a7328aa2d0a6e6dd: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:42.243526 435 tablet_bootstrap.cc:492] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f: No bootstrap required, opened a new log
I20260203 09:18:42.244074 435 ts_tablet_manager.cc:1403] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f: Time spent bootstrapping tablet: real 0.018s user 0.013s sys 0.002s
I20260203 09:18:42.244238 431 ts_tablet_manager.cc:1403] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c: Time spent bootstrapping tablet: real 0.178s user 0.068s sys 0.091s
W20260203 09:18:42.245066 355 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:39083, user_credentials={real_user=slave}} blocked reactor thread for 101137us
I20260203 09:18:42.246771 32709 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df3afc76dc2c433085206e027f693862" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c"
I20260203 09:18:42.247373 32709 raft_consensus.cc:3060] T df3afc76dc2c433085206e027f693862 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.247541 431 raft_consensus.cc:359] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.247638 435 raft_consensus.cc:359] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } }
I20260203 09:18:42.248633 435 raft_consensus.cc:385] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.248965 435 raft_consensus.cc:740] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.249650 435 consensus_queue.cc:260] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } }
I20260203 09:18:42.250712 432 tablet_bootstrap.cc:492] T 805a3fc418794c95890ee9ed803b3f00 P e1394f30f39e4553a7328aa2d0a6e6dd: No bootstrap required, opened a new log
I20260203 09:18:42.251129 432 ts_tablet_manager.cc:1403] T 805a3fc418794c95890ee9ed803b3f00 P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.002s
I20260203 09:18:42.251971 435 ts_tablet_manager.cc:1434] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260203 09:18:42.253170 435 tablet_bootstrap.cc:492] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f: Bootstrap starting.
I20260203 09:18:42.253314 432 raft_consensus.cc:359] T 805a3fc418794c95890ee9ed803b3f00 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.253924 432 raft_consensus.cc:385] T 805a3fc418794c95890ee9ed803b3f00 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.254141 432 raft_consensus.cc:740] T 805a3fc418794c95890ee9ed803b3f00 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1394f30f39e4553a7328aa2d0a6e6dd, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.254724 432 consensus_queue.cc:260] T 805a3fc418794c95890ee9ed803b3f00 P e1394f30f39e4553a7328aa2d0a6e6dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.255000 32709 raft_consensus.cc:2468] T df3afc76dc2c433085206e027f693862 P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 1.
I20260203 09:18:42.256960 432 ts_tablet_manager.cc:1434] T 805a3fc418794c95890ee9ed803b3f00 P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260203 09:18:42.257943 432 tablet_bootstrap.cc:492] T 804a15921c66442aa7512680adfd955e P e1394f30f39e4553a7328aa2d0a6e6dd: Bootstrap starting.
I20260203 09:18:42.259699 435 tablet_bootstrap.cc:654] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:42.261018 355 leader_election.cc:304] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, 680bfc8acebf4aaf91e4794096f34c2f; no voters: e1394f30f39e4553a7328aa2d0a6e6dd
I20260203 09:18:42.262223 450 raft_consensus.cc:2804] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:42.262310 431 raft_consensus.cc:385] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.262681 431 raft_consensus.cc:740] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.262766 450 raft_consensus.cc:697] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Becoming Leader. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Running, Role: LEADER
I20260203 09:18:42.263371 431 consensus_queue.cc:260] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.263630 450 consensus_queue.cc:237] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.265908 431 ts_tablet_manager.cc:1434] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c: Time spent starting tablet: real 0.021s user 0.002s sys 0.004s
I20260203 09:18:42.271878 432 tablet_bootstrap.cc:654] T 804a15921c66442aa7512680adfd955e P e1394f30f39e4553a7328aa2d0a6e6dd: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:42.274293 431 tablet_bootstrap.cc:492] T 6a2c729bc0f147799a4b75e98082559c P 1a4d6aa056f44fb995225297c3cae89c: Bootstrap starting.
I20260203 09:18:42.281282 431 tablet_bootstrap.cc:654] T 6a2c729bc0f147799a4b75e98082559c P 1a4d6aa056f44fb995225297c3cae89c: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:42.284935 432 tablet_bootstrap.cc:492] T 804a15921c66442aa7512680adfd955e P e1394f30f39e4553a7328aa2d0a6e6dd: No bootstrap required, opened a new log
I20260203 09:18:42.285395 435 tablet_bootstrap.cc:492] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f: No bootstrap required, opened a new log
I20260203 09:18:42.285777 432 ts_tablet_manager.cc:1403] T 804a15921c66442aa7512680adfd955e P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent bootstrapping tablet: real 0.028s user 0.012s sys 0.003s
I20260203 09:18:42.287591 391 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1c0b217cc424f539d0a9281cda6a9ce" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f" is_pre_election: true
I20260203 09:18:42.288718 432 raft_consensus.cc:359] T 804a15921c66442aa7512680adfd955e P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.285931 435 ts_tablet_manager.cc:1403] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f: Time spent bootstrapping tablet: real 0.033s user 0.008s sys 0.009s
I20260203 09:18:42.289247 434 raft_consensus.cc:493] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260203 09:18:42.289498 32672 leader_election.cc:343] T d1c0b217cc424f539d0a9281cda6a9ce P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:42.289774 434 raft_consensus.cc:515] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.291765 434 leader_election.cc:290] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:42.291836 435 raft_consensus.cc:359] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.292532 435 raft_consensus.cc:385] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.292765 432 raft_consensus.cc:385] T 804a15921c66442aa7512680adfd955e P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.292928 435 raft_consensus.cc:740] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.293126 432 raft_consensus.cc:740] T 804a15921c66442aa7512680adfd955e P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1394f30f39e4553a7328aa2d0a6e6dd, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.293927 435 consensus_queue.cc:260] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.294319 391 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15672473fef9443f99c480d08fd50796" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f" is_pre_election: true
I20260203 09:18:42.293990 432 consensus_queue.cc:260] T 804a15921c66442aa7512680adfd955e P e1394f30f39e4553a7328aa2d0a6e6dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.295094 391 raft_consensus.cc:2468] T 15672473fef9443f99c480d08fd50796 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 0.
I20260203 09:18:42.296868 32672 leader_election.cc:304] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, 680bfc8acebf4aaf91e4794096f34c2f; no voters:
W20260203 09:18:42.297991 32655 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:18:42.298663 435 ts_tablet_manager.cc:1434] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260203 09:18:42.302165 435 tablet_bootstrap.cc:492] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f: Bootstrap starting.
I20260203 09:18:42.302359 431 tablet_bootstrap.cc:492] T 6a2c729bc0f147799a4b75e98082559c P 1a4d6aa056f44fb995225297c3cae89c: No bootstrap required, opened a new log
I20260203 09:18:42.302850 431 ts_tablet_manager.cc:1403] T 6a2c729bc0f147799a4b75e98082559c P 1a4d6aa056f44fb995225297c3cae89c: Time spent bootstrapping tablet: real 0.029s user 0.019s sys 0.007s
I20260203 09:18:42.299450 432 ts_tablet_manager.cc:1434] T 804a15921c66442aa7512680adfd955e P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20260203 09:18:42.305059 431 raft_consensus.cc:359] T 6a2c729bc0f147799a4b75e98082559c P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.305893 431 raft_consensus.cc:385] T 6a2c729bc0f147799a4b75e98082559c P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.306252 431 raft_consensus.cc:740] T 6a2c729bc0f147799a4b75e98082559c P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.306602 435 tablet_bootstrap.cc:654] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:42.307387 432 tablet_bootstrap.cc:492] T 6a2c729bc0f147799a4b75e98082559c P e1394f30f39e4553a7328aa2d0a6e6dd: Bootstrap starting.
I20260203 09:18:42.307061 431 consensus_queue.cc:260] T 6a2c729bc0f147799a4b75e98082559c P 1a4d6aa056f44fb995225297c3cae89c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.311573 434 raft_consensus.cc:2804] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:42.312049 434 raft_consensus.cc:493] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:42.312849 434 raft_consensus.cc:3060] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.312089 32605 catalog_manager.cc:5654] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67). New cstate: current_term: 1 leader_uuid: "680bfc8acebf4aaf91e4794096f34c2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:42.314682 432 tablet_bootstrap.cc:654] T 6a2c729bc0f147799a4b75e98082559c P e1394f30f39e4553a7328aa2d0a6e6dd: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:42.320708 434 raft_consensus.cc:515] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.322966 315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1c0b217cc424f539d0a9281cda6a9ce" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" is_pre_election: true
I20260203 09:18:42.324633 316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15672473fef9443f99c480d08fd50796" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" is_pre_election: true
I20260203 09:18:42.327137 432 tablet_bootstrap.cc:492] T 6a2c729bc0f147799a4b75e98082559c P e1394f30f39e4553a7328aa2d0a6e6dd: No bootstrap required, opened a new log
W20260203 09:18:42.327461 32672 leader_election.cc:343] T d1c0b217cc424f539d0a9281cda6a9ce P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:42.327819 432 ts_tablet_manager.cc:1403] T 6a2c729bc0f147799a4b75e98082559c P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent bootstrapping tablet: real 0.021s user 0.011s sys 0.008s
I20260203 09:18:42.331573 435 tablet_bootstrap.cc:492] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f: No bootstrap required, opened a new log
I20260203 09:18:42.334070 435 ts_tablet_manager.cc:1403] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f: Time spent bootstrapping tablet: real 0.032s user 0.011s sys 0.017s
I20260203 09:18:42.333784 432 raft_consensus.cc:359] T 6a2c729bc0f147799a4b75e98082559c P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.334568 432 raft_consensus.cc:385] T 6a2c729bc0f147799a4b75e98082559c P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.333470 431 ts_tablet_manager.cc:1434] T 6a2c729bc0f147799a4b75e98082559c P 1a4d6aa056f44fb995225297c3cae89c: Time spent starting tablet: real 0.030s user 0.006s sys 0.008s
I20260203 09:18:42.335347 32672 leader_election.cc:304] T d1c0b217cc424f539d0a9281cda6a9ce P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c; no voters: 680bfc8acebf4aaf91e4794096f34c2f, e1394f30f39e4553a7328aa2d0a6e6dd
I20260203 09:18:42.336162 431 tablet_bootstrap.cc:492] T a05059935c4c436984c601aeb649fd70 P 1a4d6aa056f44fb995225297c3cae89c: Bootstrap starting.
I20260203 09:18:42.336509 434 leader_election.cc:290] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 election: Requested vote from peers e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:42.337206 434 raft_consensus.cc:2749] T d1c0b217cc424f539d0a9281cda6a9ce P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:42.328058 450 raft_consensus.cc:493] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:42.336902 435 raft_consensus.cc:359] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.338704 435 raft_consensus.cc:385] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.338346 450 raft_consensus.cc:515] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
W20260203 09:18:42.337742 32672 leader_election.cc:343] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:42.339035 435 raft_consensus.cc:740] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.339860 435 consensus_queue.cc:260] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.340803 440 raft_consensus.cc:493] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:42.341009 316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15672473fef9443f99c480d08fd50796" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
I20260203 09:18:42.341297 440 raft_consensus.cc:515] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.343071 431 tablet_bootstrap.cc:654] T a05059935c4c436984c601aeb649fd70 P 1a4d6aa056f44fb995225297c3cae89c: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:42.343642 391 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15672473fef9443f99c480d08fd50796" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f"
I20260203 09:18:42.344235 391 raft_consensus.cc:3060] T 15672473fef9443f99c480d08fd50796 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.334939 432 raft_consensus.cc:740] T 6a2c729bc0f147799a4b75e98082559c P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1394f30f39e4553a7328aa2d0a6e6dd, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.344482 32709 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "805a3fc418794c95890ee9ed803b3f00" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c" is_pre_election: true
I20260203 09:18:42.345243 432 consensus_queue.cc:260] T 6a2c729bc0f147799a4b75e98082559c P e1394f30f39e4553a7328aa2d0a6e6dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
W20260203 09:18:42.345883 355 leader_election.cc:343] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:42.343278 440 leader_election.cc:290] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595)
I20260203 09:18:42.347666 432 ts_tablet_manager.cc:1434] T 6a2c729bc0f147799a4b75e98082559c P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent starting tablet: real 0.017s user 0.004s sys 0.000s
I20260203 09:18:42.348068 435 ts_tablet_manager.cc:1434] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f: Time spent starting tablet: real 0.014s user 0.002s sys 0.003s
I20260203 09:18:42.348719 432 tablet_bootstrap.cc:492] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd: Bootstrap starting.
I20260203 09:18:42.345927 316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "805a3fc418794c95890ee9ed803b3f00" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" is_pre_election: true
I20260203 09:18:42.349557 316 raft_consensus.cc:2468] T 805a3fc418794c95890ee9ed803b3f00 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 0.
I20260203 09:18:42.352206 354 leader_election.cc:304] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bfc8acebf4aaf91e4794096f34c2f, e1394f30f39e4553a7328aa2d0a6e6dd; no voters: 1a4d6aa056f44fb995225297c3cae89c
I20260203 09:18:42.352429 32709 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "67a1e7ee026e45abbc27e3b1db8c3f0c" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c" is_pre_election: true
I20260203 09:18:42.353622 440 raft_consensus.cc:2804] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260203 09:18:42.353826 355 leader_election.cc:343] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:42.354020 440 raft_consensus.cc:493] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:42.354362 440 raft_consensus.cc:3060] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.354765 450 leader_election.cc:290] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595)
I20260203 09:18:42.355332 432 tablet_bootstrap.cc:654] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd: Neither blocks nor log segments found. Creating new log.
W20260203 09:18:42.356284 32672 leader_election.cc:343] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:42.358814 391 raft_consensus.cc:2468] T 15672473fef9443f99c480d08fd50796 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 1.
I20260203 09:18:42.360736 32672 leader_election.cc:304] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, 680bfc8acebf4aaf91e4794096f34c2f; no voters: e1394f30f39e4553a7328aa2d0a6e6dd
I20260203 09:18:42.361042 316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "67a1e7ee026e45abbc27e3b1db8c3f0c" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" is_pre_election: true
I20260203 09:18:42.361892 434 raft_consensus.cc:2804] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:42.362356 434 raft_consensus.cc:697] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [term 1 LEADER]: Becoming Leader. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Running, Role: LEADER
W20260203 09:18:42.362754 354 leader_election.cc:343] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:42.363214 354 leader_election.cc:304] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 680bfc8acebf4aaf91e4794096f34c2f; no voters: 1a4d6aa056f44fb995225297c3cae89c, e1394f30f39e4553a7328aa2d0a6e6dd
I20260203 09:18:42.363161 434 consensus_queue.cc:237] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.364585 450 raft_consensus.cc:2749] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:42.370811 432 tablet_bootstrap.cc:492] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd: No bootstrap required, opened a new log
I20260203 09:18:42.370811 431 tablet_bootstrap.cc:492] T a05059935c4c436984c601aeb649fd70 P 1a4d6aa056f44fb995225297c3cae89c: No bootstrap required, opened a new log
I20260203 09:18:42.371661 432 ts_tablet_manager.cc:1403] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent bootstrapping tablet: real 0.023s user 0.019s sys 0.000s
I20260203 09:18:42.371707 431 ts_tablet_manager.cc:1403] T a05059935c4c436984c601aeb649fd70 P 1a4d6aa056f44fb995225297c3cae89c: Time spent bootstrapping tablet: real 0.036s user 0.009s sys 0.004s
I20260203 09:18:42.374572 432 raft_consensus.cc:359] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.374867 431 raft_consensus.cc:359] T a05059935c4c436984c601aeb649fd70 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } }
I20260203 09:18:42.375578 432 raft_consensus.cc:385] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.375715 431 raft_consensus.cc:385] T a05059935c4c436984c601aeb649fd70 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.376052 432 raft_consensus.cc:740] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1394f30f39e4553a7328aa2d0a6e6dd, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.376164 431 raft_consensus.cc:740] T a05059935c4c436984c601aeb649fd70 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.376967 432 consensus_queue.cc:260] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.377125 431 consensus_queue.cc:260] T a05059935c4c436984c601aeb649fd70 P 1a4d6aa056f44fb995225297c3cae89c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } }
I20260203 09:18:42.379737 431 ts_tablet_manager.cc:1434] T a05059935c4c436984c601aeb649fd70 P 1a4d6aa056f44fb995225297c3cae89c: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260203 09:18:42.379439 32603 catalog_manager.cc:5654] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65). New cstate: current_term: 1 leader_uuid: "1a4d6aa056f44fb995225297c3cae89c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:42.380626 432 ts_tablet_manager.cc:1434] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent starting tablet: real 0.009s user 0.003s sys 0.002s
I20260203 09:18:42.380813 431 tablet_bootstrap.cc:492] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c: Bootstrap starting.
I20260203 09:18:42.381745 432 tablet_bootstrap.cc:492] T 67a1e7ee026e45abbc27e3b1db8c3f0c P e1394f30f39e4553a7328aa2d0a6e6dd: Bootstrap starting.
I20260203 09:18:42.383605 440 raft_consensus.cc:515] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.386729 32709 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "805a3fc418794c95890ee9ed803b3f00" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c"
I20260203 09:18:42.387715 431 tablet_bootstrap.cc:654] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:42.388317 432 tablet_bootstrap.cc:654] T 67a1e7ee026e45abbc27e3b1db8c3f0c P e1394f30f39e4553a7328aa2d0a6e6dd: Neither blocks nor log segments found. Creating new log.
W20260203 09:18:42.388223 355 leader_election.cc:343] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:42.390256 440 leader_election.cc:290] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 election: Requested vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595)
I20260203 09:18:42.390482 316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "805a3fc418794c95890ee9ed803b3f00" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
I20260203 09:18:42.391250 316 raft_consensus.cc:3060] T 805a3fc418794c95890ee9ed803b3f00 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.394245 432 tablet_bootstrap.cc:492] T 67a1e7ee026e45abbc27e3b1db8c3f0c P e1394f30f39e4553a7328aa2d0a6e6dd: No bootstrap required, opened a new log
I20260203 09:18:42.394845 432 ts_tablet_manager.cc:1403] T 67a1e7ee026e45abbc27e3b1db8c3f0c P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent bootstrapping tablet: real 0.013s user 0.012s sys 0.000s
I20260203 09:18:42.399919 431 tablet_bootstrap.cc:492] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c: No bootstrap required, opened a new log
I20260203 09:18:42.400710 431 ts_tablet_manager.cc:1403] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c: Time spent bootstrapping tablet: real 0.020s user 0.013s sys 0.006s
I20260203 09:18:42.403281 440 raft_consensus.cc:493] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:42.403563 316 raft_consensus.cc:2468] T 805a3fc418794c95890ee9ed803b3f00 P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 1.
I20260203 09:18:42.403892 431 raft_consensus.cc:359] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.404721 431 raft_consensus.cc:385] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.404335 432 raft_consensus.cc:359] T 67a1e7ee026e45abbc27e3b1db8c3f0c P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.404557 440 raft_consensus.cc:515] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.404979 354 leader_election.cc:304] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bfc8acebf4aaf91e4794096f34c2f, e1394f30f39e4553a7328aa2d0a6e6dd; no voters: 1a4d6aa056f44fb995225297c3cae89c
I20260203 09:18:42.405160 431 raft_consensus.cc:740] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.405320 432 raft_consensus.cc:385] T 67a1e7ee026e45abbc27e3b1db8c3f0c P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.405680 432 raft_consensus.cc:740] T 67a1e7ee026e45abbc27e3b1db8c3f0c P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1394f30f39e4553a7328aa2d0a6e6dd, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.406237 450 raft_consensus.cc:2804] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:42.406026 431 consensus_queue.cc:260] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.406445 432 consensus_queue.cc:260] T 67a1e7ee026e45abbc27e3b1db8c3f0c P e1394f30f39e4553a7328aa2d0a6e6dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.408860 431 ts_tablet_manager.cc:1434] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260203 09:18:42.409947 431 tablet_bootstrap.cc:492] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c: Bootstrap starting.
I20260203 09:18:42.411134 432 ts_tablet_manager.cc:1434] T 67a1e7ee026e45abbc27e3b1db8c3f0c P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent starting tablet: real 0.016s user 0.002s sys 0.004s
I20260203 09:18:42.412261 432 tablet_bootstrap.cc:492] T d1c0b217cc424f539d0a9281cda6a9ce P e1394f30f39e4553a7328aa2d0a6e6dd: Bootstrap starting.
I20260203 09:18:42.412171 32709 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b9758e8663e49aaa5ecaf5f8e3da6d2" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c" is_pre_election: true
I20260203 09:18:42.412972 32709 raft_consensus.cc:2468] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 0.
I20260203 09:18:42.414181 355 leader_election.cc:304] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, 680bfc8acebf4aaf91e4794096f34c2f; no voters:
I20260203 09:18:42.415091 448 raft_consensus.cc:2804] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:42.415477 448 raft_consensus.cc:493] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:42.415844 448 raft_consensus.cc:3060] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.416193 431 tablet_bootstrap.cc:654] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:42.419627 432 tablet_bootstrap.cc:654] T d1c0b217cc424f539d0a9281cda6a9ce P e1394f30f39e4553a7328aa2d0a6e6dd: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:42.406736 450 raft_consensus.cc:697] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Becoming Leader. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Running, Role: LEADER
I20260203 09:18:42.414204 315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b9758e8663e49aaa5ecaf5f8e3da6d2" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" is_pre_election: true
I20260203 09:18:42.421638 450 consensus_queue.cc:237] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
W20260203 09:18:42.422742 354 leader_election.cc:343] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:42.406796 440 leader_election.cc:290] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595)
I20260203 09:18:42.428247 431 tablet_bootstrap.cc:492] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c: No bootstrap required, opened a new log
I20260203 09:18:42.428884 431 ts_tablet_manager.cc:1403] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.011s
I20260203 09:18:42.429384 432 tablet_bootstrap.cc:492] T d1c0b217cc424f539d0a9281cda6a9ce P e1394f30f39e4553a7328aa2d0a6e6dd: No bootstrap required, opened a new log
I20260203 09:18:42.429934 432 ts_tablet_manager.cc:1403] T d1c0b217cc424f539d0a9281cda6a9ce P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.007s
I20260203 09:18:42.431653 431 raft_consensus.cc:359] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.434333 448 raft_consensus.cc:515] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.435060 431 raft_consensus.cc:385] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.435396 431 raft_consensus.cc:740] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.436013 431 consensus_queue.cc:260] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.432508 432 raft_consensus.cc:359] T d1c0b217cc424f539d0a9281cda6a9ce P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.436875 432 raft_consensus.cc:385] T d1c0b217cc424f539d0a9281cda6a9ce P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.437168 432 raft_consensus.cc:740] T d1c0b217cc424f539d0a9281cda6a9ce P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1394f30f39e4553a7328aa2d0a6e6dd, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.437800 432 consensus_queue.cc:260] T d1c0b217cc424f539d0a9281cda6a9ce P e1394f30f39e4553a7328aa2d0a6e6dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.438273 32709 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b9758e8663e49aaa5ecaf5f8e3da6d2" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c"
I20260203 09:18:42.439224 32709 raft_consensus.cc:3060] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.438935 32603 catalog_manager.cc:5654] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67). New cstate: current_term: 1 leader_uuid: "680bfc8acebf4aaf91e4794096f34c2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:42.439914 432 ts_tablet_manager.cc:1434] T d1c0b217cc424f539d0a9281cda6a9ce P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20260203 09:18:42.441075 461 raft_consensus.cc:493] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:42.441576 461 raft_consensus.cc:515] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.442293 431 ts_tablet_manager.cc:1434] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20260203 09:18:42.442593 450 raft_consensus.cc:493] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:42.443244 431 tablet_bootstrap.cc:492] T 804a15921c66442aa7512680adfd955e P 1a4d6aa056f44fb995225297c3cae89c: Bootstrap starting.
I20260203 09:18:42.443624 461 leader_election.cc:290] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:42.445181 391 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "67a1e7ee026e45abbc27e3b1db8c3f0c" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f" is_pre_election: true
I20260203 09:18:42.445856 391 raft_consensus.cc:2468] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 0.
I20260203 09:18:42.446996 32709 raft_consensus.cc:2468] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 1.
I20260203 09:18:42.447216 32672 leader_election.cc:304] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, 680bfc8acebf4aaf91e4794096f34c2f; no voters:
I20260203 09:18:42.448138 355 leader_election.cc:304] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, 680bfc8acebf4aaf91e4794096f34c2f; no voters:
I20260203 09:18:42.449004 440 raft_consensus.cc:2804] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:42.449476 432 tablet_bootstrap.cc:492] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P e1394f30f39e4553a7328aa2d0a6e6dd: Bootstrap starting.
I20260203 09:18:42.452912 461 raft_consensus.cc:2804] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:42.453431 461 raft_consensus.cc:493] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:42.453850 461 raft_consensus.cc:3060] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.454427 448 leader_election.cc:290] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 election: Requested vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595)
I20260203 09:18:42.454811 315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b9758e8663e49aaa5ecaf5f8e3da6d2" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
I20260203 09:18:42.455593 432 tablet_bootstrap.cc:654] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P e1394f30f39e4553a7328aa2d0a6e6dd: Neither blocks nor log segments found. Creating new log.
W20260203 09:18:42.457012 354 leader_election.cc:343] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:42.457058 316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "67a1e7ee026e45abbc27e3b1db8c3f0c" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" is_pre_election: true
I20260203 09:18:42.461638 316 raft_consensus.cc:2468] T 67a1e7ee026e45abbc27e3b1db8c3f0c P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 0.
I20260203 09:18:42.461773 439 raft_consensus.cc:493] T a05059935c4c436984c601aeb649fd70 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:42.462776 439 raft_consensus.cc:515] T a05059935c4c436984c601aeb649fd70 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } }
I20260203 09:18:42.449040 431 tablet_bootstrap.cc:654] T 804a15921c66442aa7512680adfd955e P 1a4d6aa056f44fb995225297c3cae89c: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:42.466938 439 leader_election.cc:290] T a05059935c4c436984c601aeb649fd70 P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:42.443065 450 raft_consensus.cc:515] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.484622 439 raft_consensus.cc:493] T df3afc76dc2c433085206e027f693862 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:42.489625 439 raft_consensus.cc:515] T df3afc76dc2c433085206e027f693862 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.492352 439 leader_election.cc:290] T df3afc76dc2c433085206e027f693862 P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:42.495389 448 raft_consensus.cc:493] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:42.496084 448 raft_consensus.cc:515] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.498345 448 leader_election.cc:290] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595)
I20260203 09:18:42.502295 32709 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "804a15921c66442aa7512680adfd955e" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c" is_pre_election: true
I20260203 09:18:42.504276 32708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a2c729bc0f147799a4b75e98082559c" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c" is_pre_election: true
I20260203 09:18:42.505132 32708 raft_consensus.cc:2468] T 6a2c729bc0f147799a4b75e98082559c P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 0.
W20260203 09:18:42.507295 355 leader_election.cc:343] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:42.508136 355 leader_election.cc:304] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, 680bfc8acebf4aaf91e4794096f34c2f; no voters:
I20260203 09:18:42.508617 450 leader_election.cc:290] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595)
I20260203 09:18:42.509292 450 raft_consensus.cc:493] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:42.509780 450 raft_consensus.cc:515] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.511497 448 raft_consensus.cc:2804] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:42.512076 448 raft_consensus.cc:493] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:42.512472 448 raft_consensus.cc:3060] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.515235 461 raft_consensus.cc:515] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.520785 440 raft_consensus.cc:697] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Becoming Leader. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Running, Role: LEADER
I20260203 09:18:42.531029 440 consensus_queue.cc:237] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.532545 314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1c0b217cc424f539d0a9281cda6a9ce" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" is_pre_election: true
I20260203 09:18:42.533389 314 raft_consensus.cc:2468] T d1c0b217cc424f539d0a9281cda6a9ce P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 0.
I20260203 09:18:42.521534 448 raft_consensus.cc:515] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.523483 315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "804a15921c66442aa7512680adfd955e" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" is_pre_election: true
I20260203 09:18:42.534770 354 leader_election.cc:304] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bfc8acebf4aaf91e4794096f34c2f, e1394f30f39e4553a7328aa2d0a6e6dd; no voters:
I20260203 09:18:42.535331 315 raft_consensus.cc:2468] T 804a15921c66442aa7512680adfd955e P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 0.
I20260203 09:18:42.535915 475 raft_consensus.cc:2804] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:42.536440 475 raft_consensus.cc:493] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:42.536787 475 raft_consensus.cc:3060] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.538722 32709 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a2c729bc0f147799a4b75e98082559c" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c"
I20260203 09:18:42.539490 32709 raft_consensus.cc:3060] T 6a2c729bc0f147799a4b75e98082559c P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.545297 448 leader_election.cc:290] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 election: Requested vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595)
I20260203 09:18:42.546108 448 raft_consensus.cc:493] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:42.546587 448 raft_consensus.cc:515] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } }
I20260203 09:18:42.549854 32707 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a05059935c4c436984c601aeb649fd70" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c" is_pre_election: true
I20260203 09:18:42.550573 32707 raft_consensus.cc:2468] T a05059935c4c436984c601aeb649fd70 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 0.
I20260203 09:18:42.551433 475 raft_consensus.cc:515] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.526922 32708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1c0b217cc424f539d0a9281cda6a9ce" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c" is_pre_election: true
I20260203 09:18:42.566628 32708 raft_consensus.cc:2468] T d1c0b217cc424f539d0a9281cda6a9ce P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 0.
I20260203 09:18:42.529794 450 leader_election.cc:290] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595)
I20260203 09:18:42.551893 355 leader_election.cc:304] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, 680bfc8acebf4aaf91e4794096f34c2f; no voters:
I20260203 09:18:42.524576 316 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a2c729bc0f147799a4b75e98082559c" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" is_pre_election: true
I20260203 09:18:42.554023 32709 raft_consensus.cc:2468] T 6a2c729bc0f147799a4b75e98082559c P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 1.
I20260203 09:18:42.555141 354 leader_election.cc:304] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 680bfc8acebf4aaf91e4794096f34c2f, e1394f30f39e4553a7328aa2d0a6e6dd; no voters: 1a4d6aa056f44fb995225297c3cae89c
I20260203 09:18:42.556574 461 leader_election.cc:290] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 election: Requested vote from peers e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:42.557878 315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "67a1e7ee026e45abbc27e3b1db8c3f0c" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
I20260203 09:18:42.564149 314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a2c729bc0f147799a4b75e98082559c" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
I20260203 09:18:42.565873 431 tablet_bootstrap.cc:492] T 804a15921c66442aa7512680adfd955e P 1a4d6aa056f44fb995225297c3cae89c: No bootstrap required, opened a new log
I20260203 09:18:42.567677 475 leader_election.cc:290] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 election: Requested vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595)
I20260203 09:18:42.569640 32708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1c0b217cc424f539d0a9281cda6a9ce" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c"
I20260203 09:18:42.568830 432 tablet_bootstrap.cc:492] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P e1394f30f39e4553a7328aa2d0a6e6dd: No bootstrap required, opened a new log
I20260203 09:18:42.571375 450 raft_consensus.cc:2804] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:42.570319 355 leader_election.cc:304] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, 680bfc8acebf4aaf91e4794096f34c2f; no voters:
I20260203 09:18:42.578552 450 raft_consensus.cc:493] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:42.572451 448 leader_election.cc:290] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595)
I20260203 09:18:42.578958 450 raft_consensus.cc:3060] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.569077 440 raft_consensus.cc:2804] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:42.579174 432 ts_tablet_manager.cc:1403] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent bootstrapping tablet: real 0.130s user 0.054s sys 0.058s
I20260203 09:18:42.580078 440 raft_consensus.cc:493] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:42.580466 440 raft_consensus.cc:3060] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.572995 313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1c0b217cc424f539d0a9281cda6a9ce" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
I20260203 09:18:42.572526 315 raft_consensus.cc:3060] T 67a1e7ee026e45abbc27e3b1db8c3f0c P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.582532 432 raft_consensus.cc:359] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.583216 432 raft_consensus.cc:385] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.583465 432 raft_consensus.cc:740] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1394f30f39e4553a7328aa2d0a6e6dd, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.584069 432 consensus_queue.cc:260] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P e1394f30f39e4553a7328aa2d0a6e6dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.585035 32709 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a05059935c4c436984c601aeb649fd70" candidate_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c" is_pre_election: true
I20260203 09:18:42.585703 32709 raft_consensus.cc:2468] T a05059935c4c436984c601aeb649fd70 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1394f30f39e4553a7328aa2d0a6e6dd in term 0.
I20260203 09:18:42.586207 432 ts_tablet_manager.cc:1434] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20260203 09:18:42.579665 448 raft_consensus.cc:2804] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:42.586710 32707 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df3afc76dc2c433085206e027f693862" candidate_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c" is_pre_election: true
I20260203 09:18:42.586946 448 raft_consensus.cc:697] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Becoming Leader. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Running, Role: LEADER
I20260203 09:18:42.587515 32707 raft_consensus.cc:2393] T df3afc76dc2c433085206e027f693862 P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1394f30f39e4553a7328aa2d0a6e6dd in current term 1: Already voted for candidate 680bfc8acebf4aaf91e4794096f34c2f in this term.
I20260203 09:18:42.587904 448 consensus_queue.cc:237] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.574805 391 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "67a1e7ee026e45abbc27e3b1db8c3f0c" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f"
I20260203 09:18:42.574420 32605 catalog_manager.cc:5654] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67). New cstate: current_term: 1 leader_uuid: "680bfc8acebf4aaf91e4794096f34c2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:42.589741 391 raft_consensus.cc:3060] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.581774 313 raft_consensus.cc:3060] T d1c0b217cc424f539d0a9281cda6a9ce P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.577904 32708 raft_consensus.cc:3060] T d1c0b217cc424f539d0a9281cda6a9ce P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.574811 431 ts_tablet_manager.cc:1403] T 804a15921c66442aa7512680adfd955e P 1a4d6aa056f44fb995225297c3cae89c: Time spent bootstrapping tablet: real 0.132s user 0.032s sys 0.068s
I20260203 09:18:42.569396 316 raft_consensus.cc:2468] T 6a2c729bc0f147799a4b75e98082559c P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 0.
I20260203 09:18:42.574939 314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a05059935c4c436984c601aeb649fd70" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" is_pre_election: true
I20260203 09:18:42.598371 314 raft_consensus.cc:2468] T a05059935c4c436984c601aeb649fd70 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 0.
I20260203 09:18:42.601567 431 raft_consensus.cc:359] T 804a15921c66442aa7512680adfd955e P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.606724 450 raft_consensus.cc:515] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.607296 431 raft_consensus.cc:385] T 804a15921c66442aa7512680adfd955e P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:42.607654 431 raft_consensus.cc:740] T 804a15921c66442aa7512680adfd955e P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Initialized, Role: FOLLOWER
I20260203 09:18:42.608438 431 consensus_queue.cc:260] T 804a15921c66442aa7512680adfd955e P 1a4d6aa056f44fb995225297c3cae89c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.609869 32707 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "804a15921c66442aa7512680adfd955e" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c"
I20260203 09:18:42.610509 32707 raft_consensus.cc:3060] T 804a15921c66442aa7512680adfd955e P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.610842 431 ts_tablet_manager.cc:1434] T 804a15921c66442aa7512680adfd955e P 1a4d6aa056f44fb995225297c3cae89c: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20260203 09:18:42.614549 390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a05059935c4c436984c601aeb649fd70" candidate_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f" is_pre_election: true
I20260203 09:18:42.615068 450 leader_election.cc:290] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 election: Requested vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595)
I20260203 09:18:42.603566 32708 raft_consensus.cc:2468] T d1c0b217cc424f539d0a9281cda6a9ce P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 1.
I20260203 09:18:42.604884 315 raft_consensus.cc:2468] T 67a1e7ee026e45abbc27e3b1db8c3f0c P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 1.
I20260203 09:18:42.606354 440 raft_consensus.cc:515] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } }
I20260203 09:18:42.603430 391 raft_consensus.cc:2468] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 1.
I20260203 09:18:42.617193 440 leader_election.cc:290] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 election: Requested vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595)
I20260203 09:18:42.624855 314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a05059935c4c436984c601aeb649fd70" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
I20260203 09:18:42.625303 32708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a05059935c4c436984c601aeb649fd70" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c"
I20260203 09:18:42.625476 314 raft_consensus.cc:3060] T a05059935c4c436984c601aeb649fd70 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.625823 32708 raft_consensus.cc:3060] T a05059935c4c436984c601aeb649fd70 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.627301 32707 raft_consensus.cc:2468] T 804a15921c66442aa7512680adfd955e P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 1.
I20260203 09:18:42.617619 355 leader_election.cc:304] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, 680bfc8acebf4aaf91e4794096f34c2f; no voters:
I20260203 09:18:42.616189 389 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df3afc76dc2c433085206e027f693862" candidate_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f" is_pre_election: true
I20260203 09:18:42.623624 315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "804a15921c66442aa7512680adfd955e" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
I20260203 09:18:42.630576 315 raft_consensus.cc:3060] T 804a15921c66442aa7512680adfd955e P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.631050 440 raft_consensus.cc:2804] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:42.631795 440 raft_consensus.cc:697] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Becoming Leader. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Running, Role: LEADER
I20260203 09:18:42.632599 32708 raft_consensus.cc:2468] T a05059935c4c436984c601aeb649fd70 P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 1.
I20260203 09:18:42.633740 355 leader_election.cc:304] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, 680bfc8acebf4aaf91e4794096f34c2f; no voters:
I20260203 09:18:42.633909 32605 catalog_manager.cc:5654] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67). New cstate: current_term: 1 leader_uuid: "680bfc8acebf4aaf91e4794096f34c2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:42.635031 475 raft_consensus.cc:2804] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:42.635749 475 raft_consensus.cc:697] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Becoming Leader. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Running, Role: LEADER
I20260203 09:18:42.634745 355 leader_election.cc:304] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, 680bfc8acebf4aaf91e4794096f34c2f; no voters:
I20260203 09:18:42.616530 390 raft_consensus.cc:2393] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1394f30f39e4553a7328aa2d0a6e6dd in current term 1: Already voted for candidate 680bfc8acebf4aaf91e4794096f34c2f in this term.
I20260203 09:18:42.616696 32672 leader_election.cc:304] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, e1394f30f39e4553a7328aa2d0a6e6dd; no voters:
I20260203 09:18:42.636570 475 consensus_queue.cc:237] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.632629 440 consensus_queue.cc:237] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.619287 32748 leader_election.cc:304] T a05059935c4c436984c601aeb649fd70 P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, e1394f30f39e4553a7328aa2d0a6e6dd; no voters:
I20260203 09:18:42.607836 313 raft_consensus.cc:2468] T d1c0b217cc424f539d0a9281cda6a9ce P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 1.
I20260203 09:18:42.640115 461 raft_consensus.cc:2804] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:42.640733 461 raft_consensus.cc:697] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [term 1 LEADER]: Becoming Leader. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Running, Role: LEADER
I20260203 09:18:42.641631 461 consensus_queue.cc:237] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.645943 450 raft_consensus.cc:2804] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:42.646484 450 raft_consensus.cc:697] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Becoming Leader. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Running, Role: LEADER
I20260203 09:18:42.647356 450 consensus_queue.cc:237] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } }
I20260203 09:18:42.648691 32747 leader_election.cc:304] T df3afc76dc2c433085206e027f693862 P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1394f30f39e4553a7328aa2d0a6e6dd; no voters: 1a4d6aa056f44fb995225297c3cae89c, 680bfc8acebf4aaf91e4794096f34c2f
I20260203 09:18:42.653712 314 raft_consensus.cc:2468] T a05059935c4c436984c601aeb649fd70 P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 1.
I20260203 09:18:42.654374 439 raft_consensus.cc:2764] T a05059935c4c436984c601aeb649fd70 P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260203 09:18:42.657451 439 raft_consensus.cc:3060] T df3afc76dc2c433085206e027f693862 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.666206 315 raft_consensus.cc:2468] T 804a15921c66442aa7512680adfd955e P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 1.
I20260203 09:18:42.672574 486 raft_consensus.cc:493] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:42.672946 434 raft_consensus.cc:493] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:42.673398 486 raft_consensus.cc:515] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.673547 434 raft_consensus.cc:515] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.676071 434 leader_election.cc:290] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:42.677537 486 leader_election.cc:290] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:42.678491 32707 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15672473fef9443f99c480d08fd50796" candidate_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c" is_pre_election: true
I20260203 09:18:42.678491 389 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "805a3fc418794c95890ee9ed803b3f00" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f" is_pre_election: true
I20260203 09:18:42.682466 313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "805a3fc418794c95890ee9ed803b3f00" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" is_pre_election: true
I20260203 09:18:42.683486 313 raft_consensus.cc:2393] T 805a3fc418794c95890ee9ed803b3f00 P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1a4d6aa056f44fb995225297c3cae89c in current term 1: Already voted for candidate 680bfc8acebf4aaf91e4794096f34c2f in this term.
I20260203 09:18:42.686079 439 raft_consensus.cc:2749] T df3afc76dc2c433085206e027f693862 P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:42.689744 32672 leader_election.cc:304] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c; no voters: 680bfc8acebf4aaf91e4794096f34c2f, e1394f30f39e4553a7328aa2d0a6e6dd
I20260203 09:18:42.691828 461 raft_consensus.cc:3060] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.693104 390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15672473fef9443f99c480d08fd50796" candidate_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f" is_pre_election: true
I20260203 09:18:42.694000 390 raft_consensus.cc:2393] T 15672473fef9443f99c480d08fd50796 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1394f30f39e4553a7328aa2d0a6e6dd in current term 1: Already voted for candidate 1a4d6aa056f44fb995225297c3cae89c in this term.
I20260203 09:18:42.695364 32747 leader_election.cc:304] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1394f30f39e4553a7328aa2d0a6e6dd; no voters: 1a4d6aa056f44fb995225297c3cae89c, 680bfc8acebf4aaf91e4794096f34c2f
I20260203 09:18:42.696532 439 raft_consensus.cc:3060] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.696363 32603 catalog_manager.cc:5654] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65). New cstate: current_term: 1 leader_uuid: "1a4d6aa056f44fb995225297c3cae89c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:42.699537 461 raft_consensus.cc:2749] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:42.702798 439 raft_consensus.cc:2749] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:42.705909 32605 catalog_manager.cc:5654] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67). New cstate: current_term: 1 leader_uuid: "680bfc8acebf4aaf91e4794096f34c2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:42.707401 32605 catalog_manager.cc:5654] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67). New cstate: current_term: 1 leader_uuid: "680bfc8acebf4aaf91e4794096f34c2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:42.708551 32605 catalog_manager.cc:5654] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67). New cstate: current_term: 1 leader_uuid: "680bfc8acebf4aaf91e4794096f34c2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:42.731096 439 raft_consensus.cc:493] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:42.731627 439 raft_consensus.cc:515] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.733196 439 leader_election.cc:290] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:42.734076 32707 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b9758e8663e49aaa5ecaf5f8e3da6d2" candidate_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c" is_pre_election: true
I20260203 09:18:42.734159 390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b9758e8663e49aaa5ecaf5f8e3da6d2" candidate_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f" is_pre_election: true
I20260203 09:18:42.734788 32707 raft_consensus.cc:2393] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1394f30f39e4553a7328aa2d0a6e6dd in current term 1: Already voted for candidate 680bfc8acebf4aaf91e4794096f34c2f in this term.
I20260203 09:18:42.735666 32748 leader_election.cc:304] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1394f30f39e4553a7328aa2d0a6e6dd; no voters: 1a4d6aa056f44fb995225297c3cae89c, 680bfc8acebf4aaf91e4794096f34c2f
I20260203 09:18:42.736275 439 raft_consensus.cc:3060] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:42.741110 439 raft_consensus.cc:2749] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260203 09:18:42.827621 475 consensus_queue.cc:1048] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:42.839617 475 consensus_queue.cc:1048] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:42.839865 461 consensus_queue.cc:1048] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:42.843432 461 consensus_queue.cc:1048] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:42.877012 475 consensus_queue.cc:1048] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:42.891052 440 consensus_queue.cc:1048] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:42.907004 390 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "a05059935c4c436984c601aeb649fd70"
dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f"
mode: GRACEFUL
new_leader_uuid: "1a4d6aa056f44fb995225297c3cae89c"
from {username='slave'} at 127.0.0.1:45548
I20260203 09:18:42.907517 390 raft_consensus.cc:606] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Received request to transfer leadership to TS 1a4d6aa056f44fb995225297c3cae89c
I20260203 09:18:42.912837 390 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "df3afc76dc2c433085206e027f693862"
dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f"
mode: GRACEFUL
new_leader_uuid: "1a4d6aa056f44fb995225297c3cae89c"
from {username='slave'} at 127.0.0.1:45548
I20260203 09:18:42.913527 390 raft_consensus.cc:606] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Received request to transfer leadership to TS 1a4d6aa056f44fb995225297c3cae89c
I20260203 09:18:42.919734 390 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "3b9758e8663e49aaa5ecaf5f8e3da6d2"
dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f"
mode: GRACEFUL
new_leader_uuid: "1a4d6aa056f44fb995225297c3cae89c"
from {username='slave'} at 127.0.0.1:45548
I20260203 09:18:42.920271 390 raft_consensus.cc:606] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Received request to transfer leadership to TS 1a4d6aa056f44fb995225297c3cae89c
I20260203 09:18:42.925532 390 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "805a3fc418794c95890ee9ed803b3f00"
dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f"
mode: GRACEFUL
new_leader_uuid: "1a4d6aa056f44fb995225297c3cae89c"
from {username='slave'} at 127.0.0.1:45548
I20260203 09:18:42.926039 390 raft_consensus.cc:606] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Received request to transfer leadership to TS 1a4d6aa056f44fb995225297c3cae89c
I20260203 09:18:42.931440 390 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "6a2c729bc0f147799a4b75e98082559c"
dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f"
mode: GRACEFUL
new_leader_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
from {username='slave'} at 127.0.0.1:45548
I20260203 09:18:42.931962 390 raft_consensus.cc:606] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Received request to transfer leadership to TS e1394f30f39e4553a7328aa2d0a6e6dd
I20260203 09:18:42.936895 390 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "d1c0b217cc424f539d0a9281cda6a9ce"
dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f"
mode: GRACEFUL
new_leader_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
from {username='slave'} at 127.0.0.1:45548
I20260203 09:18:42.937403 390 raft_consensus.cc:606] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Received request to transfer leadership to TS e1394f30f39e4553a7328aa2d0a6e6dd
I20260203 09:18:42.937690 440 consensus_queue.cc:1048] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:42.944715 475 raft_consensus.cc:993] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f: : Instructing follower 1a4d6aa056f44fb995225297c3cae89c to start an election
I20260203 09:18:42.945220 475 raft_consensus.cc:1081] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Signalling peer 1a4d6aa056f44fb995225297c3cae89c to start an election
I20260203 09:18:42.947316 32708 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "3b9758e8663e49aaa5ecaf5f8e3da6d2"
dest_uuid: "1a4d6aa056f44fb995225297c3cae89c"
from {username='slave'} at 127.0.0.1:32786
I20260203 09:18:42.947875 32708 raft_consensus.cc:493] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:42.948226 32708 raft_consensus.cc:3060] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:42.950524 448 consensus_queue.cc:1048] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:42.955643 32709 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "67a1e7ee026e45abbc27e3b1db8c3f0c"
dest_uuid: "1a4d6aa056f44fb995225297c3cae89c"
mode: GRACEFUL
new_leader_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
from {username='slave'} at 127.0.0.1:32804
I20260203 09:18:42.956290 32709 raft_consensus.cc:606] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [term 1 LEADER]: Received request to transfer leadership to TS e1394f30f39e4553a7328aa2d0a6e6dd
I20260203 09:18:42.956935 32708 raft_consensus.cc:515] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.958618 32707 raft_consensus.cc:1240] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c [term 2 FOLLOWER]: Rejecting Update request from peer 680bfc8acebf4aaf91e4794096f34c2f for earlier term 1. Current term is 2. Ops: []
I20260203 09:18:42.961503 448 consensus_queue.cc:1059] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:42.962308 448 raft_consensus.cc:3055] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:42.962610 448 raft_consensus.cc:740] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Running, Role: LEADER
I20260203 09:18:42.962735 32708 leader_election.cc:290] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 2 election: Requested vote from peers e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:42.963635 32709 tablet_service.cc:2066] Received LeaderStepDown RPC: tablet_id: "15672473fef9443f99c480d08fd50796"
dest_uuid: "1a4d6aa056f44fb995225297c3cae89c"
mode: GRACEFUL
new_leader_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
from {username='slave'} at 127.0.0.1:32804
I20260203 09:18:42.963418 448 consensus_queue.cc:260] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.964263 32709 raft_consensus.cc:606] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [term 1 LEADER]: Received request to transfer leadership to TS e1394f30f39e4553a7328aa2d0a6e6dd
I20260203 09:18:42.964972 448 raft_consensus.cc:3060] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:42.964870 314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b9758e8663e49aaa5ecaf5f8e3da6d2" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
I20260203 09:18:42.965776 314 raft_consensus.cc:3060] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:42.965886 390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3b9758e8663e49aaa5ecaf5f8e3da6d2" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f"
I20260203 09:18:42.972708 314 raft_consensus.cc:2468] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P e1394f30f39e4553a7328aa2d0a6e6dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 2.
I20260203 09:18:42.973984 32672 leader_election.cc:304] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, e1394f30f39e4553a7328aa2d0a6e6dd; no voters:
I20260203 09:18:42.974934 496 raft_consensus.cc:2804] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:42.975417 496 raft_consensus.cc:697] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c [term 2 LEADER]: Becoming Leader. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Running, Role: LEADER
I20260203 09:18:42.976500 496 consensus_queue.cc:237] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:42.978209 390 raft_consensus.cc:2468] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 2.
I20260203 09:18:42.984360 32605 catalog_manager.cc:5654] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c reported cstate change: term changed from 1 to 2, leader changed from 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67) to 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65). New cstate: current_term: 2 leader_uuid: "1a4d6aa056f44fb995225297c3cae89c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:43.061354 496 consensus_queue.cc:1048] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:43.071596 461 consensus_queue.cc:1048] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:43.080240 495 raft_consensus.cc:993] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c: : Instructing follower e1394f30f39e4553a7328aa2d0a6e6dd to start an election
I20260203 09:18:43.080687 461 raft_consensus.cc:1081] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [term 1 LEADER]: Signalling peer e1394f30f39e4553a7328aa2d0a6e6dd to start an election
I20260203 09:18:43.082064 314 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "67a1e7ee026e45abbc27e3b1db8c3f0c"
dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
from {username='slave'} at 127.0.0.1:52216
I20260203 09:18:43.082531 314 raft_consensus.cc:493] T 67a1e7ee026e45abbc27e3b1db8c3f0c P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:43.082818 314 raft_consensus.cc:3060] T 67a1e7ee026e45abbc27e3b1db8c3f0c P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:43.088063 314 raft_consensus.cc:515] T 67a1e7ee026e45abbc27e3b1db8c3f0c P e1394f30f39e4553a7328aa2d0a6e6dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:43.089682 314 leader_election.cc:290] T 67a1e7ee026e45abbc27e3b1db8c3f0c P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 2 election: Requested vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:43.090687 32709 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "67a1e7ee026e45abbc27e3b1db8c3f0c" candidate_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a4d6aa056f44fb995225297c3cae89c"
I20260203 09:18:43.090734 390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "67a1e7ee026e45abbc27e3b1db8c3f0c" candidate_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f"
I20260203 09:18:43.091506 32709 raft_consensus.cc:3055] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:43.091898 32709 raft_consensus.cc:740] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Running, Role: LEADER
I20260203 09:18:43.091993 390 raft_consensus.cc:3060] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:43.092746 32709 consensus_queue.cc:260] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:43.094116 32709 raft_consensus.cc:3060] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:43.101042 390 raft_consensus.cc:2468] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 680bfc8acebf4aaf91e4794096f34c2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1394f30f39e4553a7328aa2d0a6e6dd in term 2.
I20260203 09:18:43.139919 32747 leader_election.cc:304] T 67a1e7ee026e45abbc27e3b1db8c3f0c P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bfc8acebf4aaf91e4794096f34c2f, e1394f30f39e4553a7328aa2d0a6e6dd; no voters:
I20260203 09:18:43.146533 439 raft_consensus.cc:2804] T 67a1e7ee026e45abbc27e3b1db8c3f0c P e1394f30f39e4553a7328aa2d0a6e6dd [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:43.143997 32709 raft_consensus.cc:2468] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1394f30f39e4553a7328aa2d0a6e6dd in term 2.
I20260203 09:18:43.147327 439 raft_consensus.cc:697] T 67a1e7ee026e45abbc27e3b1db8c3f0c P e1394f30f39e4553a7328aa2d0a6e6dd [term 2 LEADER]: Becoming Leader. State: Replica: e1394f30f39e4553a7328aa2d0a6e6dd, State: Running, Role: LEADER
I20260203 09:18:43.149952 439 consensus_queue.cc:237] T 67a1e7ee026e45abbc27e3b1db8c3f0c P e1394f30f39e4553a7328aa2d0a6e6dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:43.152148 475 consensus_queue.cc:1048] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:43.152719 450 consensus_queue.cc:1048] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:43.159379 315 raft_consensus.cc:3060] T 6a2c729bc0f147799a4b75e98082559c P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:43.160974 450 consensus_queue.cc:1048] T 804a15921c66442aa7512680adfd955e P 680bfc8acebf4aaf91e4794096f34c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:43.167639 450 consensus_queue.cc:1048] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:43.169620 450 consensus_queue.cc:1048] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:43.168067 32602 catalog_manager.cc:5654] T 67a1e7ee026e45abbc27e3b1db8c3f0c P e1394f30f39e4553a7328aa2d0a6e6dd reported cstate change: term changed from 1 to 2, leader changed from 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65) to e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66). New cstate: current_term: 2 leader_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:43.175323 450 consensus_queue.cc:1048] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:43.187601 448 consensus_queue.cc:1048] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260203 09:18:43.215611 450 raft_consensus.cc:993] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f: : Instructing follower 1a4d6aa056f44fb995225297c3cae89c to start an election
I20260203 09:18:43.216583 450 raft_consensus.cc:1081] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Signalling peer 1a4d6aa056f44fb995225297c3cae89c to start an election
I20260203 09:18:43.225713 450 consensus_queue.cc:1048] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260203 09:18:43.229497 505 raft_consensus.cc:993] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f: : Instructing follower e1394f30f39e4553a7328aa2d0a6e6dd to start an election
I20260203 09:18:43.244541 32706 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "a05059935c4c436984c601aeb649fd70"
dest_uuid: "1a4d6aa056f44fb995225297c3cae89c"
from {username='slave'} at 127.0.0.1:32786
I20260203 09:18:43.253952 32706 raft_consensus.cc:493] T a05059935c4c436984c601aeb649fd70 P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:43.254423 32706 raft_consensus.cc:3060] T a05059935c4c436984c601aeb649fd70 P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:43.257688 440 raft_consensus.cc:1081] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Signalling peer e1394f30f39e4553a7328aa2d0a6e6dd to start an election
I20260203 09:18:43.265545 32706 raft_consensus.cc:515] T a05059935c4c436984c601aeb649fd70 P 1a4d6aa056f44fb995225297c3cae89c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } }
I20260203 09:18:43.269706 390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a05059935c4c436984c601aeb649fd70" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f"
I20260203 09:18:43.270493 390 raft_consensus.cc:3055] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:43.270816 390 raft_consensus.cc:740] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Running, Role: LEADER
I20260203 09:18:43.271173 450 raft_consensus.cc:993] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f: : Instructing follower e1394f30f39e4553a7328aa2d0a6e6dd to start an election
I20260203 09:18:43.271885 390 consensus_queue.cc:260] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } }
I20260203 09:18:43.273599 390 raft_consensus.cc:3060] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:43.276419 32706 leader_election.cc:290] T a05059935c4c436984c601aeb649fd70 P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 2 election: Requested vote from peers 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635), e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595)
I20260203 09:18:43.282497 313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a05059935c4c436984c601aeb649fd70" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
I20260203 09:18:43.283308 313 raft_consensus.cc:3060] T a05059935c4c436984c601aeb649fd70 P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:43.284715 315 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "6a2c729bc0f147799a4b75e98082559c"
dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
from {username='slave'} at 127.0.0.1:52210
I20260203 09:18:43.285399 315 raft_consensus.cc:493] T 6a2c729bc0f147799a4b75e98082559c P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:43.285773 315 raft_consensus.cc:3060] T 6a2c729bc0f147799a4b75e98082559c P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:43.271895 450 raft_consensus.cc:1081] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Signalling peer e1394f30f39e4553a7328aa2d0a6e6dd to start an election
I20260203 09:18:43.291239 314 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "d1c0b217cc424f539d0a9281cda6a9ce"
dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
from {username='slave'} at 127.0.0.1:52210
I20260203 09:18:43.291882 314 raft_consensus.cc:493] T d1c0b217cc424f539d0a9281cda6a9ce P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:43.292296 314 raft_consensus.cc:3060] T d1c0b217cc424f539d0a9281cda6a9ce P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:43.290023 390 raft_consensus.cc:2468] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 2.
I20260203 09:18:43.294188 313 raft_consensus.cc:2468] T a05059935c4c436984c601aeb649fd70 P e1394f30f39e4553a7328aa2d0a6e6dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 2.
I20260203 09:18:43.295853 32672 leader_election.cc:304] T a05059935c4c436984c601aeb649fd70 P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, e1394f30f39e4553a7328aa2d0a6e6dd; no voters:
I20260203 09:18:43.296090 315 raft_consensus.cc:515] T 6a2c729bc0f147799a4b75e98082559c P e1394f30f39e4553a7328aa2d0a6e6dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:43.297236 461 raft_consensus.cc:2804] T a05059935c4c436984c601aeb649fd70 P 1a4d6aa056f44fb995225297c3cae89c [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:43.297739 461 raft_consensus.cc:697] T a05059935c4c436984c601aeb649fd70 P 1a4d6aa056f44fb995225297c3cae89c [term 2 LEADER]: Becoming Leader. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Running, Role: LEADER
I20260203 09:18:43.298805 461 consensus_queue.cc:237] T a05059935c4c436984c601aeb649fd70 P 1a4d6aa056f44fb995225297c3cae89c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } }
I20260203 09:18:43.299885 32706 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a2c729bc0f147799a4b75e98082559c" candidate_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a4d6aa056f44fb995225297c3cae89c"
I20260203 09:18:43.300525 32706 raft_consensus.cc:3060] T 6a2c729bc0f147799a4b75e98082559c P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:43.301294 314 raft_consensus.cc:515] T d1c0b217cc424f539d0a9281cda6a9ce P e1394f30f39e4553a7328aa2d0a6e6dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:43.303239 314 leader_election.cc:290] T d1c0b217cc424f539d0a9281cda6a9ce P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 2 election: Requested vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:43.304304 32708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1c0b217cc424f539d0a9281cda6a9ce" candidate_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a4d6aa056f44fb995225297c3cae89c"
I20260203 09:18:43.305040 32708 raft_consensus.cc:3060] T d1c0b217cc424f539d0a9281cda6a9ce P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:43.314438 32708 raft_consensus.cc:2468] T d1c0b217cc424f539d0a9281cda6a9ce P 1a4d6aa056f44fb995225297c3cae89c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1394f30f39e4553a7328aa2d0a6e6dd in term 2.
I20260203 09:18:43.316545 32748 leader_election.cc:304] T d1c0b217cc424f539d0a9281cda6a9ce P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, e1394f30f39e4553a7328aa2d0a6e6dd; no voters:
I20260203 09:18:43.317516 439 raft_consensus.cc:2804] T d1c0b217cc424f539d0a9281cda6a9ce P e1394f30f39e4553a7328aa2d0a6e6dd [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:43.318040 439 raft_consensus.cc:697] T d1c0b217cc424f539d0a9281cda6a9ce P e1394f30f39e4553a7328aa2d0a6e6dd [term 2 LEADER]: Becoming Leader. State: Replica: e1394f30f39e4553a7328aa2d0a6e6dd, State: Running, Role: LEADER
I20260203 09:18:43.317587 315 leader_election.cc:290] T 6a2c729bc0f147799a4b75e98082559c P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 2 election: Requested vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:43.318974 389 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a2c729bc0f147799a4b75e98082559c" candidate_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f"
I20260203 09:18:43.318598 32603 catalog_manager.cc:5654] T a05059935c4c436984c601aeb649fd70 P 1a4d6aa056f44fb995225297c3cae89c reported cstate change: term changed from 1 to 2, leader changed from 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67) to 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65). New cstate: current_term: 2 leader_uuid: "1a4d6aa056f44fb995225297c3cae89c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:43.318849 32706 raft_consensus.cc:2468] T 6a2c729bc0f147799a4b75e98082559c P 1a4d6aa056f44fb995225297c3cae89c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1394f30f39e4553a7328aa2d0a6e6dd in term 2.
I20260203 09:18:43.319875 389 raft_consensus.cc:3055] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:43.320988 389 raft_consensus.cc:740] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Running, Role: LEADER
I20260203 09:18:43.322008 389 consensus_queue.cc:260] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:43.322538 32748 leader_election.cc:304] T 6a2c729bc0f147799a4b75e98082559c P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, e1394f30f39e4553a7328aa2d0a6e6dd; no voters:
I20260203 09:18:43.323501 389 raft_consensus.cc:3060] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:43.325387 390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1c0b217cc424f539d0a9281cda6a9ce" candidate_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f"
I20260203 09:18:43.332892 390 raft_consensus.cc:3055] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:43.333334 390 raft_consensus.cc:740] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Running, Role: LEADER
I20260203 09:18:43.319084 439 consensus_queue.cc:237] T d1c0b217cc424f539d0a9281cda6a9ce P e1394f30f39e4553a7328aa2d0a6e6dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:43.335415 461 raft_consensus.cc:993] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c: : Instructing follower e1394f30f39e4553a7328aa2d0a6e6dd to start an election
I20260203 09:18:43.336059 461 raft_consensus.cc:1081] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [term 1 LEADER]: Signalling peer e1394f30f39e4553a7328aa2d0a6e6dd to start an election
I20260203 09:18:43.323634 486 raft_consensus.cc:2804] T 6a2c729bc0f147799a4b75e98082559c P e1394f30f39e4553a7328aa2d0a6e6dd [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:43.338325 315 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "15672473fef9443f99c480d08fd50796"
dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
from {username='slave'} at 127.0.0.1:52216
I20260203 09:18:43.338917 315 raft_consensus.cc:493] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:43.339327 315 raft_consensus.cc:3060] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:43.339519 390 consensus_queue.cc:260] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:43.341121 390 raft_consensus.cc:3060] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:43.343256 486 raft_consensus.cc:697] T 6a2c729bc0f147799a4b75e98082559c P e1394f30f39e4553a7328aa2d0a6e6dd [term 2 LEADER]: Becoming Leader. State: Replica: e1394f30f39e4553a7328aa2d0a6e6dd, State: Running, Role: LEADER
I20260203 09:18:43.344406 486 consensus_queue.cc:237] T 6a2c729bc0f147799a4b75e98082559c P e1394f30f39e4553a7328aa2d0a6e6dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:43.346213 32605 catalog_manager.cc:5654] T d1c0b217cc424f539d0a9281cda6a9ce P e1394f30f39e4553a7328aa2d0a6e6dd reported cstate change: term changed from 1 to 2, leader changed from 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67) to e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66). New cstate: current_term: 2 leader_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:43.347263 315 raft_consensus.cc:515] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:43.348990 390 raft_consensus.cc:2468] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1394f30f39e4553a7328aa2d0a6e6dd in term 2.
I20260203 09:18:43.350172 32706 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15672473fef9443f99c480d08fd50796" candidate_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1a4d6aa056f44fb995225297c3cae89c"
I20260203 09:18:43.350836 32706 raft_consensus.cc:3055] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:43.351198 32706 raft_consensus.cc:740] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Running, Role: LEADER
I20260203 09:18:43.352128 390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15672473fef9443f99c480d08fd50796" candidate_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f"
I20260203 09:18:43.352172 32706 consensus_queue.cc:260] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:43.352743 389 raft_consensus.cc:2468] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1394f30f39e4553a7328aa2d0a6e6dd in term 2.
I20260203 09:18:43.353313 390 raft_consensus.cc:3060] T 15672473fef9443f99c480d08fd50796 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:43.354393 32706 raft_consensus.cc:3060] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:43.350231 315 leader_election.cc:290] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 2 election: Requested vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:43.361884 32706 raft_consensus.cc:2468] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1394f30f39e4553a7328aa2d0a6e6dd in term 2.
I20260203 09:18:43.362568 390 raft_consensus.cc:2468] T 15672473fef9443f99c480d08fd50796 P 680bfc8acebf4aaf91e4794096f34c2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1394f30f39e4553a7328aa2d0a6e6dd in term 2.
I20260203 09:18:43.362305 389 raft_consensus.cc:1275] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 680bfc8acebf4aaf91e4794096f34c2f [term 2 FOLLOWER]: Refusing update from remote peer 1a4d6aa056f44fb995225297c3cae89c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:43.363010 32748 leader_election.cc:304] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, e1394f30f39e4553a7328aa2d0a6e6dd; no voters:
I20260203 09:18:43.364009 486 raft_consensus.cc:2804] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:43.363694 32605 catalog_manager.cc:5654] T 6a2c729bc0f147799a4b75e98082559c P e1394f30f39e4553a7328aa2d0a6e6dd reported cstate change: term changed from 1 to 2, leader changed from 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67) to e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66). New cstate: current_term: 2 leader_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:43.364553 486 raft_consensus.cc:697] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd [term 2 LEADER]: Becoming Leader. State: Replica: e1394f30f39e4553a7328aa2d0a6e6dd, State: Running, Role: LEADER
I20260203 09:18:43.364348 461 consensus_queue.cc:1048] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:43.365792 486 consensus_queue.cc:237] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:43.377467 315 raft_consensus.cc:1275] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P e1394f30f39e4553a7328aa2d0a6e6dd [term 2 FOLLOWER]: Refusing update from remote peer 1a4d6aa056f44fb995225297c3cae89c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:43.380789 496 consensus_queue.cc:1048] T 3b9758e8663e49aaa5ecaf5f8e3da6d2 P 1a4d6aa056f44fb995225297c3cae89c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:18:43.386479 32603 catalog_manager.cc:5654] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd reported cstate change: term changed from 1 to 2, leader changed from 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65) to e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66). New cstate: current_term: 2 leader_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:43.388787 513 raft_consensus.cc:993] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f: : Instructing follower 1a4d6aa056f44fb995225297c3cae89c to start an election
I20260203 09:18:43.389256 513 raft_consensus.cc:1081] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Signalling peer 1a4d6aa056f44fb995225297c3cae89c to start an election
I20260203 09:18:43.390725 32706 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "805a3fc418794c95890ee9ed803b3f00"
dest_uuid: "1a4d6aa056f44fb995225297c3cae89c"
from {username='slave'} at 127.0.0.1:32786
I20260203 09:18:43.391191 32706 raft_consensus.cc:493] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:43.391604 32706 raft_consensus.cc:3060] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:43.398270 32706 raft_consensus.cc:515] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:43.399796 32706 leader_election.cc:290] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 2 election: Requested vote from peers e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:43.400821 315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "805a3fc418794c95890ee9ed803b3f00" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
I20260203 09:18:43.400996 389 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "805a3fc418794c95890ee9ed803b3f00" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f"
I20260203 09:18:43.401392 315 raft_consensus.cc:3060] T 805a3fc418794c95890ee9ed803b3f00 P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:43.401566 389 raft_consensus.cc:3055] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:43.401937 389 raft_consensus.cc:740] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Running, Role: LEADER
I20260203 09:18:43.402643 389 consensus_queue.cc:260] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:43.403697 389 raft_consensus.cc:3060] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:43.407670 315 raft_consensus.cc:2468] T 805a3fc418794c95890ee9ed803b3f00 P e1394f30f39e4553a7328aa2d0a6e6dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 2.
I20260203 09:18:43.409343 32672 leader_election.cc:304] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, e1394f30f39e4553a7328aa2d0a6e6dd; no voters:
I20260203 09:18:43.410200 496 raft_consensus.cc:2804] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:43.410663 496 raft_consensus.cc:697] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c [term 2 LEADER]: Becoming Leader. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Running, Role: LEADER
I20260203 09:18:43.411646 496 consensus_queue.cc:237] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:43.413097 389 raft_consensus.cc:2468] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 2.
I20260203 09:18:43.418725 32603 catalog_manager.cc:5654] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c reported cstate change: term changed from 1 to 2, leader changed from 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67) to 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65). New cstate: current_term: 2 leader_uuid: "1a4d6aa056f44fb995225297c3cae89c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:43.424597 513 raft_consensus.cc:993] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f: : Instructing follower 1a4d6aa056f44fb995225297c3cae89c to start an election
I20260203 09:18:43.425096 450 raft_consensus.cc:1081] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Signalling peer 1a4d6aa056f44fb995225297c3cae89c to start an election
I20260203 09:18:43.426657 32706 tablet_service.cc:2038] Received Run Leader Election RPC: tablet_id: "df3afc76dc2c433085206e027f693862"
dest_uuid: "1a4d6aa056f44fb995225297c3cae89c"
from {username='slave'} at 127.0.0.1:32786
I20260203 09:18:43.427173 32706 raft_consensus.cc:493] T df3afc76dc2c433085206e027f693862 P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260203 09:18:43.427456 32706 raft_consensus.cc:3060] T df3afc76dc2c433085206e027f693862 P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:43.432685 32706 raft_consensus.cc:515] T df3afc76dc2c433085206e027f693862 P 1a4d6aa056f44fb995225297c3cae89c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:43.434316 32706 leader_election.cc:290] T df3afc76dc2c433085206e027f693862 P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 2 election: Requested vote from peers e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:43.435138 315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df3afc76dc2c433085206e027f693862" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
I20260203 09:18:43.435359 389 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df3afc76dc2c433085206e027f693862" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f"
I20260203 09:18:43.435676 315 raft_consensus.cc:3060] T df3afc76dc2c433085206e027f693862 P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:43.435914 389 raft_consensus.cc:3055] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Stepping down as leader of term 1
I20260203 09:18:43.436232 389 raft_consensus.cc:740] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Running, Role: LEADER
I20260203 09:18:43.436986 389 consensus_queue.cc:260] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:43.437978 389 raft_consensus.cc:3060] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Advancing to term 2
I20260203 09:18:43.440954 315 raft_consensus.cc:2468] T df3afc76dc2c433085206e027f693862 P e1394f30f39e4553a7328aa2d0a6e6dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 2.
I20260203 09:18:43.442011 32672 leader_election.cc:304] T df3afc76dc2c433085206e027f693862 P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, e1394f30f39e4553a7328aa2d0a6e6dd; no voters:
I20260203 09:18:43.442814 496 raft_consensus.cc:2804] T df3afc76dc2c433085206e027f693862 P 1a4d6aa056f44fb995225297c3cae89c [term 2 FOLLOWER]: Leader election won for term 2
I20260203 09:18:43.443192 496 raft_consensus.cc:697] T df3afc76dc2c433085206e027f693862 P 1a4d6aa056f44fb995225297c3cae89c [term 2 LEADER]: Becoming Leader. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Running, Role: LEADER
I20260203 09:18:43.443426 389 raft_consensus.cc:2468] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 2.
I20260203 09:18:43.444061 496 consensus_queue.cc:237] T df3afc76dc2c433085206e027f693862 P 1a4d6aa056f44fb995225297c3cae89c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:43.450611 32603 catalog_manager.cc:5654] T df3afc76dc2c433085206e027f693862 P 1a4d6aa056f44fb995225297c3cae89c reported cstate change: term changed from 1 to 2, leader changed from 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67) to 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65). New cstate: current_term: 2 leader_uuid: "1a4d6aa056f44fb995225297c3cae89c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:43.549727 389 raft_consensus.cc:1275] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 680bfc8acebf4aaf91e4794096f34c2f [term 2 FOLLOWER]: Refusing update from remote peer e1394f30f39e4553a7328aa2d0a6e6dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:43.550877 439 consensus_queue.cc:1048] T 67a1e7ee026e45abbc27e3b1db8c3f0c P e1394f30f39e4553a7328aa2d0a6e6dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:43.558585 32706 raft_consensus.cc:1275] T 67a1e7ee026e45abbc27e3b1db8c3f0c P 1a4d6aa056f44fb995225297c3cae89c [term 2 FOLLOWER]: Refusing update from remote peer e1394f30f39e4553a7328aa2d0a6e6dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:43.560206 439 consensus_queue.cc:1048] T 67a1e7ee026e45abbc27e3b1db8c3f0c P e1394f30f39e4553a7328aa2d0a6e6dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:43.718477 315 raft_consensus.cc:1275] T a05059935c4c436984c601aeb649fd70 P e1394f30f39e4553a7328aa2d0a6e6dd [term 2 FOLLOWER]: Refusing update from remote peer 1a4d6aa056f44fb995225297c3cae89c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:43.719686 496 consensus_queue.cc:1048] T a05059935c4c436984c601aeb649fd70 P 1a4d6aa056f44fb995225297c3cae89c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:43.727118 389 raft_consensus.cc:1275] T a05059935c4c436984c601aeb649fd70 P 680bfc8acebf4aaf91e4794096f34c2f [term 2 FOLLOWER]: Refusing update from remote peer 1a4d6aa056f44fb995225297c3cae89c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:43.729099 461 consensus_queue.cc:1048] T a05059935c4c436984c601aeb649fd70 P 1a4d6aa056f44fb995225297c3cae89c [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:43.732299 32706 raft_consensus.cc:1275] T 6a2c729bc0f147799a4b75e98082559c P 1a4d6aa056f44fb995225297c3cae89c [term 2 FOLLOWER]: Refusing update from remote peer e1394f30f39e4553a7328aa2d0a6e6dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:43.733666 439 consensus_queue.cc:1048] T 6a2c729bc0f147799a4b75e98082559c P e1394f30f39e4553a7328aa2d0a6e6dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:43.743031 389 raft_consensus.cc:1275] T 6a2c729bc0f147799a4b75e98082559c P 680bfc8acebf4aaf91e4794096f34c2f [term 2 FOLLOWER]: Refusing update from remote peer e1394f30f39e4553a7328aa2d0a6e6dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:43.744853 518 consensus_queue.cc:1048] T 6a2c729bc0f147799a4b75e98082559c P e1394f30f39e4553a7328aa2d0a6e6dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:18:43.791653 389 raft_consensus.cc:1275] T 15672473fef9443f99c480d08fd50796 P 680bfc8acebf4aaf91e4794096f34c2f [term 2 FOLLOWER]: Refusing update from remote peer e1394f30f39e4553a7328aa2d0a6e6dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:43.792877 439 consensus_queue.cc:1048] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:43.803718 32706 raft_consensus.cc:1275] T 15672473fef9443f99c480d08fd50796 P 1a4d6aa056f44fb995225297c3cae89c [term 2 FOLLOWER]: Refusing update from remote peer e1394f30f39e4553a7328aa2d0a6e6dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:43.805148 486 consensus_queue.cc:1048] T 15672473fef9443f99c480d08fd50796 P e1394f30f39e4553a7328aa2d0a6e6dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:43.844393 389 raft_consensus.cc:1275] T d1c0b217cc424f539d0a9281cda6a9ce P 680bfc8acebf4aaf91e4794096f34c2f [term 2 FOLLOWER]: Refusing update from remote peer e1394f30f39e4553a7328aa2d0a6e6dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:43.846019 486 consensus_queue.cc:1048] T d1c0b217cc424f539d0a9281cda6a9ce P e1394f30f39e4553a7328aa2d0a6e6dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:43.853865 32706 raft_consensus.cc:1275] T d1c0b217cc424f539d0a9281cda6a9ce P 1a4d6aa056f44fb995225297c3cae89c [term 2 FOLLOWER]: Refusing update from remote peer e1394f30f39e4553a7328aa2d0a6e6dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:43.855939 439 consensus_queue.cc:1048] T d1c0b217cc424f539d0a9281cda6a9ce P e1394f30f39e4553a7328aa2d0a6e6dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:43.861644 390 raft_consensus.cc:1275] T 805a3fc418794c95890ee9ed803b3f00 P 680bfc8acebf4aaf91e4794096f34c2f [term 2 FOLLOWER]: Refusing update from remote peer 1a4d6aa056f44fb995225297c3cae89c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:43.860960 389 raft_consensus.cc:1275] T df3afc76dc2c433085206e027f693862 P 680bfc8acebf4aaf91e4794096f34c2f [term 2 FOLLOWER]: Refusing update from remote peer 1a4d6aa056f44fb995225297c3cae89c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:43.863046 461 consensus_queue.cc:1048] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:18:43.864480 461 consensus_queue.cc:1048] T df3afc76dc2c433085206e027f693862 P 1a4d6aa056f44fb995225297c3cae89c [LEADER]: Connected to new peer: Peer: permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260203 09:18:43.876497 315 raft_consensus.cc:1275] T 805a3fc418794c95890ee9ed803b3f00 P e1394f30f39e4553a7328aa2d0a6e6dd [term 2 FOLLOWER]: Refusing update from remote peer 1a4d6aa056f44fb995225297c3cae89c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:43.879871 315 raft_consensus.cc:1275] T df3afc76dc2c433085206e027f693862 P e1394f30f39e4553a7328aa2d0a6e6dd [term 2 FOLLOWER]: Refusing update from remote peer 1a4d6aa056f44fb995225297c3cae89c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260203 09:18:43.887693 434 consensus_queue.cc:1048] T df3afc76dc2c433085206e027f693862 P 1a4d6aa056f44fb995225297c3cae89c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260203 09:18:43.887336 461 consensus_queue.cc:1048] T 805a3fc418794c95890ee9ed803b3f00 P 1a4d6aa056f44fb995225297c3cae89c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260203 09:18:45.998970 32602 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35410:
name: "soft_deleted_table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260203 09:18:46.001843 32602 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260203 09:18:46.053797 32691 tablet_service.cc:1505] Processing CreateTablet for tablet 7c6053c0caec43d89bad47f59c2313ff (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260203 09:18:46.054867 304 tablet_service.cc:1505] Processing CreateTablet for tablet 7c6053c0caec43d89bad47f59c2313ff (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260203 09:18:46.056516 304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c6053c0caec43d89bad47f59c2313ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.057076 374 tablet_service.cc:1505] Processing CreateTablet for tablet 7c6053c0caec43d89bad47f59c2313ff (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260203 09:18:46.057927 32696 tablet_service.cc:1505] Processing CreateTablet for tablet 18374de5ba5b4112997f0ebbd4095811 (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260203 09:18:46.058583 374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c6053c0caec43d89bad47f59c2313ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.055588 32691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c6053c0caec43d89bad47f59c2313ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.061964 300 tablet_service.cc:1505] Processing CreateTablet for tablet 18374de5ba5b4112997f0ebbd4095811 (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260203 09:18:46.063462 32696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18374de5ba5b4112997f0ebbd4095811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.061950 379 tablet_service.cc:1505] Processing CreateTablet for tablet 18374de5ba5b4112997f0ebbd4095811 (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260203 09:18:46.064476 379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18374de5ba5b4112997f0ebbd4095811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.065712 301 tablet_service.cc:1505] Processing CreateTablet for tablet 23b00275b2f9473eafd8800758e46884 (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260203 09:18:46.061996 32693 tablet_service.cc:1505] Processing CreateTablet for tablet 23b00275b2f9473eafd8800758e46884 (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260203 09:18:46.068222 32693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23b00275b2f9473eafd8800758e46884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.068462 32694 tablet_service.cc:1505] Processing CreateTablet for tablet 404d50c6e6b8437082d1260ee9f2e944 (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260203 09:18:46.069765 32694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 404d50c6e6b8437082d1260ee9f2e944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.066769 376 tablet_service.cc:1505] Processing CreateTablet for tablet 23b00275b2f9473eafd8800758e46884 (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260203 09:18:46.071933 376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23b00275b2f9473eafd8800758e46884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.063655 300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18374de5ba5b4112997f0ebbd4095811. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.074474 301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23b00275b2f9473eafd8800758e46884. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.079998 306 tablet_service.cc:1505] Processing CreateTablet for tablet 404d50c6e6b8437082d1260ee9f2e944 (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260203 09:18:46.081463 306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 404d50c6e6b8437082d1260ee9f2e944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.085942 381 tablet_service.cc:1505] Processing CreateTablet for tablet 404d50c6e6b8437082d1260ee9f2e944 (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260203 09:18:46.087374 381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 404d50c6e6b8437082d1260ee9f2e944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.099328 32699 tablet_service.cc:1505] Processing CreateTablet for tablet 6fc85217f0e346d48329da6030d7b19e (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260203 09:18:46.100889 32699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc85217f0e346d48329da6030d7b19e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.114596 32767 tablet_service.cc:1505] Processing CreateTablet for tablet 6fc85217f0e346d48329da6030d7b19e (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260203 09:18:46.116048 32767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc85217f0e346d48329da6030d7b19e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.131668 375 tablet_service.cc:1505] Processing CreateTablet for tablet 6fc85217f0e346d48329da6030d7b19e (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260203 09:18:46.133145 375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc85217f0e346d48329da6030d7b19e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.157166 32695 tablet_service.cc:1505] Processing CreateTablet for tablet e092a848890b488baf54eea89baba9ea (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260203 09:18:46.158604 32695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e092a848890b488baf54eea89baba9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.173153 374 tablet_service.cc:1505] Processing CreateTablet for tablet e092a848890b488baf54eea89baba9ea (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260203 09:18:46.175280 32691 tablet_service.cc:1505] Processing CreateTablet for tablet 1c2ee4a758ff49d6bfe40298d9f815d4 (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260203 09:18:46.176669 32691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c2ee4a758ff49d6bfe40298d9f815d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.177721 301 tablet_service.cc:1505] Processing CreateTablet for tablet e092a848890b488baf54eea89baba9ea (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260203 09:18:46.190999 537 tablet_bootstrap.cc:492] T 7c6053c0caec43d89bad47f59c2313ff P e1394f30f39e4553a7328aa2d0a6e6dd: Bootstrap starting.
I20260203 09:18:46.179785 374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e092a848890b488baf54eea89baba9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.185909 535 tablet_bootstrap.cc:492] T 18374de5ba5b4112997f0ebbd4095811 P 1a4d6aa056f44fb995225297c3cae89c: Bootstrap starting.
I20260203 09:18:46.187495 300 tablet_service.cc:1505] Processing CreateTablet for tablet 1c2ee4a758ff49d6bfe40298d9f815d4 (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260203 09:18:46.188843 538 tablet_bootstrap.cc:492] T 18374de5ba5b4112997f0ebbd4095811 P 680bfc8acebf4aaf91e4794096f34c2f: Bootstrap starting.
I20260203 09:18:46.189309 379 tablet_service.cc:1505] Processing CreateTablet for tablet 1c2ee4a758ff49d6bfe40298d9f815d4 (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260203 09:18:46.196132 379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c2ee4a758ff49d6bfe40298d9f815d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.191565 301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e092a848890b488baf54eea89baba9ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.197466 32693 tablet_service.cc:1505] Processing CreateTablet for tablet 7bac68369bd3469d9961c738fbd51a9e (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260203 09:18:46.198834 32693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bac68369bd3469d9961c738fbd51a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.201190 300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c2ee4a758ff49d6bfe40298d9f815d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.208592 537 tablet_bootstrap.cc:654] T 7c6053c0caec43d89bad47f59c2313ff P e1394f30f39e4553a7328aa2d0a6e6dd: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.212311 304 tablet_service.cc:1505] Processing CreateTablet for tablet 7bac68369bd3469d9961c738fbd51a9e (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260203 09:18:46.214234 535 tablet_bootstrap.cc:654] T 18374de5ba5b4112997f0ebbd4095811 P 1a4d6aa056f44fb995225297c3cae89c: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.214850 376 tablet_service.cc:1505] Processing CreateTablet for tablet 7bac68369bd3469d9961c738fbd51a9e (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260203 09:18:46.222638 32695 tablet_service.cc:1505] Processing CreateTablet for tablet 449ddd8a621c42c8961c1b4083d664e9 (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260203 09:18:46.228421 304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bac68369bd3469d9961c738fbd51a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.228523 376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bac68369bd3469d9961c738fbd51a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.228610 32695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 449ddd8a621c42c8961c1b4083d664e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.225458 301 tablet_service.cc:1505] Processing CreateTablet for tablet 449ddd8a621c42c8961c1b4083d664e9 (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260203 09:18:46.226491 381 tablet_service.cc:1505] Processing CreateTablet for tablet 449ddd8a621c42c8961c1b4083d664e9 (DEFAULT_TABLE table=soft_deleted_table [id=0fcf4cfbacc54f16af71e2d217075c53]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260203 09:18:46.240413 381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 449ddd8a621c42c8961c1b4083d664e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.240413 301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 449ddd8a621c42c8961c1b4083d664e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260203 09:18:46.252120 538 tablet_bootstrap.cc:654] T 18374de5ba5b4112997f0ebbd4095811 P 680bfc8acebf4aaf91e4794096f34c2f: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.257680 535 tablet_bootstrap.cc:492] T 18374de5ba5b4112997f0ebbd4095811 P 1a4d6aa056f44fb995225297c3cae89c: No bootstrap required, opened a new log
I20260203 09:18:46.258311 535 ts_tablet_manager.cc:1403] T 18374de5ba5b4112997f0ebbd4095811 P 1a4d6aa056f44fb995225297c3cae89c: Time spent bootstrapping tablet: real 0.073s user 0.001s sys 0.011s
I20260203 09:18:46.266626 537 tablet_bootstrap.cc:492] T 7c6053c0caec43d89bad47f59c2313ff P e1394f30f39e4553a7328aa2d0a6e6dd: No bootstrap required, opened a new log
I20260203 09:18:46.272429 537 ts_tablet_manager.cc:1403] T 7c6053c0caec43d89bad47f59c2313ff P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent bootstrapping tablet: real 0.082s user 0.008s sys 0.022s
I20260203 09:18:46.275323 537 raft_consensus.cc:359] T 7c6053c0caec43d89bad47f59c2313ff P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.276005 537 raft_consensus.cc:385] T 7c6053c0caec43d89bad47f59c2313ff P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.276325 537 raft_consensus.cc:740] T 7c6053c0caec43d89bad47f59c2313ff P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1394f30f39e4553a7328aa2d0a6e6dd, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.275133 535 raft_consensus.cc:359] T 18374de5ba5b4112997f0ebbd4095811 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.277067 537 consensus_queue.cc:260] T 7c6053c0caec43d89bad47f59c2313ff P e1394f30f39e4553a7328aa2d0a6e6dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.277698 535 raft_consensus.cc:385] T 18374de5ba5b4112997f0ebbd4095811 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.278111 535 raft_consensus.cc:740] T 18374de5ba5b4112997f0ebbd4095811 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.278888 535 consensus_queue.cc:260] T 18374de5ba5b4112997f0ebbd4095811 P 1a4d6aa056f44fb995225297c3cae89c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.281108 537 ts_tablet_manager.cc:1434] T 7c6053c0caec43d89bad47f59c2313ff P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260203 09:18:46.282272 537 tablet_bootstrap.cc:492] T 23b00275b2f9473eafd8800758e46884 P e1394f30f39e4553a7328aa2d0a6e6dd: Bootstrap starting.
I20260203 09:18:46.285437 535 ts_tablet_manager.cc:1434] T 18374de5ba5b4112997f0ebbd4095811 P 1a4d6aa056f44fb995225297c3cae89c: Time spent starting tablet: real 0.027s user 0.009s sys 0.000s
I20260203 09:18:46.286686 535 tablet_bootstrap.cc:492] T 404d50c6e6b8437082d1260ee9f2e944 P 1a4d6aa056f44fb995225297c3cae89c: Bootstrap starting.
I20260203 09:18:46.297369 537 tablet_bootstrap.cc:654] T 23b00275b2f9473eafd8800758e46884 P e1394f30f39e4553a7328aa2d0a6e6dd: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.301614 538 tablet_bootstrap.cc:492] T 18374de5ba5b4112997f0ebbd4095811 P 680bfc8acebf4aaf91e4794096f34c2f: No bootstrap required, opened a new log
I20260203 09:18:46.301782 535 tablet_bootstrap.cc:654] T 404d50c6e6b8437082d1260ee9f2e944 P 1a4d6aa056f44fb995225297c3cae89c: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.302199 538 ts_tablet_manager.cc:1403] T 18374de5ba5b4112997f0ebbd4095811 P 680bfc8acebf4aaf91e4794096f34c2f: Time spent bootstrapping tablet: real 0.114s user 0.017s sys 0.015s
I20260203 09:18:46.305528 538 raft_consensus.cc:359] T 18374de5ba5b4112997f0ebbd4095811 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.306361 538 raft_consensus.cc:385] T 18374de5ba5b4112997f0ebbd4095811 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.306682 538 raft_consensus.cc:740] T 18374de5ba5b4112997f0ebbd4095811 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.307376 538 consensus_queue.cc:260] T 18374de5ba5b4112997f0ebbd4095811 P 680bfc8acebf4aaf91e4794096f34c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.308138 537 tablet_bootstrap.cc:492] T 23b00275b2f9473eafd8800758e46884 P e1394f30f39e4553a7328aa2d0a6e6dd: No bootstrap required, opened a new log
I20260203 09:18:46.308166 535 tablet_bootstrap.cc:492] T 404d50c6e6b8437082d1260ee9f2e944 P 1a4d6aa056f44fb995225297c3cae89c: No bootstrap required, opened a new log
I20260203 09:18:46.308720 537 ts_tablet_manager.cc:1403] T 23b00275b2f9473eafd8800758e46884 P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent bootstrapping tablet: real 0.027s user 0.012s sys 0.005s
I20260203 09:18:46.309862 538 ts_tablet_manager.cc:1434] T 18374de5ba5b4112997f0ebbd4095811 P 680bfc8acebf4aaf91e4794096f34c2f: Time spent starting tablet: real 0.007s user 0.003s sys 0.005s
I20260203 09:18:46.310564 535 ts_tablet_manager.cc:1403] T 404d50c6e6b8437082d1260ee9f2e944 P 1a4d6aa056f44fb995225297c3cae89c: Time spent bootstrapping tablet: real 0.024s user 0.014s sys 0.000s
I20260203 09:18:46.311651 538 tablet_bootstrap.cc:492] T 23b00275b2f9473eafd8800758e46884 P 680bfc8acebf4aaf91e4794096f34c2f: Bootstrap starting.
I20260203 09:18:46.313472 537 raft_consensus.cc:359] T 23b00275b2f9473eafd8800758e46884 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.313782 535 raft_consensus.cc:359] T 404d50c6e6b8437082d1260ee9f2e944 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.314211 537 raft_consensus.cc:385] T 23b00275b2f9473eafd8800758e46884 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.314632 537 raft_consensus.cc:740] T 23b00275b2f9473eafd8800758e46884 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1394f30f39e4553a7328aa2d0a6e6dd, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.314556 535 raft_consensus.cc:385] T 404d50c6e6b8437082d1260ee9f2e944 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.315526 535 raft_consensus.cc:740] T 404d50c6e6b8437082d1260ee9f2e944 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.315460 537 consensus_queue.cc:260] T 23b00275b2f9473eafd8800758e46884 P e1394f30f39e4553a7328aa2d0a6e6dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.318300 537 ts_tablet_manager.cc:1434] T 23b00275b2f9473eafd8800758e46884 P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260203 09:18:46.319289 537 tablet_bootstrap.cc:492] T 404d50c6e6b8437082d1260ee9f2e944 P e1394f30f39e4553a7328aa2d0a6e6dd: Bootstrap starting.
I20260203 09:18:46.319164 535 consensus_queue.cc:260] T 404d50c6e6b8437082d1260ee9f2e944 P 1a4d6aa056f44fb995225297c3cae89c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.324235 535 ts_tablet_manager.cc:1434] T 404d50c6e6b8437082d1260ee9f2e944 P 1a4d6aa056f44fb995225297c3cae89c: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20260203 09:18:46.325350 535 tablet_bootstrap.cc:492] T 7c6053c0caec43d89bad47f59c2313ff P 1a4d6aa056f44fb995225297c3cae89c: Bootstrap starting.
I20260203 09:18:46.326202 537 tablet_bootstrap.cc:654] T 404d50c6e6b8437082d1260ee9f2e944 P e1394f30f39e4553a7328aa2d0a6e6dd: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.326788 538 tablet_bootstrap.cc:654] T 23b00275b2f9473eafd8800758e46884 P 680bfc8acebf4aaf91e4794096f34c2f: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.334841 535 tablet_bootstrap.cc:654] T 7c6053c0caec43d89bad47f59c2313ff P 1a4d6aa056f44fb995225297c3cae89c: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.341183 537 tablet_bootstrap.cc:492] T 404d50c6e6b8437082d1260ee9f2e944 P e1394f30f39e4553a7328aa2d0a6e6dd: No bootstrap required, opened a new log
I20260203 09:18:46.341707 537 ts_tablet_manager.cc:1403] T 404d50c6e6b8437082d1260ee9f2e944 P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent bootstrapping tablet: real 0.023s user 0.016s sys 0.005s
I20260203 09:18:46.342177 538 tablet_bootstrap.cc:492] T 23b00275b2f9473eafd8800758e46884 P 680bfc8acebf4aaf91e4794096f34c2f: No bootstrap required, opened a new log
I20260203 09:18:46.342738 538 ts_tablet_manager.cc:1403] T 23b00275b2f9473eafd8800758e46884 P 680bfc8acebf4aaf91e4794096f34c2f: Time spent bootstrapping tablet: real 0.031s user 0.009s sys 0.009s
I20260203 09:18:46.345292 537 raft_consensus.cc:359] T 404d50c6e6b8437082d1260ee9f2e944 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.346375 537 raft_consensus.cc:385] T 404d50c6e6b8437082d1260ee9f2e944 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.346697 535 tablet_bootstrap.cc:492] T 7c6053c0caec43d89bad47f59c2313ff P 1a4d6aa056f44fb995225297c3cae89c: No bootstrap required, opened a new log
I20260203 09:18:46.346732 537 raft_consensus.cc:740] T 404d50c6e6b8437082d1260ee9f2e944 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1394f30f39e4553a7328aa2d0a6e6dd, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.346541 538 raft_consensus.cc:359] T 23b00275b2f9473eafd8800758e46884 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.347329 535 ts_tablet_manager.cc:1403] T 7c6053c0caec43d89bad47f59c2313ff P 1a4d6aa056f44fb995225297c3cae89c: Time spent bootstrapping tablet: real 0.022s user 0.018s sys 0.000s
I20260203 09:18:46.347487 538 raft_consensus.cc:385] T 23b00275b2f9473eafd8800758e46884 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.347854 538 raft_consensus.cc:740] T 23b00275b2f9473eafd8800758e46884 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.347891 537 consensus_queue.cc:260] T 404d50c6e6b8437082d1260ee9f2e944 P e1394f30f39e4553a7328aa2d0a6e6dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.348670 538 consensus_queue.cc:260] T 23b00275b2f9473eafd8800758e46884 P 680bfc8acebf4aaf91e4794096f34c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.350600 537 ts_tablet_manager.cc:1434] T 404d50c6e6b8437082d1260ee9f2e944 P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent starting tablet: real 0.009s user 0.006s sys 0.002s
I20260203 09:18:46.350252 535 raft_consensus.cc:359] T 7c6053c0caec43d89bad47f59c2313ff P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.351012 535 raft_consensus.cc:385] T 7c6053c0caec43d89bad47f59c2313ff P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.351308 535 raft_consensus.cc:740] T 7c6053c0caec43d89bad47f59c2313ff P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.351645 537 tablet_bootstrap.cc:492] T 18374de5ba5b4112997f0ebbd4095811 P e1394f30f39e4553a7328aa2d0a6e6dd: Bootstrap starting.
I20260203 09:18:46.351982 535 consensus_queue.cc:260] T 7c6053c0caec43d89bad47f59c2313ff P 1a4d6aa056f44fb995225297c3cae89c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.354583 535 ts_tablet_manager.cc:1434] T 7c6053c0caec43d89bad47f59c2313ff P 1a4d6aa056f44fb995225297c3cae89c: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260203 09:18:46.355540 535 tablet_bootstrap.cc:492] T 23b00275b2f9473eafd8800758e46884 P 1a4d6aa056f44fb995225297c3cae89c: Bootstrap starting.
W20260203 09:18:46.358148 32655 auto_rebalancer.cc:229] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260203 09:18:46.360515 538 ts_tablet_manager.cc:1434] T 23b00275b2f9473eafd8800758e46884 P 680bfc8acebf4aaf91e4794096f34c2f: Time spent starting tablet: real 0.017s user 0.009s sys 0.001s
I20260203 09:18:46.363217 537 tablet_bootstrap.cc:654] T 18374de5ba5b4112997f0ebbd4095811 P e1394f30f39e4553a7328aa2d0a6e6dd: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.363210 535 tablet_bootstrap.cc:654] T 23b00275b2f9473eafd8800758e46884 P 1a4d6aa056f44fb995225297c3cae89c: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.371848 538 tablet_bootstrap.cc:492] T 404d50c6e6b8437082d1260ee9f2e944 P 680bfc8acebf4aaf91e4794096f34c2f: Bootstrap starting.
I20260203 09:18:46.377518 537 tablet_bootstrap.cc:492] T 18374de5ba5b4112997f0ebbd4095811 P e1394f30f39e4553a7328aa2d0a6e6dd: No bootstrap required, opened a new log
I20260203 09:18:46.378141 537 ts_tablet_manager.cc:1403] T 18374de5ba5b4112997f0ebbd4095811 P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent bootstrapping tablet: real 0.027s user 0.011s sys 0.005s
I20260203 09:18:46.379222 538 tablet_bootstrap.cc:654] T 404d50c6e6b8437082d1260ee9f2e944 P 680bfc8acebf4aaf91e4794096f34c2f: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.381209 537 raft_consensus.cc:359] T 18374de5ba5b4112997f0ebbd4095811 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.381986 537 raft_consensus.cc:385] T 18374de5ba5b4112997f0ebbd4095811 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.382267 537 raft_consensus.cc:740] T 18374de5ba5b4112997f0ebbd4095811 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1394f30f39e4553a7328aa2d0a6e6dd, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.383466 537 consensus_queue.cc:260] T 18374de5ba5b4112997f0ebbd4095811 P e1394f30f39e4553a7328aa2d0a6e6dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.387910 537 ts_tablet_manager.cc:1434] T 18374de5ba5b4112997f0ebbd4095811 P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent starting tablet: real 0.009s user 0.005s sys 0.003s
I20260203 09:18:46.388486 535 tablet_bootstrap.cc:492] T 23b00275b2f9473eafd8800758e46884 P 1a4d6aa056f44fb995225297c3cae89c: No bootstrap required, opened a new log
I20260203 09:18:46.388983 537 tablet_bootstrap.cc:492] T 6fc85217f0e346d48329da6030d7b19e P e1394f30f39e4553a7328aa2d0a6e6dd: Bootstrap starting.
I20260203 09:18:46.389118 535 ts_tablet_manager.cc:1403] T 23b00275b2f9473eafd8800758e46884 P 1a4d6aa056f44fb995225297c3cae89c: Time spent bootstrapping tablet: real 0.034s user 0.020s sys 0.009s
I20260203 09:18:46.392505 535 raft_consensus.cc:359] T 23b00275b2f9473eafd8800758e46884 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.393402 535 raft_consensus.cc:385] T 23b00275b2f9473eafd8800758e46884 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.393759 535 raft_consensus.cc:740] T 23b00275b2f9473eafd8800758e46884 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.394613 535 consensus_queue.cc:260] T 23b00275b2f9473eafd8800758e46884 P 1a4d6aa056f44fb995225297c3cae89c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.396214 537 tablet_bootstrap.cc:654] T 6fc85217f0e346d48329da6030d7b19e P e1394f30f39e4553a7328aa2d0a6e6dd: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.401154 535 ts_tablet_manager.cc:1434] T 23b00275b2f9473eafd8800758e46884 P 1a4d6aa056f44fb995225297c3cae89c: Time spent starting tablet: real 0.012s user 0.007s sys 0.000s
I20260203 09:18:46.402554 535 tablet_bootstrap.cc:492] T e092a848890b488baf54eea89baba9ea P 1a4d6aa056f44fb995225297c3cae89c: Bootstrap starting.
I20260203 09:18:46.402567 538 tablet_bootstrap.cc:492] T 404d50c6e6b8437082d1260ee9f2e944 P 680bfc8acebf4aaf91e4794096f34c2f: No bootstrap required, opened a new log
I20260203 09:18:46.403267 538 ts_tablet_manager.cc:1403] T 404d50c6e6b8437082d1260ee9f2e944 P 680bfc8acebf4aaf91e4794096f34c2f: Time spent bootstrapping tablet: real 0.032s user 0.017s sys 0.011s
I20260203 09:18:46.404389 537 tablet_bootstrap.cc:492] T 6fc85217f0e346d48329da6030d7b19e P e1394f30f39e4553a7328aa2d0a6e6dd: No bootstrap required, opened a new log
I20260203 09:18:46.404835 537 ts_tablet_manager.cc:1403] T 6fc85217f0e346d48329da6030d7b19e P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.005s
I20260203 09:18:46.406234 538 raft_consensus.cc:359] T 404d50c6e6b8437082d1260ee9f2e944 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.406985 538 raft_consensus.cc:385] T 404d50c6e6b8437082d1260ee9f2e944 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.407290 538 raft_consensus.cc:740] T 404d50c6e6b8437082d1260ee9f2e944 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.407155 537 raft_consensus.cc:359] T 6fc85217f0e346d48329da6030d7b19e P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.407997 537 raft_consensus.cc:385] T 6fc85217f0e346d48329da6030d7b19e P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.408316 537 raft_consensus.cc:740] T 6fc85217f0e346d48329da6030d7b19e P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1394f30f39e4553a7328aa2d0a6e6dd, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.408257 538 consensus_queue.cc:260] T 404d50c6e6b8437082d1260ee9f2e944 P 680bfc8acebf4aaf91e4794096f34c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.411026 538 ts_tablet_manager.cc:1434] T 404d50c6e6b8437082d1260ee9f2e944 P 680bfc8acebf4aaf91e4794096f34c2f: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20260203 09:18:46.409242 537 consensus_queue.cc:260] T 6fc85217f0e346d48329da6030d7b19e P e1394f30f39e4553a7328aa2d0a6e6dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.412161 538 tablet_bootstrap.cc:492] T 7c6053c0caec43d89bad47f59c2313ff P 680bfc8acebf4aaf91e4794096f34c2f: Bootstrap starting.
I20260203 09:18:46.413756 537 ts_tablet_manager.cc:1434] T 6fc85217f0e346d48329da6030d7b19e P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260203 09:18:46.414870 537 tablet_bootstrap.cc:492] T e092a848890b488baf54eea89baba9ea P e1394f30f39e4553a7328aa2d0a6e6dd: Bootstrap starting.
I20260203 09:18:46.417163 535 tablet_bootstrap.cc:654] T e092a848890b488baf54eea89baba9ea P 1a4d6aa056f44fb995225297c3cae89c: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.419234 538 tablet_bootstrap.cc:654] T 7c6053c0caec43d89bad47f59c2313ff P 680bfc8acebf4aaf91e4794096f34c2f: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.425176 537 tablet_bootstrap.cc:654] T e092a848890b488baf54eea89baba9ea P e1394f30f39e4553a7328aa2d0a6e6dd: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.428385 538 tablet_bootstrap.cc:492] T 7c6053c0caec43d89bad47f59c2313ff P 680bfc8acebf4aaf91e4794096f34c2f: No bootstrap required, opened a new log
I20260203 09:18:46.429078 538 ts_tablet_manager.cc:1403] T 7c6053c0caec43d89bad47f59c2313ff P 680bfc8acebf4aaf91e4794096f34c2f: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.005s
I20260203 09:18:46.432440 538 raft_consensus.cc:359] T 7c6053c0caec43d89bad47f59c2313ff P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.434166 538 raft_consensus.cc:385] T 7c6053c0caec43d89bad47f59c2313ff P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.434465 538 raft_consensus.cc:740] T 7c6053c0caec43d89bad47f59c2313ff P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.435065 538 consensus_queue.cc:260] T 7c6053c0caec43d89bad47f59c2313ff P 680bfc8acebf4aaf91e4794096f34c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.437062 535 tablet_bootstrap.cc:492] T e092a848890b488baf54eea89baba9ea P 1a4d6aa056f44fb995225297c3cae89c: No bootstrap required, opened a new log
I20260203 09:18:46.437109 537 tablet_bootstrap.cc:492] T e092a848890b488baf54eea89baba9ea P e1394f30f39e4553a7328aa2d0a6e6dd: No bootstrap required, opened a new log
I20260203 09:18:46.437614 538 ts_tablet_manager.cc:1434] T 7c6053c0caec43d89bad47f59c2313ff P 680bfc8acebf4aaf91e4794096f34c2f: Time spent starting tablet: real 0.008s user 0.006s sys 0.002s
I20260203 09:18:46.437764 535 ts_tablet_manager.cc:1403] T e092a848890b488baf54eea89baba9ea P 1a4d6aa056f44fb995225297c3cae89c: Time spent bootstrapping tablet: real 0.035s user 0.009s sys 0.014s
I20260203 09:18:46.437845 537 ts_tablet_manager.cc:1403] T e092a848890b488baf54eea89baba9ea P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent bootstrapping tablet: real 0.023s user 0.018s sys 0.000s
I20260203 09:18:46.438637 538 tablet_bootstrap.cc:492] T e092a848890b488baf54eea89baba9ea P 680bfc8acebf4aaf91e4794096f34c2f: Bootstrap starting.
I20260203 09:18:46.445238 537 raft_consensus.cc:359] T e092a848890b488baf54eea89baba9ea P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.446043 537 raft_consensus.cc:385] T e092a848890b488baf54eea89baba9ea P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.446342 537 raft_consensus.cc:740] T e092a848890b488baf54eea89baba9ea P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1394f30f39e4553a7328aa2d0a6e6dd, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.446475 538 tablet_bootstrap.cc:654] T e092a848890b488baf54eea89baba9ea P 680bfc8acebf4aaf91e4794096f34c2f: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.447089 537 consensus_queue.cc:260] T e092a848890b488baf54eea89baba9ea P e1394f30f39e4553a7328aa2d0a6e6dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.447305 535 raft_consensus.cc:359] T e092a848890b488baf54eea89baba9ea P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.448120 535 raft_consensus.cc:385] T e092a848890b488baf54eea89baba9ea P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.448427 535 raft_consensus.cc:740] T e092a848890b488baf54eea89baba9ea P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.452441 537 ts_tablet_manager.cc:1434] T e092a848890b488baf54eea89baba9ea P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent starting tablet: real 0.014s user 0.007s sys 0.000s
I20260203 09:18:46.453631 537 tablet_bootstrap.cc:492] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd: Bootstrap starting.
I20260203 09:18:46.449326 535 consensus_queue.cc:260] T e092a848890b488baf54eea89baba9ea P 1a4d6aa056f44fb995225297c3cae89c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.459573 538 tablet_bootstrap.cc:492] T e092a848890b488baf54eea89baba9ea P 680bfc8acebf4aaf91e4794096f34c2f: No bootstrap required, opened a new log
I20260203 09:18:46.460311 537 tablet_bootstrap.cc:654] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.460343 538 ts_tablet_manager.cc:1403] T e092a848890b488baf54eea89baba9ea P 680bfc8acebf4aaf91e4794096f34c2f: Time spent bootstrapping tablet: real 0.022s user 0.013s sys 0.005s
I20260203 09:18:46.464303 538 raft_consensus.cc:359] T e092a848890b488baf54eea89baba9ea P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.465240 538 raft_consensus.cc:385] T e092a848890b488baf54eea89baba9ea P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.465584 538 raft_consensus.cc:740] T e092a848890b488baf54eea89baba9ea P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.466428 536 raft_consensus.cc:493] T 18374de5ba5b4112997f0ebbd4095811 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:46.466977 536 raft_consensus.cc:515] T 18374de5ba5b4112997f0ebbd4095811 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.466585 538 consensus_queue.cc:260] T e092a848890b488baf54eea89baba9ea P 680bfc8acebf4aaf91e4794096f34c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.469022 536 leader_election.cc:290] T 18374de5ba5b4112997f0ebbd4095811 P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:46.469175 538 ts_tablet_manager.cc:1434] T e092a848890b488baf54eea89baba9ea P 680bfc8acebf4aaf91e4794096f34c2f: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260203 09:18:46.470703 390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18374de5ba5b4112997f0ebbd4095811" candidate_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f" is_pre_election: true
I20260203 09:18:46.470959 32706 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18374de5ba5b4112997f0ebbd4095811" candidate_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c" is_pre_election: true
I20260203 09:18:46.471524 390 raft_consensus.cc:2468] T 18374de5ba5b4112997f0ebbd4095811 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1394f30f39e4553a7328aa2d0a6e6dd in term 0.
I20260203 09:18:46.471621 32706 raft_consensus.cc:2468] T 18374de5ba5b4112997f0ebbd4095811 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1394f30f39e4553a7328aa2d0a6e6dd in term 0.
I20260203 09:18:46.471837 538 tablet_bootstrap.cc:492] T 6fc85217f0e346d48329da6030d7b19e P 680bfc8acebf4aaf91e4794096f34c2f: Bootstrap starting.
I20260203 09:18:46.472987 32747 leader_election.cc:304] T 18374de5ba5b4112997f0ebbd4095811 P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bfc8acebf4aaf91e4794096f34c2f, e1394f30f39e4553a7328aa2d0a6e6dd; no voters:
I20260203 09:18:46.473811 536 raft_consensus.cc:2804] T 18374de5ba5b4112997f0ebbd4095811 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:46.474174 536 raft_consensus.cc:493] T 18374de5ba5b4112997f0ebbd4095811 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:46.474491 536 raft_consensus.cc:3060] T 18374de5ba5b4112997f0ebbd4095811 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:46.478653 535 ts_tablet_manager.cc:1434] T e092a848890b488baf54eea89baba9ea P 1a4d6aa056f44fb995225297c3cae89c: Time spent starting tablet: real 0.040s user 0.002s sys 0.004s
I20260203 09:18:46.481426 538 tablet_bootstrap.cc:654] T 6fc85217f0e346d48329da6030d7b19e P 680bfc8acebf4aaf91e4794096f34c2f: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.482367 536 raft_consensus.cc:515] T 18374de5ba5b4112997f0ebbd4095811 P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.486464 535 tablet_bootstrap.cc:492] T 449ddd8a621c42c8961c1b4083d664e9 P 1a4d6aa056f44fb995225297c3cae89c: Bootstrap starting.
I20260203 09:18:46.486935 32706 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18374de5ba5b4112997f0ebbd4095811" candidate_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c"
I20260203 09:18:46.487797 32706 raft_consensus.cc:3060] T 18374de5ba5b4112997f0ebbd4095811 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:46.500438 535 tablet_bootstrap.cc:654] T 449ddd8a621c42c8961c1b4083d664e9 P 1a4d6aa056f44fb995225297c3cae89c: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.501223 495 raft_consensus.cc:493] T 404d50c6e6b8437082d1260ee9f2e944 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:46.501698 495 raft_consensus.cc:515] T 404d50c6e6b8437082d1260ee9f2e944 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.502295 537 tablet_bootstrap.cc:492] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd: No bootstrap required, opened a new log
I20260203 09:18:46.502830 537 ts_tablet_manager.cc:1403] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent bootstrapping tablet: real 0.049s user 0.013s sys 0.001s
I20260203 09:18:46.502362 390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18374de5ba5b4112997f0ebbd4095811" candidate_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f"
I20260203 09:18:46.503595 390 raft_consensus.cc:3060] T 18374de5ba5b4112997f0ebbd4095811 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:46.504173 495 leader_election.cc:290] T 404d50c6e6b8437082d1260ee9f2e944 P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:46.505220 315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "404d50c6e6b8437082d1260ee9f2e944" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" is_pre_election: true
I20260203 09:18:46.505609 495 raft_consensus.cc:493] T e092a848890b488baf54eea89baba9ea P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:46.506109 495 raft_consensus.cc:515] T e092a848890b488baf54eea89baba9ea P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.506341 389 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "404d50c6e6b8437082d1260ee9f2e944" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f" is_pre_election: true
I20260203 09:18:46.506968 389 raft_consensus.cc:2468] T 404d50c6e6b8437082d1260ee9f2e944 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 0.
I20260203 09:18:46.508265 32672 leader_election.cc:304] T 404d50c6e6b8437082d1260ee9f2e944 P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, 680bfc8acebf4aaf91e4794096f34c2f; no voters:
I20260203 09:18:46.508786 495 leader_election.cc:290] T e092a848890b488baf54eea89baba9ea P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:46.508862 313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e092a848890b488baf54eea89baba9ea" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" is_pre_election: true
I20260203 09:18:46.509697 313 raft_consensus.cc:2468] T e092a848890b488baf54eea89baba9ea P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 0.
I20260203 09:18:46.505860 315 raft_consensus.cc:2468] T 404d50c6e6b8437082d1260ee9f2e944 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 0.
I20260203 09:18:46.510268 389 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e092a848890b488baf54eea89baba9ea" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f" is_pre_election: true
I20260203 09:18:46.509387 524 raft_consensus.cc:2804] T 404d50c6e6b8437082d1260ee9f2e944 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:46.510912 524 raft_consensus.cc:493] T 404d50c6e6b8437082d1260ee9f2e944 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:46.510907 389 raft_consensus.cc:2468] T e092a848890b488baf54eea89baba9ea P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 0.
I20260203 09:18:46.511368 524 raft_consensus.cc:3060] T 404d50c6e6b8437082d1260ee9f2e944 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:46.511590 390 raft_consensus.cc:2468] T 18374de5ba5b4112997f0ebbd4095811 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1394f30f39e4553a7328aa2d0a6e6dd in term 1.
I20260203 09:18:46.512800 32747 leader_election.cc:304] T 18374de5ba5b4112997f0ebbd4095811 P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bfc8acebf4aaf91e4794096f34c2f, e1394f30f39e4553a7328aa2d0a6e6dd; no voters:
I20260203 09:18:46.514206 518 raft_consensus.cc:2804] T 18374de5ba5b4112997f0ebbd4095811 P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:46.515219 538 tablet_bootstrap.cc:492] T 6fc85217f0e346d48329da6030d7b19e P 680bfc8acebf4aaf91e4794096f34c2f: No bootstrap required, opened a new log
I20260203 09:18:46.515877 538 ts_tablet_manager.cc:1403] T 6fc85217f0e346d48329da6030d7b19e P 680bfc8acebf4aaf91e4794096f34c2f: Time spent bootstrapping tablet: real 0.044s user 0.017s sys 0.004s
I20260203 09:18:46.515798 32672 leader_election.cc:304] T e092a848890b488baf54eea89baba9ea P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, 680bfc8acebf4aaf91e4794096f34c2f; no voters:
I20260203 09:18:46.516716 495 raft_consensus.cc:2804] T e092a848890b488baf54eea89baba9ea P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:46.517127 495 raft_consensus.cc:493] T e092a848890b488baf54eea89baba9ea P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:46.517506 495 raft_consensus.cc:3060] T e092a848890b488baf54eea89baba9ea P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:46.520962 524 raft_consensus.cc:515] T 404d50c6e6b8437082d1260ee9f2e944 P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.503229 536 leader_election.cc:290] T 18374de5ba5b4112997f0ebbd4095811 P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 1 election: Requested vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:46.528892 315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "404d50c6e6b8437082d1260ee9f2e944" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
I20260203 09:18:46.529418 315 raft_consensus.cc:3060] T 404d50c6e6b8437082d1260ee9f2e944 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:46.531816 537 raft_consensus.cc:359] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.532778 537 raft_consensus.cc:385] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.533100 537 raft_consensus.cc:740] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1394f30f39e4553a7328aa2d0a6e6dd, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.534184 518 raft_consensus.cc:697] T 18374de5ba5b4112997f0ebbd4095811 P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 LEADER]: Becoming Leader. State: Replica: e1394f30f39e4553a7328aa2d0a6e6dd, State: Running, Role: LEADER
I20260203 09:18:46.534991 495 raft_consensus.cc:515] T e092a848890b488baf54eea89baba9ea P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.534452 524 leader_election.cc:290] T 404d50c6e6b8437082d1260ee9f2e944 P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 election: Requested vote from peers e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:46.535425 538 raft_consensus.cc:359] T 6fc85217f0e346d48329da6030d7b19e P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.536330 538 raft_consensus.cc:385] T 6fc85217f0e346d48329da6030d7b19e P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.536638 538 raft_consensus.cc:740] T 6fc85217f0e346d48329da6030d7b19e P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.536904 518 consensus_queue.cc:237] T 18374de5ba5b4112997f0ebbd4095811 P e1394f30f39e4553a7328aa2d0a6e6dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.537324 390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "404d50c6e6b8437082d1260ee9f2e944" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f"
I20260203 09:18:46.535624 32706 raft_consensus.cc:2468] T 18374de5ba5b4112997f0ebbd4095811 P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1394f30f39e4553a7328aa2d0a6e6dd in term 1.
I20260203 09:18:46.537498 538 consensus_queue.cc:260] T 6fc85217f0e346d48329da6030d7b19e P 680bfc8acebf4aaf91e4794096f34c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.537954 390 raft_consensus.cc:3060] T 404d50c6e6b8437082d1260ee9f2e944 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:46.540176 538 ts_tablet_manager.cc:1434] T 6fc85217f0e346d48329da6030d7b19e P 680bfc8acebf4aaf91e4794096f34c2f: Time spent starting tablet: real 0.024s user 0.005s sys 0.000s
I20260203 09:18:46.539386 313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e092a848890b488baf54eea89baba9ea" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
I20260203 09:18:46.533855 537 consensus_queue.cc:260] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.541496 313 raft_consensus.cc:3060] T e092a848890b488baf54eea89baba9ea P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:46.537524 495 leader_election.cc:290] T e092a848890b488baf54eea89baba9ea P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 election: Requested vote from peers e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:46.546267 389 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e092a848890b488baf54eea89baba9ea" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f"
I20260203 09:18:46.546931 389 raft_consensus.cc:3060] T e092a848890b488baf54eea89baba9ea P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:46.553701 315 raft_consensus.cc:2468] T 404d50c6e6b8437082d1260ee9f2e944 P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 1.
I20260203 09:18:46.556145 313 raft_consensus.cc:2468] T e092a848890b488baf54eea89baba9ea P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 1.
I20260203 09:18:46.557781 390 raft_consensus.cc:2468] T 404d50c6e6b8437082d1260ee9f2e944 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 1.
I20260203 09:18:46.559249 537 ts_tablet_manager.cc:1434] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent starting tablet: real 0.056s user 0.002s sys 0.006s
I20260203 09:18:46.558985 32672 leader_election.cc:304] T 404d50c6e6b8437082d1260ee9f2e944 P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, e1394f30f39e4553a7328aa2d0a6e6dd; no voters:
I20260203 09:18:46.560572 32672 leader_election.cc:304] T e092a848890b488baf54eea89baba9ea P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, e1394f30f39e4553a7328aa2d0a6e6dd; no voters:
I20260203 09:18:46.560847 495 raft_consensus.cc:2804] T 404d50c6e6b8437082d1260ee9f2e944 P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:46.561457 524 raft_consensus.cc:2804] T e092a848890b488baf54eea89baba9ea P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:46.561810 535 tablet_bootstrap.cc:492] T 449ddd8a621c42c8961c1b4083d664e9 P 1a4d6aa056f44fb995225297c3cae89c: No bootstrap required, opened a new log
I20260203 09:18:46.562444 535 ts_tablet_manager.cc:1403] T 449ddd8a621c42c8961c1b4083d664e9 P 1a4d6aa056f44fb995225297c3cae89c: Time spent bootstrapping tablet: real 0.076s user 0.011s sys 0.009s
I20260203 09:18:46.560510 537 tablet_bootstrap.cc:492] T 7bac68369bd3469d9961c738fbd51a9e P e1394f30f39e4553a7328aa2d0a6e6dd: Bootstrap starting.
I20260203 09:18:46.565500 535 raft_consensus.cc:359] T 449ddd8a621c42c8961c1b4083d664e9 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.566272 535 raft_consensus.cc:385] T 449ddd8a621c42c8961c1b4083d664e9 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.566555 535 raft_consensus.cc:740] T 449ddd8a621c42c8961c1b4083d664e9 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.567288 535 consensus_queue.cc:260] T 449ddd8a621c42c8961c1b4083d664e9 P 1a4d6aa056f44fb995225297c3cae89c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.553465 538 tablet_bootstrap.cc:492] T 1c2ee4a758ff49d6bfe40298d9f815d4 P 680bfc8acebf4aaf91e4794096f34c2f: Bootstrap starting.
I20260203 09:18:46.585326 495 raft_consensus.cc:697] T 404d50c6e6b8437082d1260ee9f2e944 P 1a4d6aa056f44fb995225297c3cae89c [term 1 LEADER]: Becoming Leader. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Running, Role: LEADER
I20260203 09:18:46.586535 495 consensus_queue.cc:237] T 404d50c6e6b8437082d1260ee9f2e944 P 1a4d6aa056f44fb995225297c3cae89c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.587476 535 ts_tablet_manager.cc:1434] T 449ddd8a621c42c8961c1b4083d664e9 P 1a4d6aa056f44fb995225297c3cae89c: Time spent starting tablet: real 0.025s user 0.017s sys 0.007s
I20260203 09:18:46.588691 535 tablet_bootstrap.cc:492] T 6fc85217f0e346d48329da6030d7b19e P 1a4d6aa056f44fb995225297c3cae89c: Bootstrap starting.
I20260203 09:18:46.589102 389 raft_consensus.cc:2468] T e092a848890b488baf54eea89baba9ea P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 1.
I20260203 09:18:46.593284 524 raft_consensus.cc:697] T e092a848890b488baf54eea89baba9ea P 1a4d6aa056f44fb995225297c3cae89c [term 1 LEADER]: Becoming Leader. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Running, Role: LEADER
I20260203 09:18:46.596221 524 consensus_queue.cc:237] T e092a848890b488baf54eea89baba9ea P 1a4d6aa056f44fb995225297c3cae89c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.597124 538 tablet_bootstrap.cc:654] T 1c2ee4a758ff49d6bfe40298d9f815d4 P 680bfc8acebf4aaf91e4794096f34c2f: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.598483 535 tablet_bootstrap.cc:654] T 6fc85217f0e346d48329da6030d7b19e P 1a4d6aa056f44fb995225297c3cae89c: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.602103 537 tablet_bootstrap.cc:654] T 7bac68369bd3469d9961c738fbd51a9e P e1394f30f39e4553a7328aa2d0a6e6dd: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.601986 32603 catalog_manager.cc:5654] T 18374de5ba5b4112997f0ebbd4095811 P e1394f30f39e4553a7328aa2d0a6e6dd reported cstate change: term changed from 0 to 1, leader changed from <none> to e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66). New cstate: current_term: 1 leader_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:46.612053 450 raft_consensus.cc:493] T 23b00275b2f9473eafd8800758e46884 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:46.612802 450 raft_consensus.cc:515] T 23b00275b2f9473eafd8800758e46884 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.616569 32706 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23b00275b2f9473eafd8800758e46884" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c" is_pre_election: true
I20260203 09:18:46.619372 32706 raft_consensus.cc:2468] T 23b00275b2f9473eafd8800758e46884 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 0.
I20260203 09:18:46.621109 355 leader_election.cc:304] T 23b00275b2f9473eafd8800758e46884 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, 680bfc8acebf4aaf91e4794096f34c2f; no voters:
I20260203 09:18:46.630183 570 raft_consensus.cc:2804] T 23b00275b2f9473eafd8800758e46884 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:46.630787 570 raft_consensus.cc:493] T 23b00275b2f9473eafd8800758e46884 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:46.631160 570 raft_consensus.cc:3060] T 23b00275b2f9473eafd8800758e46884 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:46.634367 538 tablet_bootstrap.cc:492] T 1c2ee4a758ff49d6bfe40298d9f815d4 P 680bfc8acebf4aaf91e4794096f34c2f: No bootstrap required, opened a new log
I20260203 09:18:46.635079 538 ts_tablet_manager.cc:1403] T 1c2ee4a758ff49d6bfe40298d9f815d4 P 680bfc8acebf4aaf91e4794096f34c2f: Time spent bootstrapping tablet: real 0.084s user 0.006s sys 0.009s
I20260203 09:18:46.635833 535 tablet_bootstrap.cc:492] T 6fc85217f0e346d48329da6030d7b19e P 1a4d6aa056f44fb995225297c3cae89c: No bootstrap required, opened a new log
I20260203 09:18:46.636901 535 ts_tablet_manager.cc:1403] T 6fc85217f0e346d48329da6030d7b19e P 1a4d6aa056f44fb995225297c3cae89c: Time spent bootstrapping tablet: real 0.048s user 0.019s sys 0.002s
I20260203 09:18:46.618460 313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23b00275b2f9473eafd8800758e46884" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" is_pre_election: true
I20260203 09:18:46.638662 313 raft_consensus.cc:2468] T 23b00275b2f9473eafd8800758e46884 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 0.
I20260203 09:18:46.637795 518 raft_consensus.cc:493] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:46.643877 518 raft_consensus.cc:515] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.622641 450 leader_election.cc:290] T 23b00275b2f9473eafd8800758e46884 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595)
I20260203 09:18:46.645097 450 raft_consensus.cc:493] T 6fc85217f0e346d48329da6030d7b19e P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:46.645608 450 raft_consensus.cc:515] T 6fc85217f0e346d48329da6030d7b19e P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.647192 32706 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "449ddd8a621c42c8961c1b4083d664e9" candidate_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c" is_pre_election: true
I20260203 09:18:46.647912 32706 raft_consensus.cc:2468] T 449ddd8a621c42c8961c1b4083d664e9 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1394f30f39e4553a7328aa2d0a6e6dd in term 0.
I20260203 09:18:46.648177 390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "449ddd8a621c42c8961c1b4083d664e9" candidate_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f" is_pre_election: true
I20260203 09:18:46.648995 313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fc85217f0e346d48329da6030d7b19e" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" is_pre_election: true
I20260203 09:18:46.649096 32748 leader_election.cc:304] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, e1394f30f39e4553a7328aa2d0a6e6dd; no voters:
I20260203 09:18:46.649675 313 raft_consensus.cc:2468] T 6fc85217f0e346d48329da6030d7b19e P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 0.
W20260203 09:18:46.649837 32747 leader_election.cc:343] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:46.650574 557 raft_consensus.cc:2804] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:46.650979 557 raft_consensus.cc:493] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:46.651095 518 leader_election.cc:290] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:46.651340 557 raft_consensus.cc:3060] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:46.652797 562 raft_consensus.cc:493] T 7c6053c0caec43d89bad47f59c2313ff P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:46.647809 450 leader_election.cc:290] T 6fc85217f0e346d48329da6030d7b19e P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595)
I20260203 09:18:46.652217 538 raft_consensus.cc:359] T 1c2ee4a758ff49d6bfe40298d9f815d4 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.653316 562 raft_consensus.cc:515] T 7c6053c0caec43d89bad47f59c2313ff P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.654093 538 raft_consensus.cc:385] T 1c2ee4a758ff49d6bfe40298d9f815d4 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.654453 538 raft_consensus.cc:740] T 1c2ee4a758ff49d6bfe40298d9f815d4 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.655655 538 consensus_queue.cc:260] T 1c2ee4a758ff49d6bfe40298d9f815d4 P 680bfc8acebf4aaf91e4794096f34c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.658645 538 ts_tablet_manager.cc:1434] T 1c2ee4a758ff49d6bfe40298d9f815d4 P 680bfc8acebf4aaf91e4794096f34c2f: Time spent starting tablet: real 0.023s user 0.009s sys 0.000s
I20260203 09:18:46.659849 538 tablet_bootstrap.cc:492] T 449ddd8a621c42c8961c1b4083d664e9 P 680bfc8acebf4aaf91e4794096f34c2f: Bootstrap starting.
I20260203 09:18:46.661959 354 leader_election.cc:304] T 6fc85217f0e346d48329da6030d7b19e P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 680bfc8acebf4aaf91e4794096f34c2f, e1394f30f39e4553a7328aa2d0a6e6dd; no voters:
I20260203 09:18:46.662657 562 leader_election.cc:290] T 7c6053c0caec43d89bad47f59c2313ff P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:46.663787 390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c6053c0caec43d89bad47f59c2313ff" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f" is_pre_election: true
I20260203 09:18:46.664461 390 raft_consensus.cc:2468] T 7c6053c0caec43d89bad47f59c2313ff P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 0.
I20260203 09:18:46.665686 32672 leader_election.cc:304] T 7c6053c0caec43d89bad47f59c2313ff P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, 680bfc8acebf4aaf91e4794096f34c2f; no voters:
I20260203 09:18:46.668262 562 raft_consensus.cc:2804] T 7c6053c0caec43d89bad47f59c2313ff P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:46.654453 535 raft_consensus.cc:359] T 6fc85217f0e346d48329da6030d7b19e P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.668627 562 raft_consensus.cc:493] T 7c6053c0caec43d89bad47f59c2313ff P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:46.668613 313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c6053c0caec43d89bad47f59c2313ff" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" is_pre_election: true
I20260203 09:18:46.669428 562 raft_consensus.cc:3060] T 7c6053c0caec43d89bad47f59c2313ff P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:46.669787 313 raft_consensus.cc:2468] T 7c6053c0caec43d89bad47f59c2313ff P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 0.
W20260203 09:18:46.669090 355 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.26.232.65:39083, user_credentials={real_user=slave}} blocked reactor thread for 48224.3us
I20260203 09:18:46.671398 32605 catalog_manager.cc:5654] T 404d50c6e6b8437082d1260ee9f2e944 P 1a4d6aa056f44fb995225297c3cae89c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65). New cstate: current_term: 1 leader_uuid: "1a4d6aa056f44fb995225297c3cae89c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:46.673620 450 raft_consensus.cc:2804] T 6fc85217f0e346d48329da6030d7b19e P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260203 09:18:46.672408 535 raft_consensus.cc:385] T 6fc85217f0e346d48329da6030d7b19e P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.674129 32706 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fc85217f0e346d48329da6030d7b19e" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c" is_pre_election: true
I20260203 09:18:46.674173 450 raft_consensus.cc:493] T 6fc85217f0e346d48329da6030d7b19e P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260203 09:18:46.676968 450 raft_consensus.cc:3060] T 6fc85217f0e346d48329da6030d7b19e P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:46.674810 535 raft_consensus.cc:740] T 6fc85217f0e346d48329da6030d7b19e P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.680469 562 raft_consensus.cc:515] T 7c6053c0caec43d89bad47f59c2313ff P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.671816 557 raft_consensus.cc:515] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.685416 537 tablet_bootstrap.cc:492] T 7bac68369bd3469d9961c738fbd51a9e P e1394f30f39e4553a7328aa2d0a6e6dd: No bootstrap required, opened a new log
I20260203 09:18:46.685976 537 ts_tablet_manager.cc:1403] T 7bac68369bd3469d9961c738fbd51a9e P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent bootstrapping tablet: real 0.126s user 0.054s sys 0.013s
I20260203 09:18:46.686133 32708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "449ddd8a621c42c8961c1b4083d664e9" candidate_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c"
I20260203 09:18:46.686755 32708 raft_consensus.cc:3060] T 449ddd8a621c42c8961c1b4083d664e9 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:46.688153 535 consensus_queue.cc:260] T 6fc85217f0e346d48329da6030d7b19e P 1a4d6aa056f44fb995225297c3cae89c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.688745 537 raft_consensus.cc:359] T 7bac68369bd3469d9961c738fbd51a9e P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.689555 537 raft_consensus.cc:385] T 7bac68369bd3469d9961c738fbd51a9e P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.689798 537 raft_consensus.cc:740] T 7bac68369bd3469d9961c738fbd51a9e P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1394f30f39e4553a7328aa2d0a6e6dd, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.690455 562 leader_election.cc:290] T 7c6053c0caec43d89bad47f59c2313ff P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 election: Requested vote from peers e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:46.691205 538 tablet_bootstrap.cc:654] T 449ddd8a621c42c8961c1b4083d664e9 P 680bfc8acebf4aaf91e4794096f34c2f: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.691431 32706 raft_consensus.cc:2468] T 6fc85217f0e346d48329da6030d7b19e P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 0.
I20260203 09:18:46.691522 390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c6053c0caec43d89bad47f59c2313ff" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f"
I20260203 09:18:46.692171 390 raft_consensus.cc:3060] T 7c6053c0caec43d89bad47f59c2313ff P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:46.691250 313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c6053c0caec43d89bad47f59c2313ff" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
I20260203 09:18:46.695231 313 raft_consensus.cc:3060] T 7c6053c0caec43d89bad47f59c2313ff P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:46.695607 535 ts_tablet_manager.cc:1434] T 6fc85217f0e346d48329da6030d7b19e P 1a4d6aa056f44fb995225297c3cae89c: Time spent starting tablet: real 0.057s user 0.001s sys 0.007s
I20260203 09:18:46.696863 535 tablet_bootstrap.cc:492] T 7bac68369bd3469d9961c738fbd51a9e P 1a4d6aa056f44fb995225297c3cae89c: Bootstrap starting.
I20260203 09:18:46.698596 570 raft_consensus.cc:515] T 23b00275b2f9473eafd8800758e46884 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.705739 313 raft_consensus.cc:2468] T 7c6053c0caec43d89bad47f59c2313ff P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 1.
I20260203 09:18:46.706900 537 consensus_queue.cc:260] T 7bac68369bd3469d9961c738fbd51a9e P e1394f30f39e4553a7328aa2d0a6e6dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.707993 32672 leader_election.cc:304] T 7c6053c0caec43d89bad47f59c2313ff P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, e1394f30f39e4553a7328aa2d0a6e6dd; no voters:
I20260203 09:18:46.708875 562 raft_consensus.cc:2804] T 7c6053c0caec43d89bad47f59c2313ff P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:46.709285 537 ts_tablet_manager.cc:1434] T 7bac68369bd3469d9961c738fbd51a9e P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent starting tablet: real 0.023s user 0.008s sys 0.000s
I20260203 09:18:46.709447 562 raft_consensus.cc:697] T 7c6053c0caec43d89bad47f59c2313ff P 1a4d6aa056f44fb995225297c3cae89c [term 1 LEADER]: Becoming Leader. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Running, Role: LEADER
I20260203 09:18:46.711201 32706 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23b00275b2f9473eafd8800758e46884" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c"
I20260203 09:18:46.711405 315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23b00275b2f9473eafd8800758e46884" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
I20260203 09:18:46.711863 32706 raft_consensus.cc:3060] T 23b00275b2f9473eafd8800758e46884 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:46.711988 315 raft_consensus.cc:3060] T 23b00275b2f9473eafd8800758e46884 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:46.711719 562 consensus_queue.cc:237] T 7c6053c0caec43d89bad47f59c2313ff P 1a4d6aa056f44fb995225297c3cae89c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.715925 570 leader_election.cc:290] T 23b00275b2f9473eafd8800758e46884 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 election: Requested vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595)
I20260203 09:18:46.719489 535 tablet_bootstrap.cc:654] T 7bac68369bd3469d9961c738fbd51a9e P 1a4d6aa056f44fb995225297c3cae89c: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.722369 32706 raft_consensus.cc:2468] T 23b00275b2f9473eafd8800758e46884 P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 1.
I20260203 09:18:46.723755 355 leader_election.cc:304] T 23b00275b2f9473eafd8800758e46884 P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, 680bfc8acebf4aaf91e4794096f34c2f; no voters:
I20260203 09:18:46.724790 570 raft_consensus.cc:2804] T 23b00275b2f9473eafd8800758e46884 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:46.725363 570 raft_consensus.cc:697] T 23b00275b2f9473eafd8800758e46884 P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Becoming Leader. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Running, Role: LEADER
I20260203 09:18:46.726244 570 consensus_queue.cc:237] T 23b00275b2f9473eafd8800758e46884 P 680bfc8acebf4aaf91e4794096f34c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.729184 537 tablet_bootstrap.cc:492] T 1c2ee4a758ff49d6bfe40298d9f815d4 P e1394f30f39e4553a7328aa2d0a6e6dd: Bootstrap starting.
I20260203 09:18:46.739226 537 tablet_bootstrap.cc:654] T 1c2ee4a758ff49d6bfe40298d9f815d4 P e1394f30f39e4553a7328aa2d0a6e6dd: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.744228 535 tablet_bootstrap.cc:492] T 7bac68369bd3469d9961c738fbd51a9e P 1a4d6aa056f44fb995225297c3cae89c: No bootstrap required, opened a new log
I20260203 09:18:46.744982 535 ts_tablet_manager.cc:1403] T 7bac68369bd3469d9961c738fbd51a9e P 1a4d6aa056f44fb995225297c3cae89c: Time spent bootstrapping tablet: real 0.048s user 0.018s sys 0.000s
I20260203 09:18:46.753290 535 raft_consensus.cc:359] T 7bac68369bd3469d9961c738fbd51a9e P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.754259 535 raft_consensus.cc:385] T 7bac68369bd3469d9961c738fbd51a9e P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.754573 535 raft_consensus.cc:740] T 7bac68369bd3469d9961c738fbd51a9e P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.755409 535 consensus_queue.cc:260] T 7bac68369bd3469d9961c738fbd51a9e P 1a4d6aa056f44fb995225297c3cae89c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.758319 535 ts_tablet_manager.cc:1434] T 7bac68369bd3469d9961c738fbd51a9e P 1a4d6aa056f44fb995225297c3cae89c: Time spent starting tablet: real 0.013s user 0.008s sys 0.000s
I20260203 09:18:46.759886 535 tablet_bootstrap.cc:492] T 1c2ee4a758ff49d6bfe40298d9f815d4 P 1a4d6aa056f44fb995225297c3cae89c: Bootstrap starting.
I20260203 09:18:46.763226 32708 raft_consensus.cc:2468] T 449ddd8a621c42c8961c1b4083d664e9 P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1394f30f39e4553a7328aa2d0a6e6dd in term 1.
I20260203 09:18:46.769362 32748 leader_election.cc:304] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, e1394f30f39e4553a7328aa2d0a6e6dd; no voters:
I20260203 09:18:46.774063 32605 catalog_manager.cc:5654] T e092a848890b488baf54eea89baba9ea P 1a4d6aa056f44fb995225297c3cae89c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65). New cstate: current_term: 1 leader_uuid: "1a4d6aa056f44fb995225297c3cae89c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:46.774921 518 raft_consensus.cc:2804] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:46.775983 518 raft_consensus.cc:697] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 LEADER]: Becoming Leader. State: Replica: e1394f30f39e4553a7328aa2d0a6e6dd, State: Running, Role: LEADER
I20260203 09:18:46.777058 518 consensus_queue.cc:237] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.780071 535 tablet_bootstrap.cc:654] T 1c2ee4a758ff49d6bfe40298d9f815d4 P 1a4d6aa056f44fb995225297c3cae89c: Neither blocks nor log segments found. Creating new log.
I20260203 09:18:46.782459 391 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "449ddd8a621c42c8961c1b4083d664e9" candidate_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f"
W20260203 09:18:46.784215 32747 leader_election.cc:343] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635): Illegal state: must be running to vote when last-logged opid is not known
I20260203 09:18:46.784894 557 leader_election.cc:290] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd [CANDIDATE]: Term 1 election: Requested vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:46.789301 390 raft_consensus.cc:2468] T 7c6053c0caec43d89bad47f59c2313ff P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a4d6aa056f44fb995225297c3cae89c in term 1.
I20260203 09:18:46.746783 315 raft_consensus.cc:2468] T 23b00275b2f9473eafd8800758e46884 P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 1.
I20260203 09:18:46.800486 535 tablet_bootstrap.cc:492] T 1c2ee4a758ff49d6bfe40298d9f815d4 P 1a4d6aa056f44fb995225297c3cae89c: No bootstrap required, opened a new log
I20260203 09:18:46.801178 535 ts_tablet_manager.cc:1403] T 1c2ee4a758ff49d6bfe40298d9f815d4 P 1a4d6aa056f44fb995225297c3cae89c: Time spent bootstrapping tablet: real 0.042s user 0.012s sys 0.003s
I20260203 09:18:46.804616 535 raft_consensus.cc:359] T 1c2ee4a758ff49d6bfe40298d9f815d4 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.805462 535 raft_consensus.cc:385] T 1c2ee4a758ff49d6bfe40298d9f815d4 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.805819 535 raft_consensus.cc:740] T 1c2ee4a758ff49d6bfe40298d9f815d4 P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a4d6aa056f44fb995225297c3cae89c, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.811489 32605 catalog_manager.cc:5654] T 23b00275b2f9473eafd8800758e46884 P 680bfc8acebf4aaf91e4794096f34c2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67). New cstate: current_term: 1 leader_uuid: "680bfc8acebf4aaf91e4794096f34c2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:46.823144 537 tablet_bootstrap.cc:492] T 1c2ee4a758ff49d6bfe40298d9f815d4 P e1394f30f39e4553a7328aa2d0a6e6dd: No bootstrap required, opened a new log
I20260203 09:18:46.815373 450 raft_consensus.cc:515] T 6fc85217f0e346d48329da6030d7b19e P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.824888 32603 catalog_manager.cc:5654] T 449ddd8a621c42c8961c1b4083d664e9 P e1394f30f39e4553a7328aa2d0a6e6dd reported cstate change: term changed from 0 to 1, leader changed from <none> to e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66). New cstate: current_term: 1 leader_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:46.826093 535 consensus_queue.cc:260] T 1c2ee4a758ff49d6bfe40298d9f815d4 P 1a4d6aa056f44fb995225297c3cae89c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.827402 450 leader_election.cc:290] T 6fc85217f0e346d48329da6030d7b19e P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 election: Requested vote from peers 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65:39083), e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595)
I20260203 09:18:46.828688 537 ts_tablet_manager.cc:1403] T 1c2ee4a758ff49d6bfe40298d9f815d4 P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent bootstrapping tablet: real 0.100s user 0.026s sys 0.023s
I20260203 09:18:46.830879 32602 catalog_manager.cc:5654] T 7c6053c0caec43d89bad47f59c2313ff P 1a4d6aa056f44fb995225297c3cae89c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a4d6aa056f44fb995225297c3cae89c (127.26.232.65). New cstate: current_term: 1 leader_uuid: "1a4d6aa056f44fb995225297c3cae89c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } health_report { overall_health: UNKNOWN } } }
I20260203 09:18:46.831727 315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fc85217f0e346d48329da6030d7b19e" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd"
I20260203 09:18:46.833180 32708 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fc85217f0e346d48329da6030d7b19e" candidate_uuid: "680bfc8acebf4aaf91e4794096f34c2f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a4d6aa056f44fb995225297c3cae89c"
I20260203 09:18:46.834545 315 raft_consensus.cc:3060] T 6fc85217f0e346d48329da6030d7b19e P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:46.833148 537 raft_consensus.cc:359] T 1c2ee4a758ff49d6bfe40298d9f815d4 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.834586 32708 raft_consensus.cc:3060] T 6fc85217f0e346d48329da6030d7b19e P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Advancing to term 1
I20260203 09:18:46.829454 535 ts_tablet_manager.cc:1434] T 1c2ee4a758ff49d6bfe40298d9f815d4 P 1a4d6aa056f44fb995225297c3cae89c: Time spent starting tablet: real 0.028s user 0.003s sys 0.004s
I20260203 09:18:46.840919 537 raft_consensus.cc:385] T 1c2ee4a758ff49d6bfe40298d9f815d4 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.841398 537 raft_consensus.cc:740] T 1c2ee4a758ff49d6bfe40298d9f815d4 P e1394f30f39e4553a7328aa2d0a6e6dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1394f30f39e4553a7328aa2d0a6e6dd, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.844311 32708 raft_consensus.cc:2468] T 6fc85217f0e346d48329da6030d7b19e P 1a4d6aa056f44fb995225297c3cae89c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 1.
I20260203 09:18:46.845943 355 leader_election.cc:304] T 6fc85217f0e346d48329da6030d7b19e P 680bfc8acebf4aaf91e4794096f34c2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a4d6aa056f44fb995225297c3cae89c, 680bfc8acebf4aaf91e4794096f34c2f; no voters:
I20260203 09:18:46.849010 450 raft_consensus.cc:2804] T 6fc85217f0e346d48329da6030d7b19e P 680bfc8acebf4aaf91e4794096f34c2f [term 1 FOLLOWER]: Leader election won for term 1
I20260203 09:18:46.849912 450 raft_consensus.cc:697] T 6fc85217f0e346d48329da6030d7b19e P 680bfc8acebf4aaf91e4794096f34c2f [term 1 LEADER]: Becoming Leader. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Running, Role: LEADER
I20260203 09:18:46.850934 450 consensus_queue.cc:237] T 6fc85217f0e346d48329da6030d7b19e P 680bfc8acebf4aaf91e4794096f34c2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.854497 315 raft_consensus.cc:2468] T 6fc85217f0e346d48329da6030d7b19e P e1394f30f39e4553a7328aa2d0a6e6dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 680bfc8acebf4aaf91e4794096f34c2f in term 1.
I20260203 09:18:46.865758 537 consensus_queue.cc:260] T 1c2ee4a758ff49d6bfe40298d9f815d4 P e1394f30f39e4553a7328aa2d0a6e6dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.866993 538 tablet_bootstrap.cc:492] T 449ddd8a621c42c8961c1b4083d664e9 P 680bfc8acebf4aaf91e4794096f34c2f: No bootstrap required, opened a new log
I20260203 09:18:46.867540 538 ts_tablet_manager.cc:1403] T 449ddd8a621c42c8961c1b4083d664e9 P 680bfc8acebf4aaf91e4794096f34c2f: Time spent bootstrapping tablet: real 0.208s user 0.050s sys 0.049s
I20260203 09:18:46.868275 537 ts_tablet_manager.cc:1434] T 1c2ee4a758ff49d6bfe40298d9f815d4 P e1394f30f39e4553a7328aa2d0a6e6dd: Time spent starting tablet: real 0.038s user 0.017s sys 0.010s
I20260203 09:18:46.870290 538 raft_consensus.cc:359] T 449ddd8a621c42c8961c1b4083d664e9 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.871014 538 raft_consensus.cc:385] T 449ddd8a621c42c8961c1b4083d664e9 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260203 09:18:46.871272 538 raft_consensus.cc:740] T 449ddd8a621c42c8961c1b4083d664e9 P 680bfc8acebf4aaf91e4794096f34c2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 680bfc8acebf4aaf91e4794096f34c2f, State: Initialized, Role: FOLLOWER
I20260203 09:18:46.871949 538 consensus_queue.cc:260] T 449ddd8a621c42c8961c1b4083d664e9 P 680bfc8acebf4aaf91e4794096f34c2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.877210 562 raft_consensus.cc:493] T 7bac68369bd3469d9961c738fbd51a9e P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260203 09:18:46.877815 562 raft_consensus.cc:515] T 7bac68369bd3469d9961c738fbd51a9e P 1a4d6aa056f44fb995225297c3cae89c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } }
I20260203 09:18:46.878283 32603 catalog_manager.cc:5654] T 6fc85217f0e346d48329da6030d7b19e P 680bfc8acebf4aaf91e4794096f34c2f reported cstate change: term changed from 0 to 1, leader changed from <none> to 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67). New cstate: current_term: 1 leader_uuid: "680bfc8acebf4aaf91e4794096f34c2f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a4d6aa056f44fb995225297c3cae89c" member_type: VOTER last_known_addr { host: "127.26.232.65" port: 39083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1394f30f39e4553a7328aa2d0a6e6dd" member_type: VOTER last_known_addr { host: "127.26.232.66" port: 40595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "680bfc8acebf4aaf91e4794096f34c2f" member_type: VOTER last_known_addr { host: "127.26.232.67" port: 42635 } health_report { overall_health: HEALTHY } } }
I20260203 09:18:46.879487 538 ts_tablet_manager.cc:1434] T 449ddd8a621c42c8961c1b4083d664e9 P 680bfc8acebf4aaf91e4794096f34c2f: Time spent starting tablet: real 0.012s user 0.007s sys 0.002s
I20260203 09:18:46.879840 562 leader_election.cc:290] T 7bac68369bd3469d9961c738fbd51a9e P 1a4d6aa056f44fb995225297c3cae89c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1394f30f39e4553a7328aa2d0a6e6dd (127.26.232.66:40595), 680bfc8acebf4aaf91e4794096f34c2f (127.26.232.67:42635)
I20260203 09:18:46.881129 538 tablet_bootstrap.cc:492] T 7bac68369bd3469d9961c738fbd51a9e P 680bfc8acebf4aaf91e4794096f34c2f: Bootstrap starting.
I20260203 09:18:46.881747 390 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7bac68369bd3469d9961c738fbd51a9e" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "680bfc8acebf4aaf91e4794096f34c2f" is_pre_election: true
I20260203 09:18:46.882174 315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7bac68369bd3469d9961c738fbd51a9e" candidate_uuid: "1a4d6aa056f44fb995225297c3cae89c"